license: apache-2.0
tags:
- medical-imaging
- image-registration
- torchscript
- impact
- pretrained
- segmentation
🧠 TorchScript Models for the IMPACT Semantic Similarity Metric
This repository hosts multiple TorchScript-exported pretrained models used by the IMPACT similarity metric for semantic medical image registration.
The IMPACT metric is described in the following preprint, currently under review:
IMPACT: A Generic Semantic Loss for Multimodal Medical Image Registration
V. Boussot, C. Hémon, J.-C. Nunes, J. Downling, S. Rouzé, C. Lafond, A. Barateau, J.-L. Dillenseger
arXiv:2503.24121 [cs.CV]
The TorchScript models provided in this repository were exported from publicly available pretrained networks. These include:
- TotalSegmentator (TS) — U-Net models trained for full-body anatomical segmentation
- Segment Anything 2.1 (SAM2.1) — Foundation model for segmentation on natural images
- DINOv2 — Self-supervised vision transformer trained on diverse datasets
- Anatomix — Transformer-based model with anatomical priors for medical images
Each model provides multiple feature extraction layers, which can be selected independently using the corresponding model l_Layers. This can be configured through the LayerMask parameter in the IMPACT configuration.
In addition, the repository also includes:
- MIND — A handcrafted Modality Independent Neighborhood Descriptor, wrapped in TorchScript
📚 Pretrained Model References
| Model | Specialization | Paper / Reference | Field of View | License |
|---|---|---|---|---|
| MIND | Handcrafted descriptor | Heinrich et al., 2012 | 2r + 1 |
Research only |
| SAM2.1 | General segmentation (natural images) | Ravi et al., 2023 | 29 | MIT |
| TS Models | Multi-resolution CT/MRI segmentation | Wasserthal et al., 2022 | 2^l + 3 |
Apache 2.0 |
| Anatomix | Anatomy-aware transformer encoder | Dey et al., 2024 | Hierarchical | MIT |
| DINOv2 | Self-supervised vision transformer | Oquab et al., 2023 | Global / ViT-Base | MIT |
🔍 TS Model Variants
TS Models refer to the following TotalSegmentator-derived TorchScript models:M258, M291, M293, M294, M295, M297, M298, M730, M731, M732, M733, M850, M851
Each model is specialized for a specific anatomical structure or resolution (e.g., 3mm / 6mm) and shares the same encoder-decoder architecture.