mlsanityData to 14 Oct 2026

Effective Feature Learning for 3D Medical Registration via Domain-Specialized DINO Pretraining

arXiv 2603.14086 ↗First posted 14 Mar 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Medical image registration is a critical component of clinical imaging workflows, enabling accurate longitudinal assessment, multi-modal data fusion, and image-guided interventions. Intensity-based approaches often struggle with interscanner variability and complex anatomical deformations, whereas feature-based methods offer improved robustness by leveraging semantically informed representations. In this work, we investigate DINO-style self-supervised pretraining directly on 3D medical imaging data, aiming to learn dense volumetric features well suited for deformable registration. We assess the resulting representations on challenging interpatient abdominal registration task across both MRI and CT modalities. Our domain-specialized pretraining outperforms the DINOv2 model trained on a large-scale collection of natural images, while requiring substantially lower computational resources at inference time. Moreover, it surpasses established registration models under out-of-domain evaluation, demonstrating the value of task-agnostic yet medical imaging-focused pretraining for robust and efficient 3D image registration.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 16 references that are in the map. First posted on arXiv 14 Mar 2026.

Builds on

10 of 16 references.

References · 10

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  3. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  4. 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 903
  5. 2022TotalSegmentator: robust segmentation of 104 anatomical structures in CT imagescited by 613
  6. 2021Learn2Reg: comprehensive multi-task medical image registration challenge, dataset and evaluation in the era of deep learningcited by 125
  7. 2018Spreading vectors for similarity searchcited by 118
  8. 2025Primus: Enforcing Attention Usage for 3D Medical Image Segmentationcited by 24
  9. 2025Are Vision Foundation Models Ready for Out-of-the-Box Medical Image Registration?cited by 6
  10. 2025TotalRegistrator: Towards a Lightweight Foundation Model for CT Image Registrationcited by 2

Built on by

Not cited yet.