mlsanityData to 7 Oct 2026

Modality-Agnostic Structural Image Representation Learning for Deformable Multi-Modality Medical Image Registration

arXiv 2402.18933 ↗First posted 29 Feb 2024cs.CVcited by 17

Not on the map. Why?

Abstract (arXiv)

Establishing dense anatomical correspondence across distinct imaging modalities is a foundational yet challenging procedure for numerous medical image analysis studies and image-guided radiotherapy. Existing multi-modality image registration algorithms rely on statistical-based similarity measures or local structural image representations. However, the former is sensitive to locally varying noise, while the latter is not discriminative enough to cope with complex anatomical structures in multimodal scans, causing ambiguity in determining the anatomical correspondence across scans with different modalities. In this paper, we propose a modality-agnostic structural representation learning method, which leverages Deep Neighbourhood Self-similarity (DNS) and anatomy-aware contrastive learning to learn discriminative and contrast-invariance deep structural image representations (DSIR) without the need for anatomical delineations or pre-aligned training images. We evaluate our method on multiphase CT, abdomen MR-CT, and brain MR T1w-T2w registration. Comprehensive results demonstrate that our method is superior to the conventional local structural representation and statistical-based similarity measures in terms of discriminability and accuracy.

Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Builds on 28 of its 61 references that are in the map. First posted on arXiv 29 Feb 2024.

Builds on

28 of 61 references.

References · 28

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  3. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  4. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  5. 2019Data-Efficient Image Recognition with Contrastive Predictive Codingcited by 672
  6. 2018VoxelMorph: A Learning Framework for Deformable Medical Image Registrationcited by 657
  7. 2020Contrastive Learning for Unpaired Image-to-Image Translationcited by 637
  8. 2019Making Convolutional Networks Shift-Invariant Againcited by 390
  9. 2020Large Deformation Diffeomorphic Image Registration with Laplacian Pyramid Networkscited by 136
  10. 2021Learn2Reg: comprehensive multi-task medical image registration challenge, dataset and evaluation in the era of deep learningcited by 125
  11. 2020Fast Symmetric Diffeomorphic Image Registration with Convolutional Neural Networkscited by 107
  12. 2020Training BatchNorm and Only BatchNorm: On the Expressive Power of Random Features in CNNscited by 103
16 more
  1. 2021HyperMorph: Amortized Hyperparameter Learning for Image Registrationcited by 84
  2. 2020SAM: Self-supervised Learning of Pixel-wise Anatomical Embeddings in Radiological Imagescited by 66
  3. 2020CoMIR: Contrastive Multimodal Image Representation for Registrationcited by 45
  4. 2021Fast 3D registration with accurate optimisation and little learning for Learn2Reg 2021cited by 40
  5. 2022Affine Medical Image Registration with Coarse-to-Fine Vision Transformercited by 35
  6. 2020Multi-Site Infant Brain Segmentation Algorithms: The iSeg-2019 Challengecited by 28
  7. 2022Biomedical image analysis competitions: The state of current participation practicecited by 20
  8. 2020Learning Deformable Image Registration from Optimization: Perspective, Modules, Bilevel Training and Beyondcited by 19
  9. 2019Evaluation of MRI to ultrasound registration methods for brain shift correction: The CuRIOUS2018 Challengecited by 16
  10. 2022Unsupervised Deformable Image Registration with Absent Correspondences in Pre-operative and Post-Recurrence Brain Tumor MRI Scanscited by 15
  11. 2023SAMConvex: Fast Discrete Optimization for CT Registration using Self-supervised Anatomical Embedding and Correlation Pyramidcited by 14
  12. 2022Robust Image Registration with Absent Correspondences in Pre-operative and Follow-up Brain MRI Scans of Diffuse Glioma Patientscited by 9
  13. 2022Automated Learning for Deformable Medical Image Registration by Jointly Optimizing Network Architectures and Objective Functionscited by 8
  14. 2023Unsupervised 3D registration through optimization-guided cyclical self-trainingcited by 7
  15. 2020JSSR: A Joint Synthesis, Segmentation, and Registration System for 3D Multi-Modal Image Alignment of Large-scale Pathological CT Scanscited by 3
  16. 2023Matching in the Wild: Learning Anatomical Embeddings for Multi-Modality Imagescited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 5; 2025: 5; 2026: 7.

17 papers.

Sort:

  1. 2024uniGradICON: A Foundation Model for Medical Image Registrationcited by 55
  2. 2024Learning General-Purpose Biomedical Volume Representations using Randomized Synthesiscited by 27
  3. 2024multiGradICON: A Foundation Model for Multimodal Medical Image Registrationcited by 16
  4. 2024Cross-Modal Few-Shot Learning: a Generative Transfer Learning Frameworkcited by 2
  5. 2024CABLD: Contrast-Agnostic Brain Landmark Detection with Consistency-Based Regularizationcited by 2
  6. 2025UniReg: Conditional Unified Model for Medical Image Registrationcited by 2
  7. 2025Mono-Modalizing Extremely Heterogeneous Multi-Modal Medical Image Registrationcited by 1
  8. 2025Intraoperative 2D/3D Registration via Spherical Similarity Learning and Differentiable Levenberg-Marquardt Optimizationcited by 1
  9. 2025Uncertainty Estimation for Pretrained Medical Image Registration Models via Transformation Equivariancecited by 1
  10. 2025Multimodal Diffeomorphic Registration with Neural ODEs and Structural Descriptorscited by 0
  11. 2026Adaptive Conditional Contrast-Agnostic Deformable Image Registration with Uncertainty Estimationcited by 0
  12. 2026PCReg-Net: Progressive Contrast-Guided Registration for Cross-Domain Image Alignmentcited by 0
5 more
  1. 2026Robust Self-Supervised Cross-Modal Super-Resolution against Real-World Misaligned Observationscited by 0
  2. 2026CoRe: Joint Optimization with Contrastive Learning for Medical Image Registrationcited by 0
  3. 2026Adapting Frozen Mono-modal Backbones for Multi-modal Registration via Contrast-Agnostic Instance Optimizationcited by 0
  4. 2026Patient-Agnostic Synthetic Pretraining for Efficient Patient-Specific Intraoperative 2D/3D Registrationcited by 0
  5. 2026Benchmarking Intra-Patient 3D Deformable Multimodal Image Registrationcited by 0