A survey on deep learning in medical image registration: new technologies, uncertainty, evaluation metrics, and beyond
Not on the map. Why?
Abstract (arXiv)
Deep learning technologies have dramatically reshaped the field of medical image registration over the past decade. The initial developments, such as regression-based and U-Net-based networks, established the foundation for deep learning in image registration. Subsequent progress has been made in various aspects of deep learning-based registration, including similarity measures, deformation regularizations, network architectures, and uncertainty estimation. These advancements have not only enriched the field of image registration but have also facilitated its application in a wide range of tasks, including atlas construction, multi-atlas segmentation, motion estimation, and 2D-3D registration. In this paper, we present a comprehensive overview of the most recent advancements in deep learning-based image registration. We begin with a concise introduction to the core concepts of deep learning-based image registration. Then, we delve into innovative network architectures, loss functions specific to registration, and methods for estimating registration uncertainty. Additionally, this paper explores appropriate evaluation metrics for assessing the performance of deep learning models in registration tasks. Finally, we highlight the practical applications of these novel techniques in medical imaging and discuss the future prospects of deep learning-based image registration.
Key facts. Cited by 55 papers in the map (data through 14 Oct 2026). Builds on 190 of its 495 references that are in the map. First posted on arXiv 28 Jul 2023.
Builds on
190 of 495 references.
References · 190
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2022Generative Adversarial Networkscited by 5,627
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
38 more
- 2018Neural Ordinary Differential Equationscited by 3,779
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
- 2015Spatial Transformer Networkscited by 1,429
- 2021Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNetcited by 1,101
- 2017Deep Image Priorcited by 1,098
- 2021Video Swin Transformercited by 1,091
- 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,059
- 2016HyperNetworkscited by 1,027
- 2021CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classificationcited by 806
- 2016FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networkscited by 784
- 2018VoxelMorph: A Learning Framework for Deformable Medical Image Registrationcited by 662
- 2020Contrastive Learning for Unpaired Image-to-Image Translationcited by 639
- 2022TotalSegmentator: robust segmentation of 104 anatomical structures in CT imagescited by 613
- 2019UNet++: Redesigning Skip Connections to Exploit Multiscale Features in Image Segmentationcited by 586
- 2017Understanding the Effective Receptive Field in Deep Convolutional Neural Networkscited by 553
- 2021CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped Windowscited by 527
- 2018Bilevel Programming for Hyperparameter Optimization and Meta-Learningcited by 405
- 2020Spatiotemporal Contrastive Video Representation Learningcited by 372
- 2015Adversarial Autoencoderscited by 364
- 2017Snapshot Ensembles: Train 1, get M for freecited by 350
- 2016A Learned Representation For Artistic Stylecited by 341
- 2020Keystroke Dynamics as Part of Lifeloggingcited by 334
- 2022Diffusion Models for Medical Image Analysis: A Comprehensive Surveycited by 273
- 2020Space-Time Correspondence as a Contrastive Random Walkcited by 239
- 2021SynthSeg: Segmentation of brain MRI scans of any contrast and resolution without retrainingcited by 237
- 2018Competitive Collaboration: Joint Unsupervised Learning of Depth, Camera Motion, Optical Flow and Motion Segmentationcited by 222
- 2022Particle Video Revisited: Tracking Through Occlusions Using Point Trajectoriescited by 217
- 2019Unsupervised Learning of Probabilistic Diffeomorphic Registration for Images and Surfacescited by 186
- 2018A Deep Learning Framework for Unsupervised Affine and Deformable Image Registrationcited by 160
- 2018Self-Supervised Video Representation Learning with Space-Time Cubic Puzzlescited by 149
- 2020SynthMorph: learning contrast-invariant registration without acquired imagescited by 140
- 2020Large Deformation Diffeomorphic Image Registration with Laplacian Pyramid Networkscited by 136
- 2021TCLR: Temporal Contrastive Learning for Video Representationcited by 136
- 2018Uncertainty Estimates and Multi-Hypotheses Networks for Optical Flowcited by 135
- 2022SynthStrip: Skull-Stripping for Any Brain Imagecited by 127
50 most cited of 190 All 190 (JSON)
Built on by
Citing papers per year: 2023: 2; 2024: 11; 2025: 16; 2026: 26.
55 papers.
Sort:
By area:
- 2024Local Feature Matching Using Deep Learning: A Surveycited by 26
- 2024Similarity and Quality Metrics for MR Image-To-Image Translationcited by 20
- 2024multiGradICON: A Foundation Model for Multimodal Medical Image Registrationcited by 16
- 2025Beyond the LUMIR challenge: The pathway to foundational registration modelscited by 12
- 2024Vector Field Attention for Deformable Image Registrationcited by 10
- 2025DINOv3 with Test-Time Training for Medical Image Registrationcited by 6
- 2025IMPACT: A Generic Semantic Loss for Multimodal Medical Image Registrationcited by 5
- 2025Conformal Lesion Segmentation for 3D Medical Imagescited by 5
- 2023A Survey on Image-text Multimodal Modelscited by 4
- 2024From Registration Uncertainty to Segmentation Uncertaintycited by 4
- 2025Pretraining Deformable Image Registration Networks with Random Imagescited by 3
- 2026Expert-Guided Explainable Few-Shot Learning with Active Sample Selection for Medical Image Analysiscited by 3
38 more
- 2026Learning Domain-Invariant Representations for Cross-Domain Image Registration via Scene-Appearance Disentanglementcited by 3
- 2026CRFT: Consistent-Recurrent Feature Flow Transformer for Cross-Modal Image Registrationcited by 3
- 2023MomentaMorph: Unsupervised Spatial-Temporal Registration with Momenta, Shooting, and Correctioncited by 2
- 2024Is Registering Raw Tagged-MR Enough for Strain Estimation in the Era of Deep Learning?cited by 2
- 2024CTARR: A fast and robust method for identifying anatomical regions on CT images via atlas registrationcited by 2
- 2024CABLD: Contrast-Agnostic Brain Landmark Detection with Consistency-Based Regularizationcited by 2
- 2024Unsupervised learning of spatially varying regularization for diffeomorphic image registrationcited by 2
- 2025Comprehensive Review of Reinforcement Learning for Medical Ultrasound Imagingcited by 2
- 2026Learning to Select Like Humans: Explainable Active Learning for Medical Imagingcited by 2
- 2024Advancing Deformable Medical Image Registration with Multi-axis Cross-covariance Attentioncited by 1
- 2025Spatial regularisation for improved accuracy and interpretability in keypoint-based registrationcited by 1
- 2025Mono-Modalizing Extremely Heterogeneous Multi-Modal Medical Image Registrationcited by 1
- 2025Hyperbolic Cycle Alignment for Infrared-Visible Image Fusioncited by 1
- 2025The Impact of Longitudinal Mammogram Alignment on Breast Cancer Risk Assessmentcited by 1
- 2026Spatiotemporal Gaussian representation-based dynamic reconstruction and motion estimation framework for time-resolved volumetric MR imaging (DREME-GSMR)cited by 1
- 2026VoxCor: Training-Free Volumetric Features for Multimodal Voxel Correspondencecited by 1
- 2026Reliability-Aware CT-MRI Registration: A Quality Engineering Framework with Stability Analysis and Risk Classificationcited by 1
- 2024H-SGANet: Hybrid Sparse Graph Attention Network for Deformable Medical Image Registrationcited by 0
- 2025Reliable Radiologic Skeletal Muscle Area Assessment -- A Biomarker for Cancer Cachexia Diagnosiscited by 0
- 2025Biomechanical Constraints Assimilation in Deep-Learning Image Registration: Application to sliding and locally rigid deformationscited by 0
- 2025X-RAFT: Cross-Modal Non-Rigid Registration of Blue and White Light Neurosurgical Hyperspectral Imagescited by 0
- 2025Surrogate Supervision for Robust and Generalizable Deformable Image Registrationcited by 0
- 2025Efficient Large-Deformation Medical Image Registration via Recurrent Dynamic Correlationcited by 0
- 2025Domain-Shift Immunity in Deep Deformable Registration via Local Feature Representationscited by 0
- 2026Bridging Modalities: Joint Synthesis and Registration Framework for Aligning Diffusion MRI with T1-Weighted Imagescited by 0
- 2026TempDiffReg: Temporal Diffusion Model for Non-Rigid 2D-3D Vascular Registrationcited by 0
- 2026Interpretable Unsupervised Deformable Image Registration via Confidence-bound Multi-Hop Visual Reasoningcited by 0
- 2026Attention-Driven Framework for Non-Rigid Medical Image Registrationcited by 0
- 2026SAS-Net: Cross-Domain Image Registration as Inverse Rendering via Structure-Appearance Factorizationcited by 0
- 2026Data-driven registration and modeling of brain deformation for image-guided neurosurgerycited by 0
- 2026Insertion Network for Image Sequence Correspondencecited by 0
- 2026Deep-Learning Atlas Registration for Melanoma Brain Metastases: Preserving Pathology While Enabling Cohort-Level Analysescited by 0
- 2026PCReg-Net: Progressive Contrast-Guided Registration for Cross-Domain Image Alignmentcited by 0
- 2026Generative Latent Representations of 3D Brain MRI for Multi-Task Downstream Analysis in Down Syndromecited by 0
- 2026Deformation-Free Cross-Domain Image Registration via Position-Encoded Temporal Attentioncited by 0
- 2026On the Degrees of Freedom of Gridded Control Points in Learning-Based Medical Image Registrationcited by 0
- 2026Subspace-Guided Semantic and Topological Invariant Registration for Annotation-Free Ultrasound Plane Quality Controlcited by 0
- 2026DrivenMorph: Bridging Attention Mechanism and Variational Image Registration via Difference Modelingcited by 0
50 most cited of 55 All 55 (JSON)
- 2026Recursive Uncertainty-Gated Image Registration for Learning-based Algorithms23 Sep 2026
- 2026BINDER: A Latent Variable Model for Probabilistic Medical Image Registration17 Sep 2026
- 2026Benchmarking Intra-Patient 3D Deformable Multimodal Image Registration14 Sep 2026
- 2026Is Deformable Image Registration Ready for Brain Metastasis Reirradiation Dose Accumulation? A Longitudinal MRI Benchmark of Registration Accuracy27 Aug 2026
- 2026Reliability-Aware CT-MRI Registration: A Quality Engineering Framework with Stability Analysis and Risk Classification1 Jul 2026
- 2026RBE-Flow: Recurrent Bayesian Estimation on Feature Manifolds for Cross-Modal Registration29 Jun 2026
- 2026DrivenMorph: Bridging Attention Mechanism and Variational Image Registration via Difference Modeling29 Jun 2026
- 2026Subspace-Guided Semantic and Topological Invariant Registration for Annotation-Free Ultrasound Plane Quality Control25 May 2026
- 2026VoxCor: Training-Free Volumetric Features for Multimodal Voxel Correspondence13 May 2026
- 2026Spatiotemporal Gaussian representation-based dynamic reconstruction and motion estimation framework for time-resolved volumetric MR imaging (DREME-GSMR)7 Apr 2026
- 2026CRFT: Consistent-Recurrent Feature Flow Transformer for Cross-Modal Image Registration7 Apr 2026
- 2026On the Degrees of Freedom of Gridded Control Points in Learning-Based Medical Image Registration15 Mar 2026
38 more
- 2026Deformation-Free Cross-Domain Image Registration via Position-Encoded Temporal Attention17 Feb 2026
- 2026Generative Latent Representations of 3D Brain MRI for Multi-Task Downstream Analysis in Down Syndrome14 Feb 2026
- 2026Deep-Learning Atlas Registration for Melanoma Brain Metastases: Preserving Pathology While Enabling Cohort-Level Analyses13 Feb 2026
- 2026Insertion Network for Image Sequence Correspondence13 Feb 2026
- 2026Learning to Select Like Humans: Explainable Active Learning for Medical Imaging10 Feb 2026
- 2026PCReg-Net: Progressive Contrast-Guided Registration for Cross-Domain Image Alignment9 Feb 2026
- 2026Data-driven registration and modeling of brain deformation for image-guided neurosurgery9 Feb 2026
- 2026SAS-Net: Cross-Domain Image Registration as Inverse Rendering via Structure-Appearance Factorization6 Feb 2026
- 2026Attention-Driven Framework for Non-Rigid Medical Image Registration6 Feb 2026
- 2026Interpretable Unsupervised Deformable Image Registration via Confidence-bound Multi-Hop Visual Reasoning30 Jan 2026
- 2026TempDiffReg: Temporal Diffusion Model for Non-Rigid 2D-3D Vascular Registration26 Jan 2026
- 2026Bridging Modalities: Joint Synthesis and Registration Framework for Aligning Diffusion MRI with T1-Weighted Images16 Jan 2026
- 2026Learning Domain-Invariant Representations for Cross-Domain Image Registration via Scene-Appearance Disentanglement12 Jan 2026
- 2026Expert-Guided Explainable Few-Shot Learning with Active Sample Selection for Medical Image Analysis2 Jan 2026
- 2025Domain-Shift Immunity in Deep Deformable Registration via Local Feature Representations29 Dec 2025
- 2025The Impact of Longitudinal Mammogram Alignment on Breast Cancer Risk Assessment11 Nov 2025
- 2025Efficient Large-Deformation Medical Image Registration via Recurrent Dynamic Correlation25 Oct 2025
- 2025Conformal Lesion Segmentation for 3D Medical Images19 Oct 2025
- 2025Surrogate Supervision for Robust and Generalizable Deformable Image Registration11 Sep 2025
- 2025DINOv3 with Test-Time Training for Medical Image Registration20 Aug 2025
- 2025Hyperbolic Cycle Alignment for Infrared-Visible Image Fusion31 Jul 2025
- 2025X-RAFT: Cross-Modal Non-Rigid Registration of Blue and White Light Neurosurgical Hyperspectral Images10 Jul 2025
- 2025Mono-Modalizing Extremely Heterogeneous Multi-Modal Medical Image Registration18 Jun 2025
- 2025Pretraining Deformable Image Registration Networks with Random Images30 May 2025
- 2025Beyond the LUMIR challenge: The pathway to foundational registration models30 May 2025
- 2025Biomechanical Constraints Assimilation in Deep-Learning Image Registration: Application to sliding and locally rigid deformations7 Apr 2025
- 2025IMPACT: A Generic Semantic Loss for Multimodal Medical Image Registration31 Mar 2025
- 2025Reliable Radiologic Skeletal Muscle Area Assessment -- A Biomarker for Cancer Cachexia Diagnosis19 Mar 2025
- 2025Comprehensive Review of Reinforcement Learning for Medical Ultrasound Imaging19 Mar 2025
- 2025Spatial regularisation for improved accuracy and interpretability in keypoint-based registration6 Mar 2025
- 2024Advancing Deformable Medical Image Registration with Multi-axis Cross-covariance Attention24 Dec 2024
- 2024Unsupervised learning of spatially varying regularization for diffeomorphic image registration23 Dec 2024
- 2024CABLD: Contrast-Agnostic Brain Landmark Detection with Consistency-Based Regularization26 Nov 2024
- 2024CTARR: A fast and robust method for identifying anatomical regions on CT images via atlas registration3 Oct 2024
- 2024H-SGANet: Hybrid Sparse Graph Attention Network for Deformable Medical Image Registration29 Aug 2024
- 2024multiGradICON: A Foundation Model for Multimodal Medical Image Registration1 Aug 2024
- 2024Vector Field Attention for Deformable Image Registration14 Jul 2024
- 2024Similarity and Quality Metrics for MR Image-To-Image Translation14 May 2024
50 newest of 55 All 55 (JSON)
- 2024Local Feature Matching Using Deep Learning: A Surveycited by 26
- 2024Similarity and Quality Metrics for MR Image-To-Image Translationcited by 20
- 2024multiGradICON: A Foundation Model for Multimodal Medical Image Registrationcited by 16
- 2025Beyond the LUMIR challenge: The pathway to foundational registration modelscited by 12
- 2024Vector Field Attention for Deformable Image Registrationcited by 10
- 2025DINOv3 with Test-Time Training for Medical Image Registrationcited by 6
- 2025IMPACT: A Generic Semantic Loss for Multimodal Medical Image Registrationcited by 5
- 2025Conformal Lesion Segmentation for 3D Medical Imagescited by 5
- 2023A Survey on Image-text Multimodal Modelscited by 4
- 2024From Registration Uncertainty to Segmentation Uncertaintycited by 4
- 2025Pretraining Deformable Image Registration Networks with Random Imagescited by 3
- 2026Expert-Guided Explainable Few-Shot Learning with Active Sample Selection for Medical Image Analysiscited by 3
12 most cited of 53 All 53 (JSON)
- 2026Recursive Uncertainty-Gated Image Registration for Learning-based Algorithms23 Sep 2026
- 2026BINDER: A Latent Variable Model for Probabilistic Medical Image Registration17 Sep 2026
- 2026Benchmarking Intra-Patient 3D Deformable Multimodal Image Registration14 Sep 2026
- 2026Is Deformable Image Registration Ready for Brain Metastasis Reirradiation Dose Accumulation? A Longitudinal MRI Benchmark of Registration Accuracy27 Aug 2026
- 2026Reliability-Aware CT-MRI Registration: A Quality Engineering Framework with Stability Analysis and Risk Classification1 Jul 2026
- 2026RBE-Flow: Recurrent Bayesian Estimation on Feature Manifolds for Cross-Modal Registration29 Jun 2026
- 2026DrivenMorph: Bridging Attention Mechanism and Variational Image Registration via Difference Modeling29 Jun 2026
- 2026Subspace-Guided Semantic and Topological Invariant Registration for Annotation-Free Ultrasound Plane Quality Control25 May 2026
- 2026VoxCor: Training-Free Volumetric Features for Multimodal Voxel Correspondence13 May 2026
- 2026Spatiotemporal Gaussian representation-based dynamic reconstruction and motion estimation framework for time-resolved volumetric MR imaging (DREME-GSMR)7 Apr 2026
- 2026CRFT: Consistent-Recurrent Feature Flow Transformer for Cross-Modal Image Registration7 Apr 2026
- 2026On the Degrees of Freedom of Gridded Control Points in Learning-Based Medical Image Registration15 Mar 2026
12 newest of 53 All 53 (JSON)