VoxelMorph: A Learning Framework for Deformable Medical Image Registration
Not on the map. Why?
Abstract (arXiv)
We present VoxelMorph, a fast learning-based framework for deformable, pairwise medical image registration. Traditional registration methods optimize an objective function for each pair of images, which can be time-consuming for large datasets or rich deformation models. In contrast to this approach, and building on recent learning-based methods, we formulate registration as a function that maps an input image pair to a deformation field that aligns these images. We parameterize the function via a convolutional neural network (CNN), and optimize the parameters of the neural network on a set of images. Given a new pair of scans, VoxelMorph rapidly computes a deformation field by directly evaluating the function. In this work, we explore two different training strategies. In the first (unsupervised) setting, we train the model to maximize standard image matching objective functions that are based on the image intensities. In the second setting, we leverage auxiliary segmentations available in the training data. We demonstrate that the unsupervised model's accuracy is comparable to state-of-the-art methods, while operating orders of magnitude faster. We also show that VoxelMorph trained with auxiliary data improves registration accuracy at test time, and evaluate the effect of training set size on registration. Our method promises to speed up medical image analysis and processing pipelines, while facilitating novel directions in learning-based registration and its applications. Our code is freely available at voxelmorph.csail.mit.edu.
Key facts. Cited by 657 papers in the map (data through 7 Oct 2026). First posted on arXiv 14 Sep 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 73; 2022: 89; 2023: 125; 2024: 139; 2025: 137; 2026: 94.
657 papers.
Sort:
By area:
- 2021Learn2Reg: comprehensive multi-task medical image registration challenge, dataset and evaluation in the era of deep learningcited by 125
- 2021Recent advances and clinical applications of deep learning in medical image analysiscited by 104
- 2023UniverSeg: Universal Medical Image Segmentationcited by 90
- 2021HyperMorph: Amortized Hyperparameter Learning for Image Registrationcited by 84
- 2021Breaking the Dilemma of Medical Image-to-image Translationcited by 82
- 2022Diffusion Deformable Model for 4D Temporal Medical Image Generationcited by 65
- 2021Recurrent Mask Refinement for Few-Shot Medical Image Segmentationcited by 63
- 2022SADM: Sequence-Aware Diffusion Model for Longitudinal Medical Image Generationcited by 56
- 2023A survey on deep learning in medical image registration: new technologies, uncertainty, evaluation metrics, and beyondcited by 55
- 2024uniGradICON: A Foundation Model for Medical Image Registrationcited by 55
- 2021AFTer-UNet: Axial Fusion Transformer UNet for Medical Image Segmentationcited by 48
- 2022XMorpher: Full Transformer for Deformable Medical Image Registration via Cross Attentioncited by 46
38 more
- 2022Transformers in Medical Image Analysis: A Reviewcited by 41
- 2022textttGradICON: Approximate Diffeomorphisms via Gradient Inverse Consistencycited by 40
- 2022U-Net vs Transformer: Is U-Net Outdated in Medical Image Registration?cited by 40
- 2025MatchAnything: Universal Cross-Modality Image Matching with Large-Scale Pre-Trainingcited by 40
- 2021Accurate Point Cloud Registration with Robust Optimal Transportcited by 38
- 2022Topology-Preserving Shape Reconstruction and Registration via Neural Diffeomorphic Flowcited by 38
- 2024Correlation-aware Coarse-to-fine MLPs for Deformable Medical Image Registrationcited by 37
- 2021RGB-D Salient Object Detection via 3D Convolutional Neural Networkscited by 36
- 2022Learning the Effect of Registration Hyperparameters with HyperMorphcited by 35
- 2024Large-Scale 3D Medical Image Pre-training with Geometric Context Priorscited by 34
- 2021The Brain Tumor Sequence Registration (BraTS-Reg) Challenge: Establishing Correspondence Between Pre-Operative and Follow-up MRI Scans of Diffuse Glioma Patientscited by 32
- 2022Transforming medical imaging with Transformers? A comparative review of key properties, current progresses, and future perspectivescited by 32
- 2021Generative Adversarial Registration for Improved Conditional Deformable Templatescited by 31
- 2022DSFormer: A Dual-domain Self-supervised Transformer for Accelerated Multi-contrast MRI Reconstructioncited by 30
- 2021Meta-Learning to Improve Pre-Trainingcited by 27
- 2021ICON: Learning Regular Maps Through Inverse Consistencycited by 26
- 2021Learning a Model-Driven Variational Network for Deformable Image Registrationcited by 25
- 2023A Robust and Interpretable Deep Learning Framework for Multi-modal Registration via Keypointscited by 25
- 2024MedIAnomaly: A comparative study of anomaly detection in medical imagescited by 25
- 2023Neuralizer: General Neuroimage Analysis without Re-Trainingcited by 24
- 2023ModeT: Learning Deformable Image Registration via Motion Decomposition Transformercited by 23
- 2021Joint Progressive and Coarse-to-fine Registration of Brain MRI via Deformation Field Integration and Non-Rigid Feature Fusioncited by 22
- 2022CortexODE: Learning Cortical Surface Reconstruction by Neural ODEscited by 22
- 2022Generative Myocardial Motion Tracking via Latent Space Exploration with Biomechanics-informed Priorcited by 22
- 2022Fourier-Net: Fast Image Registration with Band-limited Deformationcited by 22
- 2024Rethinking Autoencoders for Medical Anomaly Detection from A Theoretical Perspectivecited by 22
- 2021Cross-modal Attention for MRI and Ultrasound Volume Registrationcited by 21
- 2021SAME: Deformable Image Registration based on Self-supervised Anatomical Embeddingscited by 21
- 2022Learning Whole Heart Mesh Generation From Patient Images For Computational Simulationscited by 21
- 2023Non-iterative Coarse-to-fine Transformer Networks for Joint Affine and Deformable Image Registrationcited by 21
- 2021Enhancing MR Image Segmentation with Realistic Adversarial Data Augmentationcited by 20
- 2022Coordinate Translator for Learning Deformable Medical Image Registrationcited by 20
- 2022Non-iterative Coarse-to-fine Registration based on Single-pass Deep Cumulative Learningcited by 20
- 2022Voxelmorph++ Going beyond the cranial vault with keypoint supervision and multi-channel instance optimisationcited by 19
- 2022Medical Image Registration via Neural Fieldscited by 19
- 2023Anatomy-aware and acquisition-agnostic joint registration with SynthMorphcited by 19
- 2021Multi-scale Neural ODEs for 3D Medical Image Registrationcited by 18
- 2021Known Operator Learning and Hybrid Machine Learning in Medical Imaging -- A Review of the Past, the Present, and the Futurecited by 18
50 most cited of 657 All 657 (JSON)
- 2026NEXT: Physics-Informed Neuro-Spectral Exponential Time Differencing Architectures25 Sep 2026
- 2026Atlases Are Already Inside: Recovering Population Templates from Pretrained Diffusion Models24 Sep 2026
- 2026XCalib Depth-Guided Geometric Optimization for Dense Thermal-Visible Video Registration18 Sep 2026
- 2026A Dual-Stream Regulated Reconstruction and Segmentation Network with Hierarchical Artifact-Prior Modeling for Ultra-Low-Field Pediatric Neuroimaging17 Sep 2026
- 2026BINDER: A Latent Variable Model for Probabilistic Medical Image Registration17 Sep 2026
- 2026Benchmarking Intra-Patient 3D Deformable Multimodal Image Registration14 Sep 2026
- 2026Two-Parameter Flow Map Learning for Continuous-Time Diffeomorphic Image Registration9 Sep 2026
- 2026Shape-guided Gaussian Splatting for Sparse-View X-ray 3D Reconstruction9 Sep 2026
- 2026A Joint 2D-3D Statistical Shape Model for Orthopedic Reconstruction8 Sep 2026
- 2026SynthRCT: Scalable Conditional Deformation Synthesis for Synthetic Repeat CT Generation8 Sep 2026
- 2026Is Deformable Image Registration Ready for Brain Metastasis Reirradiation Dose Accumulation? A Longitudinal MRI Benchmark of Registration Accuracy27 Aug 2026
- 2026Phase-Aligned Finite-Fourier Periodic Deformation for 4D Medical Image Interpolation25 Aug 2026
38 more
- 2026Low-Rank Velocity Fields as a Structural Prior for Unsupervised 4D Medical Image Interpolation25 Aug 2026
- 2026Architectural and Regularization Components in Deep Learning Medical Image Registration: Systematic Ablation Study23 Aug 2026
- 2026Region-Weighted Losses and Model Fusion for Cross-Modal PET Attenuation Correction22 Aug 2026
- 2026The Right Prior for the Right Deformation: Rethinking Continuous Deformable Image Registration17 Aug 2026
- 2026Inference-Time Orthogonal Seeding Enables Geometry-Aligned 3D Organ Segmentation for Slice-Propagation Methods12 Aug 2026
- 2026Warping Earth Observations for better ice labeling in the Marginal Marginal Ice Zone12 Aug 2026
- 2026MRIComp4Flow: Compression of 3D Brain MRI for Training Multi-Modal Generative Models10 Aug 2026
- 2026textttDisMorph: learning to disentangle technical distortions from true biological change8 Aug 2026
- 2026H2AL: Hyperbolic Hierarchy-aware Aggregative Learning for Registration-based Few-shot Medical Image Segmentation7 Aug 2026
- 2026Dual-domain U-Nets with embedded back projection operators for motion-resolved 4D CBCT reconstruction4 Aug 2026
- 2026An Accessible Solution for Deformable Image Registration Compared with Learning-Based Approaches3 Aug 2026
- 2026Generative Brownian Bridge Diffusion In Motion Space For Enhanced Myocardial Strain Analysis3 Aug 2026
- 2026Lethe: How Hard Is It to Forget? A Benchmark for Federated Unlearning in Medical Imaging2 Aug 2026
- 2026DynoDINO: Harnessing Dynamic Latent Information from DINO Features for Multi-Phase Medical Image Segmentation31 Jul 2026
- 2026Eddeep: a deep-learning framework for fast eddy-current distortion correction in diffusion MRI28 Jul 2026
- 2026Unifying Active Learning and Semi-Supervised Learning for Medical Image Segmentation27 Jul 2026
- 2026Motion-Conditioned Multi-View Fusion for Myocardial Infarction Localization from Echocardiography16 Jul 2026
- 2026DINE: Distance Is Not Enough -- Learning Global Deformation Priors for Robust Soft-Tissue Point Cloud Registration16 Jul 2026
- 2026Learning to Unify Deformable Shape and Texture Representations for Cardiac Video Classification8 Jul 2026
- 2026Reliability-Aware CT-MRI Registration: A Quality Engineering Framework with Stability Analysis and Risk Classification1 Jul 2026
- 2026DrivenMorph: Bridging Attention Mechanism and Variational Image Registration via Difference Modeling29 Jun 2026
- 2026Unsupervised Susceptibility Distortion Correction of EPI without Calibration Scans via Image Translation-Based Registration19 Jun 2026
- 2026SMART: A Flexible, Interpretable, and Scalable Spatio-temporal Brain Atlas from High-Resolution Imaging Data17 Jun 2026
- 2026Neural Phase Correlation16 Jun 2026
- 2026Cohort-Scale Neural Atlases of Ultrasound Video30 May 2026
- 2026Subspace-Guided Semantic and Topological Invariant Registration for Annotation-Free Ultrasound Plane Quality Control25 May 2026
- 2026SpikeReg: Energy-Efficient 3D Deformable Medical Image Registration with Spiking Neural Networks24 May 2026
- 2026Universal CT Representations from Anatomy to Disease Phenotype through Agglomerative Pretraining21 May 2026
- 2026HyDAR-Pano3D: A Hybrid Disentangled Anatomical Recovery Framework for Panoramic-to-3D Reconstruction20 May 2026
- 2026Training Neural Networks with Optimal Double-Bayesian Learning19 May 2026
- 2026Set-Based Groupwise Registration for Variable-Length, Variable-Contrast Cardiac MRI11 May 2026
- 2026INFANiTE: Implicit Neural representation for high-resolution Fetal brain spatio-temporal Atlas learNing from clinical Thick-slicE MRI11 May 2026
- 2026MSR:Hybrid Field Modeling for CT-MRI Rigid-Deformable Registration of the Cervical Spine with an Annotated Dataset30 Apr 2026
- 2026BrainDINO: A Brain MRI Foundation Model for Generalizable Clinical Representation Learning30 Apr 2026
- 2026CT-Guided Spatially-varying Regularization for Voxel-Wise Deformable Whole-Body PET Registration24 Apr 2026
- 2026Deep learning based Non-Rigid Volume-to-Surface Registration for Brain Shift compensation Using Point Cloud19 Apr 2026
- 2026A Multimodal Clinically Informed Coarse-to-Fine Framework for Longitudinal CT Registration in Proton Therapy15 Apr 2026
- 2026Particle Diffusion Matching: Random Walk Correspondence Search for the Alignment of Standard and Ultra-Widefield Fundus Images11 Apr 2026
50 newest of 657 All 657 (JSON)
- 2022SADM: Sequence-Aware Diffusion Model for Longitudinal Medical Image Generationcited by 56
- 2023FSDiffReg: Feature-wise and Score-wise Diffusion-guided Unsupervised Deformable Image Registration for Cardiac Imagescited by 18
- 2024Deformation-Recovery Diffusion Model (DRDM): Instance Deformation for Image Manipulation and Synthesiscited by 7
- 2024DiffuseReg: Denoising Diffusion Model for Obtaining Deformation Fields in Unsupervised Deformable Image Registrationcited by 6
- 2025Guiding Registration with Emergent Similarity from Pre-Trained Diffusion Modelscited by 6
- 2024Annotated Biomedical Video Generation using Denoising Diffusion Probabilistic Models and Flow Fieldscited by 5
- 2025FB-Diff: Fourier Basis-guided Diffusion for Temporal Interpolation of 4D Medical Imagingcited by 5
- 2023Diffusion Model based Semi-supervised Learning on Brain Hemorrhage Images for Efficient Midline Shift Quantificationcited by 3
- 2025Personalized MR-Informed Diffusion Models for 3D PET Image Reconstructioncited by 2
- 2025Unsupervised Cardiac Video Translation Via Motion Feature Guided Diffusion Modelcited by 2
- 2024Multi-Subject Image Synthesis as a Generative Prior for Single-Subject PET Image Reconstructioncited by 1
- 2025MSRepaint: Multiple Sclerosis Repaint with Conditional Denoising Diffusion Implicit Model for Bidirectional Lesion Filling and Synthesiscited by 1
12 most cited of 18 All 18 (JSON)
- 2026Atlases Are Already Inside: Recovering Population Templates from Pretrained Diffusion Models24 Sep 2026
- 2026Cone-Beam CT Image Quality Enhancement Using A Latent Diffusion Model Trained with Simulated CBCT Artifacts27 Mar 2026
- 2026Sketch2CT: Multimodal Diffusion for Structure-Aware 3D Medical Volume Generation23 Mar 2026
- 2026Rectified flow-based prediction of post-treatment brain MRI from pre-radiotherapy priors for patients with glioma9 Mar 2026
- 2026Flow Matching-enabled Test-Time Refinement for Unsupervised Cardiac MR Registration1 Mar 2026
- 2025MSRepaint: Multiple Sclerosis Repaint with Conditional Denoising Diffusion Implicit Model for Bidirectional Lesion Filling and Synthesis2 Oct 2025
- 2025FB-Diff: Fourier Basis-guided Diffusion for Temporal Interpolation of 4D Medical Imaging6 Jul 2025
- 2025Unsupervised Cardiac Video Translation Via Motion Feature Guided Diffusion Model1 Jul 2025
- 2025Personalized MR-Informed Diffusion Models for 3D PET Image Reconstruction4 Jun 2025
- 2025Guiding Registration with Emergent Similarity from Pre-Trained Diffusion Models3 Jun 2025
- 2025MR2US-Pro: Prostate MR to Ultrasound Image Translation and Registration Based on Diffusion Models31 May 2025
- 2024Multi-Subject Image Synthesis as a Generative Prior for Single-Subject PET Image Reconstruction5 Dec 2024
12 newest of 18 All 18 (JSON)
- 2024MambaMorph: a Mamba-based Framework for Medical MR-CT Deformable Registrationcited by 9
- 2024Mamba? Catch The Hype Or Rethink What Really Helps for Image Registrationcited by 9
- 2024MambaReg: Mamba-Based Disentangled Convolutional Sparse Coding for Unsupervised Deformable Multi-Modal Image Registrationcited by 1
- 2024MambaReg: Mamba-Based Disentangled Convolutional Sparse Coding for Unsupervised Deformable Multi-Modal Image Registration3 Nov 2024
- 2024Mamba? Catch The Hype Or Rethink What Really Helps for Image Registration27 Jul 2024
- 2024MambaMorph: a Mamba-based Framework for Medical MR-CT Deformable Registration25 Jan 2024
- 2021Learn2Reg: comprehensive multi-task medical image registration challenge, dataset and evaluation in the era of deep learningcited by 125
- 2021Recent advances and clinical applications of deep learning in medical image analysiscited by 104
- 2023UniverSeg: Universal Medical Image Segmentationcited by 90
- 2021HyperMorph: Amortized Hyperparameter Learning for Image Registrationcited by 84
- 2021Breaking the Dilemma of Medical Image-to-image Translationcited by 82
- 2022Diffusion Deformable Model for 4D Temporal Medical Image Generationcited by 65
- 2021Recurrent Mask Refinement for Few-Shot Medical Image Segmentationcited by 63
- 2023A survey on deep learning in medical image registration: new technologies, uncertainty, evaluation metrics, and beyondcited by 55
- 2024uniGradICON: A Foundation Model for Medical Image Registrationcited by 55
- 2021AFTer-UNet: Axial Fusion Transformer UNet for Medical Image Segmentationcited by 48
- 2022XMorpher: Full Transformer for Deformable Medical Image Registration via Cross Attentioncited by 46
- 2022Transformers in Medical Image Analysis: A Reviewcited by 41
12 most cited of 633 All 633 (JSON)
- 2026NEXT: Physics-Informed Neuro-Spectral Exponential Time Differencing Architectures25 Sep 2026
- 2026XCalib Depth-Guided Geometric Optimization for Dense Thermal-Visible Video Registration18 Sep 2026
- 2026A Dual-Stream Regulated Reconstruction and Segmentation Network with Hierarchical Artifact-Prior Modeling for Ultra-Low-Field Pediatric Neuroimaging17 Sep 2026
- 2026BINDER: A Latent Variable Model for Probabilistic Medical Image Registration17 Sep 2026
- 2026Benchmarking Intra-Patient 3D Deformable Multimodal Image Registration14 Sep 2026
- 2026Two-Parameter Flow Map Learning for Continuous-Time Diffeomorphic Image Registration9 Sep 2026
- 2026Shape-guided Gaussian Splatting for Sparse-View X-ray 3D Reconstruction9 Sep 2026
- 2026A Joint 2D-3D Statistical Shape Model for Orthopedic Reconstruction8 Sep 2026
- 2026SynthRCT: Scalable Conditional Deformation Synthesis for Synthetic Repeat CT Generation8 Sep 2026
- 2026Is Deformable Image Registration Ready for Brain Metastasis Reirradiation Dose Accumulation? A Longitudinal MRI Benchmark of Registration Accuracy27 Aug 2026
- 2026Phase-Aligned Finite-Fourier Periodic Deformation for 4D Medical Image Interpolation25 Aug 2026
- 2026Low-Rank Velocity Fields as a Structural Prior for Unsupervised 4D Medical Image Interpolation25 Aug 2026
12 newest of 633 All 633 (JSON)