SynthMorph: learning contrast-invariant registration without acquired images
Not on the map. Why?
Abstract (arXiv)
We introduce a strategy for learning image registration without acquired imaging data, producing powerful networks agnostic to contrast introduced by magnetic resonance imaging (MRI). While classical registration methods accurately estimate the spatial correspondence between images, they solve an optimization problem for every new image pair. Learning-based techniques are fast at test time but limited to registering images with contrasts and geometric content similar to those seen during training. We propose to remove this dependency on training data by leveraging a generative strategy for diverse synthetic label maps and images that exposes networks to a wide range of variability, forcing them to learn more invariant features. This approach results in powerful networks that accurately generalize to a broad array of MRI contrasts. We present extensive experiments with a focus on 3D neuroimaging, showing that this strategy enables robust and accurate registration of arbitrary MRI contrasts even if the target contrast is not seen by the networks during training. We demonstrate registration accuracy surpassing the state of the art both within and across contrasts, using a single model. Critically, training on arbitrary shapes synthesized from noise distributions results in competitive performance, removing the dependency on acquired data of any kind. Additionally, since anatomical label maps are often available for the anatomy of interest, we show that synthesizing images from these dramatically boosts performance, while still avoiding the need for real intensity images. Our code is available at https://w3id.org/synthmorph.
Key facts. Cited by 137 papers in the map (data through 7 Oct 2026). First posted on arXiv 21 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 11; 2023: 23; 2024: 29; 2025: 46; 2026: 24.
137 papers.
Sort:
By area:
- 2021Learn2Reg: comprehensive multi-task medical image registration challenge, dataset and evaluation in the era of deep learningcited by 125
- 2023UniverSeg: Universal Medical Image Segmentationcited by 90
- 2023A survey on deep learning in medical image registration: new technologies, uncertainty, evaluation metrics, and beyondcited by 55
- 2022textttGradICON: Approximate Diffeomorphisms via Gradient Inverse Consistencycited by 40
- 2021The Brain Tumor Sequence Registration (BraTS-Reg) Challenge: Establishing Correspondence Between Pre-Operative and Follow-up MRI Scans of Diffuse Glioma Patientscited by 32
- 2024Learning General-Purpose Biomedical Volume Representations using Randomized Synthesiscited by 27
- 2023A Robust and Interpretable Deep Learning Framework for Multi-modal Registration via Keypointscited by 25
- 2023Neuralizer: General Neuroimage Analysis without Re-Trainingcited by 24
- 2024Tyche: Stochastic In-Context Learning for Medical Image Segmentationcited by 20
- 2024Deep Learning in Medical Image Registration: Magic or Mirage?cited by 20
- 2022Medical Image Registration via Neural Fieldscited by 19
- 2023Anatomy-aware and acquisition-agnostic joint registration with SynthMorphcited by 19
38 more
- 2024multiGradICON: A Foundation Model for Multimodal Medical Image Registrationcited by 16
- 2023AnyStar: Domain randomized universal star-convex 3D instance segmentationcited by 14
- 2023Heteroscedastic Uncertainty Estimation Framework for Unsupervised Registrationcited by 14
- 2022Self-Supervised 2D/3D Registration for X-Ray to CT Image Fusioncited by 12
- 2023Inverse Consistency by Construction for Multistep Deep Registrationcited by 12
- 2025Beyond the LUMIR challenge: The pathway to foundational registration modelscited by 12
- 2023Brain-ID: Learning Contrast-agnostic Anatomical Representations for Brain Imagingcited by 10
- 2023SE(3)-Equivariant and Noise-Invariant 3D Rigid Motion Tracking in Brain MRIcited by 10
- 2022ContraReg: Contrastive Learning of Multi-modality Unsupervised Deformable Image Registrationcited by 9
- 2023Adaptive Correspondence Scoring for Unsupervised Medical Image Registrationcited by 9
- 2024MambaMorph: a Mamba-based Framework for Medical MR-CT Deformable Registrationcited by 9
- 2025Synthesizing Individualized Aging Brains in Health and Disease with Generative Models and Parallel Transportcited by 9
- 2025MultiMorph: On-demand Atlas Constructioncited by 9
- 2022Automated Learning for Deformable Medical Image Registration by Jointly Optimizing Network Architectures and Objective Functionscited by 8
- 2022SuperWarp: Supervised Learning and Warping on U-Net for Invariant Subvoxel-Precise Registrationcited by 8
- 2024PEPSI: Pathology-Enhanced Pulse-Sequence-Invariant Representations for Brain MRIcited by 8
- 2024Registration by Regression (RbR): a framework for interpretable and flexible atlas registrationcited by 8
- 2023MAD: Modality Agnostic Distance Measure for Image Registrationcited by 7
- 2023Cortical analysis of heterogeneous clinical brain MRI scans for large-scale neuroimaging studiescited by 6
- 2023PCMC-T1: Free-breathing myocardial T1 mapping with Physically-Constrained Motion Correctioncited by 6
- 2024Recon-all-clinical: Cortical surface reconstruction and analysis of heterogeneous clinical brain MRIcited by 6
- 2025Conditional diffusion models for guided anomaly detection in brain images using fluid-driven anomaly randomizationcited by 6
- 2025Domain-randomized deep learning for neuroimage analysiscited by 6
- 2022Unsupervised Method for Intra-patient Registration of Brain Magnetic Resonance Images based on Objective Function Weighting by Inverse Consistency: Contribution to the BraTS-Reg Challengecited by 5
- 2024Deep Implicit Optimization enables Robust Learnable Features for Deformable Image Registrationcited by 5
- 2025IMPACT: A Generic Semantic Loss for Multimodal Medical Image Registrationcited by 5
- 2025A Modality-agnostic Multi-task Foundation Model for Human Brain Imagingcited by 5
- 2021LDDMM meets GANs: Generative Adversarial Networks for diffeomorphic registrationcited by 4
- 2024Synthetic Data for Robust Stroke Segmentationcited by 4
- 2024Neurovascular Segmentation in sOCT with Deep Learning and Synthetic Training Datacited by 4
- 2024Hierarchical Uncertainty Estimation for Learning-based Registration in Neuroimagingcited by 4
- 2024Learn2Synth: Learning Optimal Data Synthesis Using Hypergradients for Brain Image Segmentationcited by 4
- 2025Learning accurate rigid registration for longitudinal brain MRI from synthetic datacited by 4
- 2025Unraveling Normal Anatomy via Fluid-Driven Anomaly Randomizationcited by 4
- 2022Supervision by Denoising for Medical Image Segmentationcited by 3
- 2022Generative Aging of Brain Images with Diffeomorphic Registrationcited by 3
- 2023Implicit neural representations for joint decomposition and registration of gene expression images in the marmoset braincited by 3
- 2023Preserving Tumor Volumes for Unsupervised Medical Image Registrationcited by 3
50 most cited of 137 All 137 (JSON)
- 2026Uncertainty-Aware 3D Residual Wavelet Diffusion for Ultra Low-Field MRI Super-Resolution21 Sep 2026
- 2026BINDER: A Latent Variable Model for Probabilistic Medical Image Registration17 Sep 2026
- 2026Evaluation Principles for MRI-MRA Registration in Trigeminal Neuralgia: An ROI-Centered Neurovascular Benchmark8 Sep 2026
- 2026textttDisMorph: learning to disentangle technical distortions from true biological change8 Aug 2026
- 2026Patient-Agnostic Synthetic Pretraining for Efficient Patient-Specific Intraoperative 2D/3D Registration25 Jul 2026
- 2026Distortion-Corrected Diffusion MRI Using Rotated-View EPI and Joint Field-Map/Image Estimation with Gaussian Primitives30 Jun 2026
- 2026What neurosurgeons need to see: synthetic intra-operative MRI from ultrasound for brain-shift compensation in brain tumour surgery3 Jun 2026
- 20263D-GlioPREDICT: 3D Latent Diffusion for Post-Radiotherapy Brain MRI Prediction in Patients with Glioma3 Jun 2026
- 2026A Systematic Benchmark of Intraoperative Ultrasound-to-MR Synthesis for Brain Tumour Surgery30 May 2026
- 2026CAHAL: Clinically Applicable resolution enHAncement for Low-resolution MRI scans20 Apr 2026
- 2026Why Invariance is Not Enough for Biomedical Domain Generalization and How to Fix It2 Apr 2026
- 2026Adapting Frozen Mono-modal Backbones for Multi-modal Registration via Contrast-Agnostic Instance Optimization27 Mar 2026
38 more
- 2026On the Degrees of Freedom of Gridded Control Points in Learning-Based Medical Image Registration15 Mar 2026
- 2026TractoRC: A Unified Probabilistic Learning Framework for Joint Tractography Registration and Clustering11 Mar 2026
- 2026Rectified flow-based prediction of post-treatment brain MRI from pre-radiotherapy priors for patients with glioma9 Mar 2026
- 2026Foundation Models for Medical Imaging: Status, Challenges, and Directions17 Feb 2026
- 2026Free Lunch in Medical Image Foundation Model Pre-training via Randomized Synthesis and Disentanglement12 Feb 2026
- 2026PCReg-Net: Progressive Contrast-Guided Registration for Cross-Domain Image Alignment9 Feb 2026
- 2026Data-driven registration and modeling of brain deformation for image-guided neurosurgery9 Feb 2026
- 2026SAS-Net: Cross-Domain Image Registration as Inverse Rendering via Structure-Appearance Factorization6 Feb 2026
- 2026Zero-shot Multi-Contrast Brain MRI Registration by Intensity Randomizing T1-weighted MRI (LUMIR25)6 Feb 2026
- 2026Bridging Modalities: Joint Synthesis and Registration Framework for Aligning Diffusion MRI with T1-Weighted Images16 Jan 2026
- 2026Learning Domain-Invariant Representations for Cross-Domain Image Registration via Scene-Appearance Disentanglement12 Jan 2026
- 2026Adaptive Conditional Contrast-Agnostic Deformable Image Registration with Uncertainty Estimation9 Jan 2026
- 2025Domain-Shift Immunity in Deep Deformable Registration via Local Feature Representations29 Dec 2025
- 2025Multimodal Diffeomorphic Registration with Neural ODEs and Structural Descriptors27 Dec 2025
- 2025Unified Brain Surface and Volume Registration22 Dec 2025
- 2025Atlas is Your Perfect Context: One-Shot Customization for Generalizable Foundational Medical Image Segmentation20 Dec 2025
- 2025The LUMirage: An independent evaluation of zero-shot performance in the LUMIR challenge17 Dec 2025
- 2025Test Time Optimized Generalized AI-based Medical Image Registration Method16 Dec 2025
- 2025Pancakes: Consistent Multi-Protocol Image Segmentation Across Biomedical Domains15 Dec 2025
- 2025Deep infant brain segmentation from multi-contrast MRI4 Dec 2025
- 2025MorphSeek: Fine-grained Latent Representation-Level Policy Optimization for Deformable Image Registration21 Nov 2025
- 2025Coarse-to-Fine Non-Rigid Registration for Side-Scan Sonar Mosaicking19 Nov 2025
- 2025Revisiting Data Scaling in Medical Image Segmentation via Topology-Aware Augmentation17 Nov 2025
- 2025AtlasMorph: Learning conditional deformable templates for brain MRI17 Nov 2025
- 2025Diffusion-Driven Generation of Minimally Preprocessed Brain MRI29 Oct 2025
- 2025DARE: A Deformable Adaptive Regularization Estimator for Learning-Based Medical Image Registration22 Oct 2025
- 2025Generating healthy counterfactuals with denoising diffusion bridge models15 Oct 2025
- 2025VPREG: An Optimal Control Formulation for Diffeomorphic Image Registration Based on the Variational Principle Grid Generation Method15 Oct 2025
- 2025A Scalable Distributed Framework for Multimodal GigaVoxel Image Registration29 Sep 2025
- 2025Uncertainty Estimation for Pretrained Medical Image Registration Models via Transformation Equivariance27 Sep 2025
- 2025Robust Fetal Pose Estimation across Gestational Ages via Cross-Population Augmentation15 Sep 2025
- 2025Surrogate Supervision for Robust and Generalizable Deformable Image Registration11 Sep 2025
- 2025Medverse: A Universal Model for Full-Resolution 3D Medical Image Segmentation, Transformation and Enhancement11 Sep 2025
- 2025A Modality-agnostic Multi-task Foundation Model for Human Brain Imaging30 Aug 2025
- 2025Encoder-Only Image Registration30 Aug 2025
- 2025Coarse-to-Fine Joint Registration of MR and Ultrasound Images via Imaging Style Transfer7 Aug 2025
- 2025Modality-Aware Feature Matching in Visual and Vision-Language Applications: A Comprehensive Survey30 Jul 2025
- 2025Domain-randomized deep learning for neuroimage analysis17 Jul 2025
50 newest of 137 All 137 (JSON)
- 2025Conditional diffusion models for guided anomaly detection in brain images using fluid-driven anomaly randomizationcited by 6
- 2025Diffusion-Driven Generation of Minimally Preprocessed Brain MRIcited by 2
- 2026Rectified flow-based prediction of post-treatment brain MRI from pre-radiotherapy priors for patients with gliomacited by 1
- 2025Generating healthy counterfactuals with denoising diffusion bridge modelscited by 0
- 20263D-GlioPREDICT: 3D Latent Diffusion for Post-Radiotherapy Brain MRI Prediction in Patients with Gliomacited by 0
- 2026Uncertainty-Aware 3D Residual Wavelet Diffusion for Ultra Low-Field MRI Super-Resolutioncited by 0
- 2026Uncertainty-Aware 3D Residual Wavelet Diffusion for Ultra Low-Field MRI Super-Resolution21 Sep 2026
- 20263D-GlioPREDICT: 3D Latent Diffusion for Post-Radiotherapy Brain MRI Prediction in Patients with Glioma3 Jun 2026
- 2026Rectified flow-based prediction of post-treatment brain MRI from pre-radiotherapy priors for patients with glioma9 Mar 2026
- 2025Diffusion-Driven Generation of Minimally Preprocessed Brain MRI29 Oct 2025
- 2025Generating healthy counterfactuals with denoising diffusion bridge models15 Oct 2025
- 2025Conditional diffusion models for guided anomaly detection in brain images using fluid-driven anomaly randomization11 Jun 2025
- 2021Learn2Reg: comprehensive multi-task medical image registration challenge, dataset and evaluation in the era of deep learningcited by 125
- 2023UniverSeg: Universal Medical Image Segmentationcited by 90
- 2023A survey on deep learning in medical image registration: new technologies, uncertainty, evaluation metrics, and beyondcited by 55
- 2022textttGradICON: Approximate Diffeomorphisms via Gradient Inverse Consistencycited by 40
- 2021The Brain Tumor Sequence Registration (BraTS-Reg) Challenge: Establishing Correspondence Between Pre-Operative and Follow-up MRI Scans of Diffuse Glioma Patientscited by 32
- 2024Learning General-Purpose Biomedical Volume Representations using Randomized Synthesiscited by 27
- 2023A Robust and Interpretable Deep Learning Framework for Multi-modal Registration via Keypointscited by 25
- 2023Neuralizer: General Neuroimage Analysis without Re-Trainingcited by 24
- 2024Tyche: Stochastic In-Context Learning for Medical Image Segmentationcited by 20
- 2024Deep Learning in Medical Image Registration: Magic or Mirage?cited by 20
- 2022Medical Image Registration via Neural Fieldscited by 19
- 2023Anatomy-aware and acquisition-agnostic joint registration with SynthMorphcited by 19
12 most cited of 130 All 130 (JSON)
- 2026BINDER: A Latent Variable Model for Probabilistic Medical Image Registration17 Sep 2026
- 2026Evaluation Principles for MRI-MRA Registration in Trigeminal Neuralgia: An ROI-Centered Neurovascular Benchmark8 Sep 2026
- 2026textttDisMorph: learning to disentangle technical distortions from true biological change8 Aug 2026
- 2026Patient-Agnostic Synthetic Pretraining for Efficient Patient-Specific Intraoperative 2D/3D Registration25 Jul 2026
- 2026Distortion-Corrected Diffusion MRI Using Rotated-View EPI and Joint Field-Map/Image Estimation with Gaussian Primitives30 Jun 2026
- 2026What neurosurgeons need to see: synthetic intra-operative MRI from ultrasound for brain-shift compensation in brain tumour surgery3 Jun 2026
- 2026A Systematic Benchmark of Intraoperative Ultrasound-to-MR Synthesis for Brain Tumour Surgery30 May 2026
- 2026CAHAL: Clinically Applicable resolution enHAncement for Low-resolution MRI scans20 Apr 2026
- 2026Why Invariance is Not Enough for Biomedical Domain Generalization and How to Fix It2 Apr 2026
- 2026Adapting Frozen Mono-modal Backbones for Multi-modal Registration via Contrast-Agnostic Instance Optimization27 Mar 2026
- 2026On the Degrees of Freedom of Gridded Control Points in Learning-Based Medical Image Registration15 Mar 2026
- 2026TractoRC: A Unified Probabilistic Learning Framework for Joint Tractography Registration and Clustering11 Mar 2026
12 newest of 130 All 130 (JSON)