Unsupervised Multi-Modal Medical Image Registration via Discriminator-Free Image-to-Image Translation
Not on the map. Why?
Abstract (arXiv)
In clinical practice, well-aligned multi-modal images, such as Magnetic Resonance (MR) and Computed Tomography (CT), together can provide complementary information for image-guided therapies. Multi-modal image registration is essential for the accurate alignment of these multi-modal images. However, it remains a very challenging task due to complicated and unknown spatial correspondence between different modalities. In this paper, we propose a novel translation-based unsupervised deformable image registration approach to convert the multi-modal registration problem to a mono-modal one. Specifically, our approach incorporates a discriminator-free translation network to facilitate the training of the registration network and a patchwise contrastive loss to encourage the translation network to preserve object shapes. Furthermore, we propose to replace an adversarial loss, that is widely used in previous multi-modal image registration methods, with a pixel loss in order to integrate the output of translation into the target modality. This leads to an unsupervised method requiring no ground-truth deformation or pairs of aligned images for training. We evaluate four variants of our approach on the public Learn2Reg 2021 datasets citehering2021learn2reg. The experimental results demonstrate that the proposed architecture achieves state-of-the-art performance. Our code is available at https://github.com/heyblackC/DFMIR.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 15 of its 26 references that are in the map. First posted on arXiv 28 Apr 2022.
Builds on
15 of 26 references.
References · 15
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
- 2018VoxelMorph: A Learning Framework for Deformable Medical Image Registrationcited by 657
- 2020Contrastive Learning for Unpaired Image-to-Image Translationcited by 637
- 2021Learn2Reg: comprehensive multi-task medical image registration challenge, dataset and evaluation in the era of deep learningcited by 125
- 2018Weakly-Supervised Convolutional Neural Networks for Multimodal Image Registrationcited by 90
- 2021HyperMorph: Amortized Hyperparameter Learning for Image Registrationcited by 84
- 2021Breaking the Dilemma of Medical Image-to-image Translationcited by 82
- 2017End-to-End Unsupervised Deformable Image Registration with a Convolutional Neural Networkcited by 75
- 2020Unsupervised Multi-Modal Image Registration via Geometry Preserving Image-to-Image Translationcited by 66
- 2019Unsupervised Deformable Registration for Multi-Modal Images via Disentangled Representationscited by 52
Built on by
Citing papers per year: 2022: 2; 2023: 4; 2024: 2; 2025: 2; 2026: 1.
11 papers.
- 2022Deformation equivariant cross-modality image synthesis with paired non-aligned training datacited by 5
- 2024Medical Image Registration and Its Application in Retinal Images: A Reviewcited by 3
- 2023Can representation learning for multimodal image registration be improved by supervision of intermediate layers?cited by 2
- 2024Anatomical Conditioning for Contrastive Unpaired Image-to-Image Translation of Optical Coherence Tomography Imagescited by 2
- 2023Vista-Morph: Unsupervised Image Registration of Visible-Thermal Facial Pairscited by 1
- 2023Jurassic World Remake: Bringing Ancient Fossils Back to Life via Zero-Shot Long Image-to-Image Translationcited by 1
- 2023PET Tracer Conversion among Brain PET via Variable Augmented Invertible Networkcited by 1
- 2025Bi-directional Self-Registration for Misaligned Infrared-Visible Image Fusioncited by 1
- 2025Hyperbolic Cycle Alignment for Infrared-Visible Image Fusioncited by 1
- 2022Enhancing Generative Networks for Chest Anomaly Localization through Automatic Registration-Based Unpaired-to-Pseudo-Paired Training Data Translationcited by 0
- 2026Unsupervised Susceptibility Distortion Correction of EPI without Calibration Scans via Image Translation-Based Registrationcited by 0
- 2026Unsupervised Susceptibility Distortion Correction of EPI without Calibration Scans via Image Translation-Based Registration19 Jun 2026
- 2025Hyperbolic Cycle Alignment for Infrared-Visible Image Fusion31 Jul 2025
- 2025Bi-directional Self-Registration for Misaligned Infrared-Visible Image Fusion11 May 2025
- 2024Anatomical Conditioning for Contrastive Unpaired Image-to-Image Translation of Optical Coherence Tomography Images8 Apr 2024
- 2024Medical Image Registration and Its Application in Retinal Images: A Review25 Mar 2024
- 2023PET Tracer Conversion among Brain PET via Variable Augmented Invertible Network1 Nov 2023
- 2023Jurassic World Remake: Bringing Ancient Fossils Back to Life via Zero-Shot Long Image-to-Image Translation14 Aug 2023
- 2023Vista-Morph: Unsupervised Image Registration of Visible-Thermal Facial Pairs10 Jun 2023
- 2023Can representation learning for multimodal image registration be improved by supervision of intermediate layers?1 Mar 2023
- 2022Deformation equivariant cross-modality image synthesis with paired non-aligned training data26 Aug 2022
- 2022Enhancing Generative Networks for Chest Anomaly Localization through Automatic Registration-Based Unpaired-to-Pseudo-Paired Training Data Translation21 Jul 2022