mlsanityData to 7 Oct 2026

Unsupervised Multi-Modal Medical Image Registration via Discriminator-Free Image-to-Image Translation

arXiv 2204.13656 ↗First posted 28 Apr 2022cs.CVcited by 11

Not on the map. Why?

Abstract (arXiv)

In clinical practice, well-aligned multi-modal images, such as Magnetic Resonance (MR) and Computed Tomography (CT), together can provide complementary information for image-guided therapies. Multi-modal image registration is essential for the accurate alignment of these multi-modal images. However, it remains a very challenging task due to complicated and unknown spatial correspondence between different modalities. In this paper, we propose a novel translation-based unsupervised deformable image registration approach to convert the multi-modal registration problem to a mono-modal one. Specifically, our approach incorporates a discriminator-free translation network to facilitate the training of the registration network and a patchwise contrastive loss to encourage the translation network to preserve object shapes. Furthermore, we propose to replace an adversarial loss, that is widely used in previous multi-modal image registration methods, with a pixel loss in order to integrate the output of translation into the target modality. This leads to an unsupervised method requiring no ground-truth deformation or pairs of aligned images for training. We evaluate four variants of our approach on the public Learn2Reg 2021 datasets citehering2021learn2reg. The experimental results demonstrate that the proposed architecture achieves state-of-the-art performance. Our code is available at https://github.com/heyblackC/DFMIR.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 15 of its 26 references that are in the map. First posted on arXiv 28 Apr 2022.

Builds on

15 of 26 references.

References · 15

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  2. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  3. 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
  4. 2018VoxelMorph: A Learning Framework for Deformable Medical Image Registrationcited by 657
  5. 2020Contrastive Learning for Unpaired Image-to-Image Translationcited by 637
  6. 2021Learn2Reg: comprehensive multi-task medical image registration challenge, dataset and evaluation in the era of deep learningcited by 125
  7. 2018Weakly-Supervised Convolutional Neural Networks for Multimodal Image Registrationcited by 90
  8. 2021HyperMorph: Amortized Hyperparameter Learning for Image Registrationcited by 84
  9. 2021Breaking the Dilemma of Medical Image-to-image Translationcited by 82
  10. 2017End-to-End Unsupervised Deformable Image Registration with a Convolutional Neural Networkcited by 75
  11. 2020Unsupervised Multi-Modal Image Registration via Geometry Preserving Image-to-Image Translationcited by 66
  12. 2019Unsupervised Deformable Registration for Multi-Modal Images via Disentangled Representationscited by 52
3 more
  1. 2020CoMIR: Contrastive Multimodal Image Representation for Registrationcited by 45
  2. 2020Adversarial Uni- and Multi-modal Stream Networks for Multimodal Image Registrationcited by 25
  3. 2021Synth-by-Reg (SbR): Contrastive learning for synthesis-based registration of paired imagescited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 2; 2023: 4; 2024: 2; 2025: 2; 2026: 1.

11 papers.