A Deep Metric for Multimodal Registration
Not on the map. Why?
Abstract (arXiv)
Multimodal registration is a challenging problem in medical imaging due the high variability of tissue appearance under different imaging modalities. The crucial component here is the choice of the right similarity measure. We make a step towards a general learning-based solution that can be adapted to specific situations and present a metric based on a convolutional neural network. Our network can be trained from scratch even from a few aligned image pairs. The metric is validated on intersubject deformable registration on a dataset different from the one used for training, demonstrating good generalization. In this task, we outperform mutual information by a significant margin.
Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). First posted on arXiv 17 Sep 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 7; 2023: 1; 2024: 4; 2025: 1; 2026: 2.
19 papers.
Sort:
By area:
- 2021Recent advances and clinical applications of deep learning in medical image analysiscited by 104
- 2022Transforming medical imaging with Transformers? A comparative review of key properties, current progresses, and future perspectivescited by 32
- 2024MedIAnomaly: A comparative study of anomaly detection in medical imagescited by 25
- 2024multiGradICON: A Foundation Model for Multimodal Medical Image Registrationcited by 16
- 2022X-Metric: An N-Dimensional Information-Theoretic Framework for Groupwise Registration and Deep Combined Computingcited by 10
- 2021Semantic similarity metrics for learned image registrationcited by 9
- 2022ContraReg: Contrastive Learning of Multi-modality Unsupervised Deformable Image Registrationcited by 9
- 2022Cross-Modality Image Registration using a Training-Time Privileged Third Modalitycited by 9
- 2022Deep Learning for Medical Image Registration: A Comprehensive Reviewcited by 8
- 2023MAD: Modality Agnostic Distance Measure for Image Registrationcited by 7
- 2021Regularized directional representations for medical image registrationcited by 3
- 2025Modality-Aware Feature Matching in Visual and Vision-Language Applications: A Comprehensive Surveycited by 2
7 more
- 2022Unsupervised Image Registration Towards Enhancing Performance and Explainability in Cardiac And Brain Image Analysiscited by 1
- 2024General Vision Encoder Features as Guidance in Medical Image Registrationcited by 1
- 2024MambaReg: Mamba-Based Disentangled Convolutional Sparse Coding for Unsupervised Deformable Multi-Modal Image Registrationcited by 1
- 2021D-Net: Siamese based Network with Mutual Attention for Volume Alignmentcited by 0
- 2022An overview of deep learning in medical imagingcited by 0
- 2026CoRe: Joint Optimization with Contrastive Learning for Medical Image Registrationcited by 0
- 2026Benchmarking Intra-Patient 3D Deformable Multimodal Image Registrationcited by 0
- 2026Benchmarking Intra-Patient 3D Deformable Multimodal Image Registration14 Sep 2026
- 2026CoRe: Joint Optimization with Contrastive Learning for Medical Image Registration24 Mar 2026
- 2025Modality-Aware Feature Matching in Visual and Vision-Language Applications: A Comprehensive Survey30 Jul 2025
- 2024MambaReg: Mamba-Based Disentangled Convolutional Sparse Coding for Unsupervised Deformable Multi-Modal Image Registration3 Nov 2024
- 2024multiGradICON: A Foundation Model for Multimodal Medical Image Registration1 Aug 2024
- 2024General Vision Encoder Features as Guidance in Medical Image Registration18 Jul 2024
- 2024MedIAnomaly: A comparative study of anomaly detection in medical images6 Apr 2024
- 2023MAD: Modality Agnostic Distance Measure for Image Registration6 Sep 2023
- 2022X-Metric: An N-Dimensional Information-Theoretic Framework for Groupwise Registration and Deep Combined Computing3 Nov 2022
- 2022Cross-Modality Image Registration using a Training-Time Privileged Third Modality26 Jul 2022
- 2022ContraReg: Contrastive Learning of Multi-modality Unsupervised Deformable Image Registration27 Jun 2022
- 2022Transforming medical imaging with Transformers? A comparative review of key properties, current progresses, and future perspectives2 Jun 2022
7 more
- 2022Deep Learning for Medical Image Registration: A Comprehensive Review24 Apr 2022
- 2022Unsupervised Image Registration Towards Enhancing Performance and Explainability in Cardiac And Brain Image Analysis7 Mar 2022
- 2022An overview of deep learning in medical imaging17 Feb 2022
- 2021Regularized directional representations for medical image registration30 Nov 2021
- 2021Recent advances and clinical applications of deep learning in medical image analysis27 May 2021
- 2021Semantic similarity metrics for learned image registration20 Apr 2021
- 2021D-Net: Siamese based Network with Mutual Attention for Volume Alignment25 Jan 2021
- 2021Recent advances and clinical applications of deep learning in medical image analysiscited by 104
- 2022Transforming medical imaging with Transformers? A comparative review of key properties, current progresses, and future perspectivescited by 32
- 2024MedIAnomaly: A comparative study of anomaly detection in medical imagescited by 25
- 2024multiGradICON: A Foundation Model for Multimodal Medical Image Registrationcited by 16
- 2022X-Metric: An N-Dimensional Information-Theoretic Framework for Groupwise Registration and Deep Combined Computingcited by 10
- 2021Semantic similarity metrics for learned image registrationcited by 9
- 2022ContraReg: Contrastive Learning of Multi-modality Unsupervised Deformable Image Registrationcited by 9
- 2022Cross-Modality Image Registration using a Training-Time Privileged Third Modalitycited by 9
- 2022Deep Learning for Medical Image Registration: A Comprehensive Reviewcited by 8
- 2023MAD: Modality Agnostic Distance Measure for Image Registrationcited by 7
- 2021Regularized directional representations for medical image registrationcited by 3
- 2025Modality-Aware Feature Matching in Visual and Vision-Language Applications: A Comprehensive Surveycited by 2
12 most cited of 18 All 18 (JSON)
- 2026Benchmarking Intra-Patient 3D Deformable Multimodal Image Registration14 Sep 2026
- 2026CoRe: Joint Optimization with Contrastive Learning for Medical Image Registration24 Mar 2026
- 2025Modality-Aware Feature Matching in Visual and Vision-Language Applications: A Comprehensive Survey30 Jul 2025
- 2024multiGradICON: A Foundation Model for Multimodal Medical Image Registration1 Aug 2024
- 2024General Vision Encoder Features as Guidance in Medical Image Registration18 Jul 2024
- 2024MedIAnomaly: A comparative study of anomaly detection in medical images6 Apr 2024
- 2023MAD: Modality Agnostic Distance Measure for Image Registration6 Sep 2023
- 2022X-Metric: An N-Dimensional Information-Theoretic Framework for Groupwise Registration and Deep Combined Computing3 Nov 2022
- 2022Cross-Modality Image Registration using a Training-Time Privileged Third Modality26 Jul 2022
- 2022ContraReg: Contrastive Learning of Multi-modality Unsupervised Deformable Image Registration27 Jun 2022
- 2022Transforming medical imaging with Transformers? A comparative review of key properties, current progresses, and future perspectives2 Jun 2022
- 2022Deep Learning for Medical Image Registration: A Comprehensive Review24 Apr 2022
12 newest of 18 All 18 (JSON)