Improving Generalization of Medical Image Registration Foundation Model
Not on the map. Why?
Abstract (arXiv)
Deformable registration is a fundamental task in medical image processing, aiming to achieve precise alignment by establishing nonlinear correspondences between images. Traditional methods offer good adaptability and interpretability but are limited by computational efficiency. Although deep learning approaches have significantly improved registration speed and accuracy, they often lack flexibility and generalizability across different datasets and tasks. In recent years, foundation models have emerged as a promising direction, leveraging large and diverse datasets to learn universal features and transformation patterns for image registration, thus demonstrating strong cross-task transferability. However, these models still face challenges in generalization and robustness when encountering novel anatomical structures, varying imaging conditions, or unseen modalities. To address these limitations, this paper incorporates Sharpness-Aware Minimization (SAM) into foundation models to enhance their generalization and robustness in medical image registration. By optimizing the flatness of the loss landscape, SAM improves model stability across diverse data distributions and strengthens its ability to handle complex clinical scenarios. Experimental results show that foundation models integrated with SAM achieve significant improvements in cross-dataset registration performance, offering new insights for the advancement of medical image registration technology. Our code is available at https://github.com/Promise13/fmsamhttps://github.com/Promise13/fmsam.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 45 of its 94 references that are in the map. First posted on arXiv 10 May 2025.
Builds on
45 of 94 references.
References · 45
- 2017Attention Is All You Needcited by 60,361
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2020Sharpness-Aware Minimization for Efficiently Improving Generalizationcited by 1,417
- 2018VoxelMorph: A Learning Framework for Deformable Medical Image Registrationcited by 662
- 2015Recent Advances in Convolutional Neural Networkscited by 360
- 2021High-Performance Large-Scale Image Recognition Without Normalizationcited by 360
- 2018A Deep Learning Framework for Unsupervised Affine and Deformable Image Registrationcited by 160
- 2020Large Deformation Diffeomorphic Image Registration with Laplacian Pyramid Networkscited by 136
- 2023On the Challenges and Perspectives of Foundation Models for Medical Image Analysiscited by 135
- 2021Learn2Reg: comprehensive multi-task medical image registration challenge, dataset and evaluation in the era of deep learningcited by 125
- 2021Sharpness-Aware Minimization Improves Language Model Generalizationcited by 108
33 more
- 2020CycleMorph: Cycle Consistent Unsupervised Deformable Image Registrationcited by 79
- 2024Detecting Multimedia Generated by Large AI Models: A Surveycited by 76
- 2024Preserving Fairness Generalization in Deepfake Detectioncited by 70
- 2021DiffuseMorph: Unsupervised Deformable Image Registration Using Diffusion Modelcited by 58
- 2024uniGradICON: A Foundation Model for Medical Image Registrationcited by 58
- 2022textttGradICON: Approximate Diffeomorphisms via Gradient Inverse Consistencycited by 41
- 2023Improving Fairness in Deepfake Detectioncited by 40
- 2024LLM-MedQA: Enhancing Medical Question Answering through Case Studies in Large Language Modelscited by 32
- 2024AI-Face: A Million-Scale Demographically Annotated AI-Generated Face Dataset and Fairness Benchmarkcited by 28
- 2021ICON: Learning Regular Maps Through Inverse Consistencycited by 26
- 2022Rank-based Decomposable Losses in Machine Learning: A Surveycited by 26
- 2024Robust CLIP-Based Detector for Exposing Diffusion Model-Generated Imagescited by 20
- 2024Robust Light-Weight Facial Affective Behavior Recognition with CLIPcited by 16
- 2024multiGradICON: A Foundation Model for Multimodal Medical Image Registrationcited by 16
- 2022Distributionally Robust Survival Analysis: A Novel Fairness Loss Without Demographicscited by 15
- 2024Fairness in Survival Analysis with Distributionally Robust Optimizationcited by 14
- 2023Synthesizing Black-box Anti-forensics DeepFakes with High Visual Qualitycited by 12
- 2023Outlier Robust Adversarial Trainingcited by 10
- 2023UMedNeRF: Uncertainty-aware Single View Volumetric Rendering for Medical Neural Radiance Fieldscited by 10
- 2024Uncertainty-Aware Explainable Recommendation with Large Language Modelscited by 10
- 2025Diffusion-empowered AutoPrompt MedSAMcited by 10
- 2024Masked Conditional Diffusion Model for Enhancing Deepfake Detectioncited by 9
- 2023Harnessing the Power of Text-image Contrastive Models for Automatic Detection of Online Misinformationcited by 6
- 2024Improving Generalization for AI-Synthesized Voice Detectioncited by 6
- 2021Stochastic Planner-Actor-Critic for Unsupervised Deformable Image Registrationcited by 5
- 2022RMBench: Benchmarking Deep Reinforcement Learning for Robotic Manipulator Controlcited by 5
- 2023X-Transfer: A Transfer Learning-Based Framework for GAN-Generated Fake Image Detectioncited by 4
- 2024Real-time Lane-wise Traffic Monitoring in Optimal ROIscited by 4
- 2023Attacking Important Pixels for Anchor-free Detectorscited by 3
- 2024A Self-Learning Multimodal Approach for Fake News Detectioncited by 3
- 2019Attention-driven Tree-structured Convolutional LSTM for High Dimensional Data Understandingcited by 2
- 2024Efficient Image Super-Resolution via Symmetric Visual Attention Networkcited by 2
- 2024Enhancing Vehicle Re-identification and Matching for Weaving Analysiscited by 1
Built on by
Citing papers per year: 2025: 1; 2026: 5.
6 papers.
- 2025MedChat: A Multi-Agent Framework for Multimodal Diagnosis with Large Language Modelscited by 5
- 2026Interpretable Unsupervised Deformable Image Registration via Confidence-bound Multi-Hop Visual Reasoningcited by 0
- 2026Attention-Driven Framework for Non-Rigid Medical Image Registrationcited by 0
- 2026Foundation Models for Medical Imaging: Status, Challenges, and Directionscited by 0
- 2026Robust Multi-Source Covid-19 Detection in CT Imagescited by 0
- 2026Weight Group-wise Post-Training Quantization for Medical Foundation Modelcited by 0
- 2026Weight Group-wise Post-Training Quantization for Medical Foundation Model9 Apr 2026
- 2026Robust Multi-Source Covid-19 Detection in CT Images2 Apr 2026
- 2026Foundation Models for Medical Imaging: Status, Challenges, and Directions17 Feb 2026
- 2026Attention-Driven Framework for Non-Rigid Medical Image Registration6 Feb 2026
- 2026Interpretable Unsupervised Deformable Image Registration via Confidence-bound Multi-Hop Visual Reasoning30 Jan 2026
- 2025MedChat: A Multi-Agent Framework for Multimodal Diagnosis with Large Language Models9 Jun 2025