Causal Transfer in Medical Image Analysis
Not on the map. Why?
Abstract (arXiv)
Medical imaging models frequently fail when deployed across hospitals, scanners, populations, or imaging protocols due to domain shift, limiting their clinical reliability. While transfer learning and domain adaptation address such shifts statistically, they often rely on spurious correlations that break under changing conditions. On the other hand, causal inference provides a principled way to identify invariant mechanisms that remain stable across environments. This survey introduces and systematises Causal Transfer Learning (CTL) for medical image analysis. This paradigm integrates causal reasoning with cross-domain representation learning to enable robust and generalisable clinical AI. We frame domain shift as a causal problem and analyse how structural causal models, invariant risk minimisation, and counterfactual reasoning can be embedded within transfer learning pipelines. We studied spanning classification, segmentation, reconstruction, anomaly detection, and multimodal imaging, and organised them by task, shift type, and causal assumption. A unified taxonomy is proposed that connects causal frameworks and transfer mechanisms. We further summarise datasets, benchmarks, and empirical gains, highlighting when and why causal transfer outperforms correlation-based domain adaptation. Finally, we discuss how CTL supports fairness, robustness, and trustworthy deployment in multi-institutional and federated settings, and outline open challenges and research directions for clinically reliable medical imaging AI.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 117 of its 235 references that are in the map. First posted on arXiv 25 Mar 2026.
Builds on
117 of 235 references.
References · 117
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2017Mask R-CNNcited by 7,259
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2019Invariant Risk Minimizationcited by 1,832
- 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,410
- 2018Relational inductive biases, deep learning, and graph networkscited by 1,341
- 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,306
- 2017A Survey on Deep Learning in Medical Image Analysiscited by 1,182
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
- 2020In Search of Lost Domain Generalizationcited by 1,042
38 more
- 2019An Introduction to Variational Autoencoderscited by 997
- 2018DAGs with NO TEARS: Continuous Optimization for Structure Learningcited by 745
- 2018Identifying the Best Machine Learning Algorithms for Brain Tumor Segmentation, Progression Assessment, and Overall Survival Prediction in the BRATS Challengecited by 508
- 2021The RSNA-ASNR-MICCAI BraTS 2021 Benchmark on Brain Tumor Segmentation and Radiogenomic Classificationcited by 507
- 2019CLEVRER: CoLlision Events for Video REpresentation and Reasoningcited by 475
- 2017CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learningcited by 459
- 2016Tutorial on Variational Autoencoderscited by 404
- 2019A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAIcited by 403
- 2018Confounding variables can degrade generalization performance of radiological deep learning modelscited by 374
- 2021Domain Adaptation for Medical Image Analysis: A Surveycited by 351
- 2022AMOS: A Large-Scale Abdominal Multi-Organ Benchmark for Versatile Medical Image Segmentationcited by 347
- 2019PadChest: A large chest x-ray image dataset with multi-label annotated reportscited by 308
- 2020CHAOS Challenge -- Combined (CT-MR) Healthy Abdominal Organ Segmentationcited by 307
- 2023Multimodal Deep Learningcited by 257
- 2013Causal Discovery with Continuous Additive Noise Modelscited by 252
- 2019REFUGE Challenge: A Unified Framework for Evaluating Automated Methods for Glaucoma Assessment from Fundus Photographscited by 226
- 2020Deep Structural Causal Models for Tractable Counterfactual Inferencecited by 210
- 2021D'ya like DAGs? A Survey on Structure Learning and Causal Discoverycited by 209
- 2020A Survey on Causal Inferencecited by 202
- 2019Causality matters in medical imagingcited by 193
- 2020On the Role of Sparsity and DAG Constraints for Learning Linear DAGscited by 186
- 2019Causal Discovery from Heterogeneous/Nonstationary Data with Independent Changescited by 166
- 2015DeepOrgan: Multi-level Deep Convolutional Networks for Automated Pancreas Segmentationcited by 158
- 2021Reading Race: AI Recognises Patient's Racial Identity In Medical Imagescited by 155
- 2019A review of domain adaptation without target labelscited by 154
- 2017CausalGAN: Learning Causal Implicit Generative Models with Adversarial Trainingcited by 152
- 2019A Survey on Active Learning and Human-in-the-Loop Deep Learning for Medical Image Analysiscited by 150
- 2022Interventional Causal Representation Learningcited by 140
- 2022Causality Inspired Representation Learning for Domain Generalizationcited by 136
- 2019Deep Learning in Medical Image Registration: A Surveycited by 124
- 2020Shape-aware Meta-learning for Generalizing Prostate MRI Segmentation to Unseen Domainscited by 124
- 2021Causality-inspired Single-source Domain Generalization for Medical Image Segmentationcited by 118
- 2016Resnet in Resnet: Generalizing Residual Architecturescited by 110
- 2018Robustly Disentangled Causal Mechanisms: Validating Deep Representations for Interventional Robustnesscited by 108
- 2020Amortized Causal Discovery: Learning to Infer Causal Graphs from Time-Series Datacited by 99
- 2022VinDr-Mammo: A large-scale benchmark dataset for computer-aided diagnosis in full-field digital mammographycited by 83
- 2020Causal Discovery in Physical Systems from Videoscited by 77
- 2022Learning to Induce Causal Structurecited by 68
50 most cited of 117 All 117 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Making medical vision-language models think causally across modalities with retrieval-augmented cross-modal reasoning
- 2026When Models Learn to Ask Why: Adaptive Causal Reasoning for Trustworthy Medical Vision-Language Models
- 2026Leveraging Causal Reasoning Method for Explaining Medical Image Segmentation Models
- 2026What Do Medical Vision-Language Models Learn in Radiology? Transfer, Alignment, and Source-Proxy Leakage Under Distribution Shift
- 2026When Fine-Tuning Changes the Evidence: Architecture-Dependent Semantic Drift in Chest X-Ray Explanations
- 2026From Image Interpretation to Clinical Reasoning: Upstream Physician-Context-Aware Multimodal Learning with Causal Reinforcement Learning
- 2026Radiologist-Guided Causal Concept Bottleneck Models for Chest X-Ray Interpretation
- 2025Few-Shot Multimodal Medical Imaging: A Theoretical Framework