mlsanityData to 7 Oct 2026

Causal Transfer in Medical Image Analysis

arXiv 2603.24388 ↗First posted 25 Mar 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Medical imaging models frequently fail when deployed across hospitals, scanners, populations, or imaging protocols due to domain shift, limiting their clinical reliability. While transfer learning and domain adaptation address such shifts statistically, they often rely on spurious correlations that break under changing conditions. On the other hand, causal inference provides a principled way to identify invariant mechanisms that remain stable across environments. This survey introduces and systematises Causal Transfer Learning (CTL) for medical image analysis. This paradigm integrates causal reasoning with cross-domain representation learning to enable robust and generalisable clinical AI. We frame domain shift as a causal problem and analyse how structural causal models, invariant risk minimisation, and counterfactual reasoning can be embedded within transfer learning pipelines. We studied spanning classification, segmentation, reconstruction, anomaly detection, and multimodal imaging, and organised them by task, shift type, and causal assumption. A unified taxonomy is proposed that connects causal frameworks and transfer mechanisms. We further summarise datasets, benchmarks, and empirical gains, highlighting when and why causal transfer outperforms correlation-based domain adaptation. Finally, we discuss how CTL supports fairness, robustness, and trustworthy deployment in multi-institutional and federated settings, and outline open challenges and research directions for clinically reliable medical imaging AI.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 117 of its 235 references that are in the map. First posted on arXiv 25 Mar 2026.

Builds on

117 of 235 references.

References · 117

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  4. 2017Mask R-CNNcited by 7,259
  5. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  6. 2019Invariant Risk Minimizationcited by 1,832
  7. 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,410
  8. 2018Relational inductive biases, deep learning, and graph networkscited by 1,341
  9. 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,306
  10. 2017A Survey on Deep Learning in Medical Image Analysiscited by 1,182
  11. 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
  12. 2020In Search of Lost Domain Generalizationcited by 1,042
38 more
  1. 2019An Introduction to Variational Autoencoderscited by 997
  2. 2018DAGs with NO TEARS: Continuous Optimization for Structure Learningcited by 745
  3. 2018Identifying the Best Machine Learning Algorithms for Brain Tumor Segmentation, Progression Assessment, and Overall Survival Prediction in the BRATS Challengecited by 508
  4. 2021The RSNA-ASNR-MICCAI BraTS 2021 Benchmark on Brain Tumor Segmentation and Radiogenomic Classificationcited by 507
  5. 2019CLEVRER: CoLlision Events for Video REpresentation and Reasoningcited by 475
  6. 2017CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learningcited by 459
  7. 2016Tutorial on Variational Autoencoderscited by 404
  8. 2019A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAIcited by 403
  9. 2018Confounding variables can degrade generalization performance of radiological deep learning modelscited by 374
  10. 2021Domain Adaptation for Medical Image Analysis: A Surveycited by 351
  11. 2022AMOS: A Large-Scale Abdominal Multi-Organ Benchmark for Versatile Medical Image Segmentationcited by 347
  12. 2019PadChest: A large chest x-ray image dataset with multi-label annotated reportscited by 308
  13. 2020CHAOS Challenge -- Combined (CT-MR) Healthy Abdominal Organ Segmentationcited by 307
  14. 2023Multimodal Deep Learningcited by 257
  15. 2013Causal Discovery with Continuous Additive Noise Modelscited by 252
  16. 2019REFUGE Challenge: A Unified Framework for Evaluating Automated Methods for Glaucoma Assessment from Fundus Photographscited by 226
  17. 2020Deep Structural Causal Models for Tractable Counterfactual Inferencecited by 210
  18. 2021D'ya like DAGs? A Survey on Structure Learning and Causal Discoverycited by 209
  19. 2020A Survey on Causal Inferencecited by 202
  20. 2019Causality matters in medical imagingcited by 193
  21. 2020On the Role of Sparsity and DAG Constraints for Learning Linear DAGscited by 186
  22. 2019Causal Discovery from Heterogeneous/Nonstationary Data with Independent Changescited by 166
  23. 2015DeepOrgan: Multi-level Deep Convolutional Networks for Automated Pancreas Segmentationcited by 158
  24. 2021Reading Race: AI Recognises Patient's Racial Identity In Medical Imagescited by 155
  25. 2019A review of domain adaptation without target labelscited by 154
  26. 2017CausalGAN: Learning Causal Implicit Generative Models with Adversarial Trainingcited by 152
  27. 2019A Survey on Active Learning and Human-in-the-Loop Deep Learning for Medical Image Analysiscited by 150
  28. 2022Interventional Causal Representation Learningcited by 140
  29. 2022Causality Inspired Representation Learning for Domain Generalizationcited by 136
  30. 2019Deep Learning in Medical Image Registration: A Surveycited by 124
  31. 2020Shape-aware Meta-learning for Generalizing Prostate MRI Segmentation to Unseen Domainscited by 124
  32. 2021Causality-inspired Single-source Domain Generalization for Medical Image Segmentationcited by 118
  33. 2016Resnet in Resnet: Generalizing Residual Architecturescited by 110
  34. 2018Robustly Disentangled Causal Mechanisms: Validating Deep Representations for Interventional Robustnesscited by 108
  35. 2020Amortized Causal Discovery: Learning to Infer Causal Graphs from Time-Series Datacited by 99
  36. 2022VinDr-Mammo: A large-scale benchmark dataset for computer-aided diagnosis in full-field digital mammographycited by 83
  37. 2020Causal Discovery in Physical Systems from Videoscited by 77
  38. 2022Learning to Induce Causal Structurecited by 68

50 most cited of 117 All 117 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Making medical vision-language models think causally across modalities with retrieval-augmented cross-modal reasoning
  2. 2026When Models Learn to Ask Why: Adaptive Causal Reasoning for Trustworthy Medical Vision-Language Models
  3. 2026Leveraging Causal Reasoning Method for Explaining Medical Image Segmentation Models
  4. 2026What Do Medical Vision-Language Models Learn in Radiology? Transfer, Alignment, and Source-Proxy Leakage Under Distribution Shift
  5. 2026When Fine-Tuning Changes the Evidence: Architecture-Dependent Semantic Drift in Chest X-Ray Explanations
  6. 2026From Image Interpretation to Clinical Reasoning: Upstream Physician-Context-Aware Multimodal Learning with Causal Reinforcement Learning
  7. 2026Radiologist-Guided Causal Concept Bottleneck Models for Chest X-Ray Interpretation
  8. 2025Few-Shot Multimodal Medical Imaging: A Theoretical Framework