Few-Shot Multimodal Medical Imaging: A Theoretical Framework
Not on the map. Why?
Abstract (arXiv)
Medical imaging often operates under limited labeled data, especially in rare disease and low resource clinical environments. Existing multimodal and meta learning approaches improve performance in these settings but lack a theoretical explanation of why or when they succeed. This paper presents a unified theoretical framework for few shot multimodal medical imaging that jointly characterizes sample complexity, uncertainty quantification, and interpretability. Using PAC learning, VC theory, and PAC Bayesian analysis, we derive bounds that describe the minimum number of labeled samples required for reliable performance and show how complementary modalities reduce effective capacity through an information gain term. We further introduce a formal metric for explanation stability, proving that explanation variance decreases at an inverse n rate. A sequential Bayesian interpretation of Chain of Thought reasoning is also developed to show stepwise posterior contraction. To illustrate these ideas, we implement a controlled multimodal dataset and evaluate an additive CNN MLP fusion model under few shot regimes, confirming predicted multimodal gains, modality interference at larger sample sizes, and shrinking predictive uncertainty. Together, the framework provides a principled foundation for designing data efficient, uncertainty aware, and interpretable diagnostic models in low resource settings.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 23 of its 42 references that are in the map. First posted on arXiv 3 Nov 2025.
Builds on
23 of 42 references.
References · 23
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
- 2016Matching Networks for One Shot Learningcited by 2,246
- 2020In Search of Lost Domain Generalizationcited by 1,042
- 2020Meta-Learning in Neural Networks: A Surveycited by 944
- 2020A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challengescited by 813
- 2017Computing Nonvacuous Generalization Bounds for Deep (Stochastic) Neural Networks with Many More Parameters than Training Datacited by 527
- 2018On the Robustness of Interpretability Methodscited by 310
- 2017Information-theoretic analysis of generalization capability of learning algorithmscited by 299
- 2017Emergence of Invariance and Disentanglement in Deep Representationscited by 213
- 2021Causality-inspired Single-source Domain Generalization for Medical Image Segmentationcited by 118
11 more
- 2020Bayesian Deep Ensembles via the Neural Tangent Kernelcited by 90
- 2023Tractable Function-Space Variational Inference in Bayesian Neural Networkscited by 41
- 2020Doubly Stochastic Variational Inference for Neural Processes with Hierarchical Latent Variablescited by 33
- 2024Review of multimodal machine learning approaches in healthcarecited by 30
- 2023A Systematic Review of Few-Shot Learning in Medical Imagingcited by 28
- 2019Uncertainty Quantification in Deep Learning for Safer Neuroimage Enhancementcited by 9
- 2023Few Shot Learning for Medical Imaging: A Comparative Analysis of Methodologies and Formal Mathematical Frameworkcited by 9
- 2024BayTTA: Uncertainty-aware medical image classification with optimized test-time augmentation using Bayesian model averagingcited by 5
- 2024PM2: A New Prompting Multi-modal Model Paradigm for Few-shot Medical Image Classificationcited by 3
- 2025Blockchain-Enabled Explainable AI for Trusted Healthcare Systemscited by 2
- 2025Multimodal Foundation Models for Early Disease Detectioncited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Citrus-V: Advancing Medical Foundation Models with Unified Medical Image Grounding for Clinical Reasoning
- 2024Few-shot Adaptation of Medical Vision-Language Models
- 2024Comprehensive Evaluation of Multimodal AI Models in Medical Imaging Diagnosis: From Data Augmentation to Preference-Based Comparison
- 2025An Explainable Biomedical Foundation Model via Large-Scale Concept-Enhanced Vision-Language Pre-training
- 2024Simplifying Multimodality: Unimodal Approach to Multimodal Challenges in Radiology with General-Domain Large Language Model
- 2026Causal Transfer in Medical Image Analysis
- 2024Worse than Random? An Embarrassingly Simple Probing Evaluation of Large Multimodal Models in Medical VQA
- 2026HounsWorld: A Multimodal World Model for Hidden Patient-State Readout, Reconstruction, and Simulation