Conditional Evidence Reconstruction and Decomposition for Interpretable Multimodal Diagnosis
Not on the map. Why?
Abstract (arXiv)
Neurobiological and neurodegenerative diseases are inherently multifactorial, arising from coupled influences spanning genetic susceptibility, brain alterations, and environmental and behavioral factors. Multimodal modeling has therefore been increasingly adopted for disease diagnosis by integrating complementary evidence across data sources. However, in both large-scale cohorts and real-world clinical workflows, modality coverage is often incomplete, making many multimodal models brittle when one or more modalities are unavailable. Existing approaches to incomplete multimodal diagnosis typically rely on group-wise or static priors, which may fail to capture subject-specific cross-modal dependencies; moreover, many models provide limited interpretability into which evidence sources drive the final decision. To address these limitations, we propose Conditional Evidence Reconstruction and Decomposition (CERD), a framework for interpretable multimodal diagnosis with incomplete modalities. CERD first reconstructs missing modality representations conditioned on each subject's observed inputs, then decomposes diagnostic evidence into shared cross-modal corroboration and modality-specific cues via logit-level attribution. Experiments on the Alzheimer's Disease Neuroimaging Initiative (ADNI) demonstrate that CERD outperforms competitive baselines under incomplete-modality settings while producing structured and clinically aligned evidence attributions for trustworthy decision support.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 25 references that are in the map. First posted on arXiv 18 Apr 2026.
Builds on
13 of 25 references.
References · 13
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2017Axiomatic Attribution for Deep Networkscited by 3,384
- 2017Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPRcited by 1,089
- 2021SMIL: Multimodal Learning with Severely Missing Modalitycited by 245
- 2018Multimodal Generative Models for Scalable Weakly-Supervised Learningcited by 200
- 2019What Clinicians Want: Contextualizing Explainable Machine Learning for Clinical End Usecited by 135
- 2016HeMIS: Hetero-Modal Image Segmentationcited by 103
- 2024Deep Multimodal Learning with Missing Modality: A Surveycited by 92
- 2021Generalized Multimodal ELBOcited by 87
- 2022M3Care: Learning with Missing Modalities in Multimodal Healthcare Datacited by 72
Built on by
Not cited yet.