mlsanityData to 14 Oct 2026

PRA-PoE: Robust Multimodal Alzheimer's Diagnosis with Arbitrary Missing Modalities

arXiv 2605.13081 ↗First posted 13 May 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Missing modalities are prevalent in real-world Alzheimer's disease (AD) assessment and pose a significant challenge to multimodal learning, particularly when the distribution of observed modality subsets differs between training and deployment. Such missingness pattern mismatch induces a conditional representation shift across modality subsets. Existing approaches that rely on implicit imputation or modality synthesis often fail to explicitly model modality availability and uncertainty, leading to overconfident dependence on synthesized features, reduced robustness, and miscalibrated uncertainty estimates. To address these limitations, we propose PRA-PoE, an incomplete multimodal learning framework that is equipped with Prototype-anchored Representation Alignment (PRA) and an Uncertainty-aware Product of Experts (UA-PoE) fusion mechanism. First, PRA uses learnable global prototypes and availability-conditioned tokens to encode modality availability, distinguish observed from missing modalities, re-synthesize features for missing modalities, and adaptively refine observed representations to align latent spaces across modality subsets, with the goal of reducing representation shift under varying missingness patterns. Second, UA-PoE models each modality as a Gaussian expert and performs closed-form Product of Experts fusion, where experts with higher uncertainty are automatically down-weighted via lower precision, improving uncertainty reliability. We evaluate PRA-PoE under a clinically realistic protocol by training with naturally missing data and testing on all non-empty modality combinations. PRA-PoE consistently outperforms the state-of-the-art across datasets, achieving a 5.4% relative improvement in average accuracy on ADNI and a 10.9% relative gain in average F1 on OASIS-3 over the strongest baseline across all non-empty modality subsets.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 34 references that are in the map. First posted on arXiv 13 May 2026.

Builds on

9 of 34 references.

References · 9

  1. 2019Variational Mixture-of-Experts Autoencoders for Multi-Modal Deep Generative Modelscited by 178
  2. 2023Multi-modal Learning with Missing Modality via Shared-Specific Feature Modellingcited by 163
  3. 2022mmFormer: Multimodal Medical Transformer for Incomplete Multimodal Learning of Brain Tumor Segmentationcited by 95
  4. 2022M3Care: Learning with Missing Modalities in Multimodal Healthcare Datacited by 72
  5. 2024Flex-MoE: Modeling Arbitrary Modality Combination via the Flexible Mixture-of-Expertscited by 70
  6. 2024FuseMoE: Mixture-of-Experts Transformers for Fleximodal Fusioncited by 68
  7. 2023Towards Balanced Active Learning for Multimodal Classificationcited by 9
  8. 2025ADAgent: LLM Agent for Alzheimer's Disease Analysis with Collaborative Coordinatorcited by 9
  9. 2025MCE: Towards a General Framework for Handling Missing Modalities under Imbalanced Missing Ratescited by 4

Built on by

Not cited yet.