mlsanityData to 7 Oct 2026

MUST: Modality-Specific Representation-Aware Transformer for Diffusion-Enhanced Survival Prediction with Missing Modality

arXiv 2603.26071 ↗First posted 27 Mar 2026cs.CV cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Accurate survival prediction from multimodal medical data is essential for precision oncology, yet clinical deployment faces a persistent challenge: modalities are frequently incomplete due to cost constraints, technical limitations, or retrospective data availability. While recent methods attempt to address missing modalities through feature alignment or joint distribution learning, they fundamentally lack explicit modeling of the unique contributions of each modality as opposed to the information derivable from other modalities. We propose MUST (Modality-Specific representation-aware Transformer), a novel framework that explicitly decomposes each modality's representation into modality-specific and cross-modal contextualized components through algebraic constraints in a learned low-rank shared subspace. This decomposition enables precise identification of what information is lost when a modality is absent. For the truly modality-specific information that cannot be inferred from available modalities, we employ conditional latent diffusion models to generate high-quality representations conditioned on recovered shared information and learned structural priors. Extensive experiments on five TCGA cancer datasets demonstrate that MUST achieves state-of-the-art performance with complete data while maintaining robust predictions in both missing pathology and missing genomics conditions, with clinically acceptable inference latency.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 26 of its 43 references that are in the map. First posted on arXiv 27 Mar 2026.

Builds on

26 of 43 references.

References · 26

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2020Denoising Diffusion Implicit Modelscited by 9,655
  5. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
  6. 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,375
  7. 2023ImageBind: One Embedding Space To Bind Them Allcited by 1,162
  8. 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,004
  9. 2020Data Efficient and Weakly Supervised Computational Pathology on Whole Slide Imagescited by 738
  10. 2017Self-Normalizing Neural Networkscited by 591
  11. 2021TransMIL: Transformer based Correlated Multiple Instance Learning for Whole Slide Image Classificationcited by 549
  12. 2023BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairscited by 506
14 more
  1. 2021SMIL: Multimodal Learning with Severely Missing Modalitycited by 243
  2. 2022Unsupervised Medical Image Translation with Adversarial Diffusion Modelscited by 191
  3. 2019Pathomic Fusion: An Integrated Framework for Fusing Histopathology and Genomic Features for Cancer Diagnosis and Prognosiscited by 165
  4. 2023Multi-modal Learning with Missing Modality via Shared-Specific Feature Modellingcited by 159
  5. 2019Missing MRI Pulse Sequence Synthesis using Multi-Modal Generative Adversarial Networkcited by 98
  6. 2023Modeling Dense Multimodal Interactions Between Biological Pathways and Histology for Survival Predictioncited by 92
  7. 2023Multimodal Optimal Transport-based Co-Attention Transformer with Global Structure Consistency for Survival Predictioncited by 86
  8. 2022M3Care: Learning with Missing Modalities in Multimodal Healthcare Datacited by 71
  9. 2023Cross-Modal Translation and Alignment for Survival Analysiscited by 70
  10. 2019Hetero-Modal Variational Encoder-Decoder for Joint Modality Completion and Segmentationcited by 68
  11. 2022Bayesian MRI Reconstruction with Joint Uncertainty Estimation using Diffusion Modelscited by 46
  12. 2025Robust Multimodal Survival Prediction with the Latent Differentiation Conditional Variational AutoEncodercited by 13
  13. 2022Hierarchical Transformer for Survival Prediction Using Multimodality Whole Slide Images and Genomicscited by 8
  14. 2024Cross-modality image synthesis from TOF-MRA to CTA using diffusion-based modelscited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Multi-Modal Mamba Modeling for Survival Prediction (M4Survive): Adapting Joint Foundation Model Representations
  2. 2026Attention-Based Multimodal Survival Prediction with Cross-Modal Bilinear Fusion
  3. 2026MMSF: Multitask and Multimodal Supervised Framework for WSI Classification and Survival Analysis
  4. 2026REMIND: Rethinking Medical High-Modality Learning under Missingness--A Long-Tailed Distribution Perspective
  5. 2026HDMoE: A Hierarchical Decoupling-Fusion Mixture-of-Experts Framework for Multimodal Cancer Survival Prediction
  6. 2026Anchor-driven Multi-modal Multi-scale Expert Selection for Survival Prediction
  7. 2024MMFusion: Multi-modality Diffusion Model for Lymph Node Metastasis Diagnosis in Esophageal Cancer
  8. 2026SAGEAgent: A Self-Evolving Agent for Cost-Aware Modality Acquisition in Multimodal Survival Prediction