mlsanityData to 7 Oct 2026

A Flow Model with Low-Rank Transformers for Incomplete Multimodal Survival Analysis

arXiv 2510.21829 ↗First posted 22 Oct 2025cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

In recent years, multimodal medical data-based survival analysis has attracted much attention. However, real-world datasets often suffer from the problem of incomplete modality, where some patient modality information is missing due to acquisition limitations or system failures. Existing methods typically infer missing modalities directly from observed ones using deep neural networks, but they often ignore the distributional discrepancy across modalities, resulting in inconsistent and unreliable modality reconstruction. To address these challenges, we propose a novel framework that combines a low-rank Transformer with a flow-based generative model for robust and flexible multimodal survival prediction. Specifically, we first formulate the concerned problem as incomplete multimodal survival analysis using the multi-instance representation of whole slide images (WSIs) and genomic profiles. To realize incomplete multimodal survival analysis, we propose a class-specific flow for cross-modal distribution alignment. Under the condition of class labels, we model and transform the cross-modal distribution. By virtue of the reversible structure and accurate density modeling capabilities of the normalizing flow model, the model can effectively construct a distribution-consistent latent space of the missing modality, thereby improving the consistency between the reconstructed data and the true distribution. Finally, we design a lightweight Transformer architecture to model intra-modal dependencies while alleviating the overfitting problem in high-dimensional modality fusion by virtue of the low-rank Transformer. Extensive experiments have demonstrated that our method not only achieves state-of-the-art performance under complete modality settings, but also maintains robust and superior accuracy under the incomplete modalities scenario.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 33 of its 61 references that are in the map. First posted on arXiv 22 Oct 2025.

Builds on

33 of 61 references.

References · 33

  1. 2018Attention-based Deep Multiple Instance Learningcited by 1,077
  2. 2016Deep Variational Information Bottleneckcited by 915
  3. 2020Data Efficient and Weakly Supervised Computational Pathology on Whole Slide Imagescited by 738
  4. 2017Self-Normalizing Neural Networkscited by 591
  5. 2021TransMIL: Transformer based Correlated Multiple Instance Learning for Whole Slide Image Classificationcited by 549
  6. 2022DTFD-MIL: Double-Tier Feature Distillation Multiple Instance Learning for Histopathology Whole Slide Image Classificationcited by 254
  7. 2021SMIL: Multimodal Learning with Severely Missing Modalitycited by 243
  8. 2018Multimodal Generative Models for Scalable Weakly-Supervised Learningcited by 200
  9. 2022Are Multimodal Transformers Robust to Missing Modality?cited by 183
  10. 2020Whole Slide Images based Cancer Survival Prediction using Attention Guided Deep Multiple Instance Learning Networkscited by 178
  11. 2016On Deep Multi-View Representation Learning: Objectives and Optimizationcited by 162
  12. 2023Multi-modal Learning with Missing Modality via Shared-Specific Feature Modellingcited by 159
21 more
  1. 2018Found in Translation: Learning Robust Joint Representations by Cyclic Translations Between Modalitiescited by 149
  2. 2023Modeling Dense Multimodal Interactions Between Biological Pathways and Histology for Survival Predictioncited by 92
  3. 2023Multimodal Optimal Transport-based Co-Attention Transformer with Global Structure Consistency for Survival Predictioncited by 86
  4. 2023Cross-Modal Translation and Alignment for Survival Analysiscited by 70
  5. 2024Transcriptomics-guided Slide Representation Learning in Computational Pathologycited by 50
  6. 2023Deep Imbalanced Learning for Multimodal Emotion Recognition in Conversationscited by 47
  7. 2024Revisiting Multi-modal Emotion Learning with Broad State Space Models and Probability-guidance Fusioncited by 33
  8. 2024Revisiting Multimodal Emotion Recognition in Conversation from the Perspective of Graph Spectrumcited by 33
  9. 2023A Comprehensive Survey on Multi-modal Conversational Emotion Recognition with Deep Learningcited by 32
  10. 2023A Low-rank Matching Attention based Cross-modal Feature Fusion Method for Conversational Emotion Recognitioncited by 29
  11. 2023Masked Contrastive Graph Representation Learning for Age Estimationcited by 27
  12. 2023Graph Information Bottleneck for Remote Sensing Segmentationcited by 24
  13. 2024Efficient Long-distance Latent Relation-aware Graph Neural Network for Multi-modal Emotion Recognition in Conversationscited by 23
  14. 2024Contrastive Graph Representation Learning with Adversarial Cross-view Reconstruction and Information Bottleneckcited by 21
  15. 2024SpeGCL: Self-supervised Graph Spectrum Contrastive Learning without Positive Samplescited by 20
  16. 2024Graph Domain Adaptation with Dual-branch Encoder and Two-level Alignment for Whole Slide Image-based Survival Predictioncited by 20
  17. 2024Masked Graph Learning with Recurrent Alignment for Multimodal Emotion Recognition in Conversationcited by 19
  18. 2025Multimodal Large Language Models Meet Multimodal Emotion Recognition and Reasoning: A Surveycited by 19
  19. 2025Robust Multimodal Survival Prediction with the Latent Differentiation Conditional Variational AutoEncodercited by 13
  20. 2025Distilled Prompt Learning for Incomplete Multimodal Survival Predictioncited by 10
  21. 2025AdaMHF: Adaptive Multimodal Hierarchical Fusion for Survival Predictioncited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.