mlsanityData to 14 Oct 2026

MCE: Towards a General Framework for Handling Missing Modalities under Imbalanced Missing Rates

arXiv 2510.10534 ↗First posted 12 Oct 2025cs.CV cs.LG cs.MMcited by 4

Not on the map. Why?

Abstract (arXiv)

Multi-modal learning has made significant advances across diverse pattern recognition applications. However, handling missing modalities, especially under imbalanced missing rates, remains a major challenge. This imbalance triggers a vicious cycle: modalities with higher missing rates receive fewer updates, leading to inconsistent learning progress and representational degradation that further diminishes their contribution. Existing methods typically focus on global dataset-level balancing, often overlooking critical sample-level variations in modality utility and the underlying issue of degraded feature quality. We propose Modality Capability Enhancement (MCE) to tackle these limitations. MCE includes two synergistic components: i) Learning Capability Enhancement (LCE), which introduces multi-level factors to dynamically balance modality-specific learning progress, and ii) Representation Capability Enhancement (RCE), which improves feature semantics and robustness through subset prediction and cross-modal completion tasks. Comprehensive evaluations on four multi-modal benchmarks show that MCE consistently outperforms state-of-the-art methods under various missing configurations. The final published version is now available at https://doi.org/10.1016/j.patcog.2025.112591. Our code is available at https://github.com/byzhaoAI/MCE.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 27 of its 52 references that are in the map. First posted on arXiv 12 Oct 2025.

Builds on

27 of 52 references.

References · 27

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2016Densely Connected Convolutional Networkscited by 6,720
  4. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
  5. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  6. 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,044
  7. 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,013
  8. 2018Identifying the Best Machine Learning Algorithms for Brain Tumor Segmentation, Progression Assessment, and Overall Survival Prediction in the BRATS Challengecited by 511
  9. 2022Balanced Multimodal Learning via On-the-fly Gradient Modulationcited by 264
  10. 2021SMIL: Multimodal Learning with Severely Missing Modalitycited by 245
  11. 2023Multi-modal Learning with Missing Modality via Shared-Specific Feature Modellingcited by 163
  12. 2022Simple-BEV: What Really Matters for Multi-Sensor BEV Perception?cited by 128
15 more
  1. 2022Modality Competition: What Makes Joint Training of Multi-modal Network Fail in Deep Learning? (Provably)cited by 122
  2. 2022PMR: Prototypical Modal Rebalance for Multimodal Learningcited by 116
  3. 2014Long Short-Term Memory Based Recurrent Neural Network Architectures for Large Vocabulary Speech Recognitioncited by 111
  4. 2022mmFormer: Multimodal Medical Transformer for Incomplete Multimodal Learning of Brain Tumor Segmentationcited by 95
  5. 2022GCNet: Graph Completion Network for Incomplete Multimodal Learning in Conversationcited by 87
  6. 2018CentralNet: a Multilayer Approach for Multimodal Fusioncited by 86
  7. 2024MADTP: Multimodal Alignment-Guided Dynamic Token Pruning for Accelerating Vision-Language Transformercited by 54
  8. 2023Enhancing multimodal cooperation via sample-level modality valuationcited by 44
  9. 2024Diagnosing and Re-learning for Balanced Multimodal Learningcited by 41
  10. 2023UniBEV: Multi-modal 3D Object Detection with Uniform BEV Encoders for Robustness against Missing Sensor Modalitiescited by 29
  11. 2023Robust Multimodal Learning with Missing Modalities via Parameter-Efficient Adaptationcited by 29
  12. 2021Assessing Fairness in the Presence of Missing Datacited by 24
  13. 2024PASSION: Towards Effective Incomplete Multi-Modal Medical Image Segmentation with Imbalanced Missing Ratescited by 17
  14. 2023RedCore: Relative Advantage Aware Cross-modal Representation Learning for Missing Modalities with Imbalanced Missing Ratescited by 15
  15. 2024Ada2I: Enhancing Modality Balance for Multimodal Conversational Emotion Recognitioncited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.