mlsanityData to 7 Oct 2026

LIMSSR: LLM-Driven Sequence-to-Score Reasoning under Training-Time Incomplete Multimodal Observations

arXiv 2605.00434 ↗First posted 1 May 2026cs.CVcited by 1

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

Real-world multimodal learning is often hindered by missing modalities. While Incomplete Multimodal Learning (IML) has gained traction, existing methods typically rely on the unrealistic assumption of full-modal availability during training to provide reconstruction supervision or cross-modal priors. This paper tackles the more challenging setting of IML under training-time incomplete observations, which precludes reliance on a ``God's eye view'' of complete data. We propose LIMSSR (LLM-Driven Incomplete Multimodal Sequence-to-Score Reasoning), a framework that reformulates this challenge as a conditional sequence reasoning task. LIMSSR leverages the semantic reasoning capabilities of Large Language Models via Prompt-Guided Context-Aware Modality Imputation and Multidimensional Representation Fusion to infer latent semantics from available contexts without direct reconstruction. To mitigate hallucinations, we introduce a Mask-Aware Dual-Path Aggregation to dynamically calibrate inference uncertainty. Extensive experiments on three Action Quality Assessment datasets demonstrate that LIMSSR significantly outperforms state-of-the-art baselines without relying on complete training data, establishing a new paradigm for data-efficient multimodal learning. Code is available at https://github.com/XuHuangbiao/LIMSSR.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 5 of its 63 references that are in the map. First posted on arXiv 1 May 2026.

Builds on

5 of 63 references.

References · 5

  1. 2024The Llama 3 Herd of Modelscited by 14,192
  2. 2025Qwen3 Technical Reportcited by 8,195
  3. 2025Gemma 3 Technical Reportcited by 1,686
  4. 2021AST: Audio Spectrogram Transformercited by 634
  5. 2024Deep Multimodal Learning with Missing Modality: A Surveycited by 89

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026DLWM: Diverse Latent World Models for Efficient Multimodal Reasoning
  2. 2025TACO: Enhancing Multimodal In-context Learning via Task Mapping-Guided Sequence Configuration
  3. 2025CIMR: Contextualized Iterative Multimodal Reasoning for Robust Instruction Following in LVLMs
  4. 2023On the Performance of Multimodal Language Models
  5. 2025Self-Rewarded Multimodal Coherent Reasoning Across Diverse Visual Domains
  6. 2026TokenSwap: Benchmarking and Reducing the Modality Gap in Multimodal LLMs
  7. 2024Training-Free Mitigation of Language Reasoning Degradation After Multimodal Instruction Tuning
  8. 2025Revisiting the Data Sampling in Multimodal Post-training from a Difficulty-Distinguish View