Modality Fault Lines: Structural Corruptions Reveal Fragile Omni-Modal Reasoning
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Omni-modal large language models are increasingly evaluated on clean text--vision--audio inputs, where every channel is present, synchronized, and readily interpretable. Such scores are often taken as evidence of robust cross-modal fusion, but clean evaluation cannot tell whether success depends on stable cross-modal structure or on cues sufficient only in intact inputs. To address this gap, we define a modality fault line: a boundary at which model behavior becomes unstable when a modality remains present and human-interpretable, but its internal evidence structure is perturbed. We introduce SCEval (Structure-Corruption Evaluation) a diagnostic evaluation protocol that keeps the question, answer space, and modality channels fixed while applying controlled structural corruptions to text, vision, and audio individually and jointly. Built from 273 human-verified tri-modal examples from Social-IQ, OmniBench, and VALOR, SCEval evaluates 15 proprietary and open-source omni-modal systems. The results show that structural corruption lowers clean accuracy, text--vision damage forms the most stable shared fault line, and multi-modal degradation is non-additive rather than a simple function of the number of corrupted modalities. Clean omni-modal accuracy therefore does not establish that a model will remain reliable when cross-modal evidence becomes structurally unreliable.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 12 of its 38 references that are in the map. First posted on arXiv 29 Aug 2026.
Builds on
12 of 38 references.
Closest ancestors · 1
Same direction, newest first
Other references · 11
- 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,877
- 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 872
- 2026Qwen3.5-Omni Technical Reportcited by 174
- 2025Ola: Pushing the Frontiers of Omni-Modal Language Modelcited by 83
- 2025OmniVinci: Enhancing Architecture and Data for Omni-Modal Understanding LLMcited by 59
- 2024Baichuan-Omni Technical Reportcited by 42
- 2022Benchmarking Robustness of Multimodal Image-Text Models under Distribution Shiftcited by 24
- 2025Seeing Across Views: Benchmarking Spatial Reasoning of Vision-Language Models in Robotic Scenescited by 20
- 2026How Order-Sensitive Are LLMs? OrderProbe for Deterministic Structural Reconstructioncited by 9
- 2026QuantEval: A Benchmark for Financial Quantitative Tasks in Large Language Modelscited by 7
- 2026SPADER: Step-wise Peer Advantage with Diversity-Aware Exploration Rewards for Multi-Answer Question Answeringcited by 6
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Omni-Modal Dissonance Benchmark: Systematically Breaking Modality Consensus to Probe Robustness and Calibrated Abstention
- 2025XModBench: Benchmarking Cross-Modal Capabilities and Consistency in Omni-Language Models
- 2026C3PO: Evaluating Cross-Modal Composition and Counterfactual Performance in Omnimodal Models
- 2026Chain of Modality: From Static Fusion to Dynamic Orchestration in Omni-MLLMs
- 2026Boosting Omni-Modal Language Models: Staged Post-Training with Visually Debiased Evaluation
- 2026Seeing What Should Be Heard: Diagnosing and Repairing Cross-Modal Shortcuts in Omni-Modal LLMs
- 2024OmnixR: Evaluating Omni-modality Language Models on Reasoning across Modalities
- 2024OmniBench: Towards The Future of Universal Omni-Language Models