Look on Demand: A Cognitive Scheduling Framework for Visual Evidence Acquisition in Multimodal Reasoning
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Existing multimodal reasoning approaches predominantly follow two paradigms: converting visual inputs into text prior to reasoning, or performing end-to-end reasoning within a unified vision-language representation space. Despite their empirical progress, both paradigms suffer from fundamental structural limitations. The former relies on static visual-to-text conversion, which tends to compress and lose fine-grained visual details. The latter is prone to linguistic dominance induced by joint optimization and attention mechanisms, leading to systematically weakened faithfulness to visual evidence during reasoning. In this work, we argue that a central challenge is how and when visual evidence is introduced into the reasoning process. Motivated by this insight, we propose CSMR, a multimodal reasoning framework in which a language model controls the reasoning process by deciding when to invoke an independent visual perception module to acquire task-relevant visual evidence. Experiments across multiple multimodal reasoning benchmarks show that CSMR consistently outperforms representative baseline methods in accuracy under a zero-shot setting. Further experimental analysis confirms that these advantages primarily arise from the proposed cognitive scheduling mechanism.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 24 of its 46 references that are in the map. First posted on arXiv 27 May 2026.
Builds on
24 of 46 references.
Closest ancestors · 14
Same direction, newest first
- 2026Analyzing Reasoning Consistency in Large Multimodal Models under Cross-Modal Conflicts7 Jan
- 2025AIM-CoT: Active Information-driven Multimodal Chain-of-Thought for Vision-Language Reasoning30 Sep
- 2025From Perception to Cognition: A Survey of Vision-Language Interactive Reasoning in Multimodal Large Language Models29 Sep
- 2025Look Again, Think Slowly: Enhancing Visual Reflection in Vision-Language Models15 Sep
- 2025Argus: Vision-Centric Reasoning with Grounded Chain-of-Thought29 May
- 2025Qwen Look Again: Guiding Vision-Language Reasoning Models to Re-attention Visual Information29 May
- 2025Unveiling the Compositional Ability Gap in Vision-Language Reasoning Model26 May
- 2024M3CoT: A Novel Benchmark for Multi-Domain Multi-step Multi-modal Chain-of-Thought26 May
- 2024CoCoT: Contrastive Chain-of-Thought Prompting for Large Multimodal Models with Multiple Image Inputs5 Jan
- 2023Compositional Chain-of-Thought Prompting for Large Multimodal Models27 Nov
- 2023Boosting the Power of Small Multimodal Reasoning Models to Match Larger Models with Self-Consistency Training23 Nov
- 2023MM-REACT: Prompting ChatGPT for Multimodal Reasoning and Action20 Mar
2 more
Other references · 10
- 2025Qwen3 Technical Reportcited by 8,820
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2024Qwen2 Technical Reportcited by 2,120
- 2024An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Language Modelscited by 642
- 2025Words or Vision: Do Vision-Language Models Have Blind Faith in Text?cited by 89
- 2025More Thinking, Less Seeing? Assessing Amplified Hallucination in Multimodal Reasoning Modelscited by 86
- 2021OMPQ: Orthogonal Mixed Precision Quantizationcited by 39
- 2024Uncertainty of Thoughts: Uncertainty-Aware Planning Enhances Information Seeking in Large Language Modelscited by 39
- 2024Seeing is Believing: Mitigating Hallucination in Large Vision-Language Models via CLIP-Guided Decodingcited by 8
- 2025Energy-Guided Decoding for Object Hallucination Mitigationcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Mind with Eyes: from Language Reasoning to Multimodal Reasoning
- 2026Mind What Matters for Reasoning: Aligning Cross-Modal Attention via Selective Probability Mass Concentration
- 2026LookWise: Knowing When and Where to Look for Fine-Grained Visual Reasoning in Multimodal Large Language Models
- 2026CAVE: A Structured Credit Assignment Approach for Fragmented Visual Evidence Reasoning
- 2025Beyond Seeing: Evaluating Multimodal LLMs on Tool-Enabled Image Perception, Transformation, and Reasoning
- 2026Reflect to Inform: Boosting Multimodal Reasoning via Information-Gain-Driven Verification
- 2025Revisiting Visual Understanding in Multimodal Reasoning through a Lens of Image Perturbation
- 2026MM-OPD: Towards One More Bottleneck Between Perception and Reasoning