CogGuide: Human-Like Guidance for Zero-Shot Omni-Modal Reasoning
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Targeting the issues of "shortcuts" and insufficient contextual understanding in complex cross-modal reasoning of multimodal large models, this paper proposes a zero-shot multimodal reasoning component guided by human-like cognitive strategies centered on an "intent sketch". The component comprises a plug-and-play three-module pipeline-Intent Perceiver, Strategy Generator, and Strategy Selector-that explicitly constructs a "understand-plan-select" cognitive process. By generating and filtering "intent sketch" strategies to guide the final reasoning, it requires no parameter fine-tuning and achieves cross-model transfer solely through in-context engineering. Information-theoretic analysis shows that this process can reduce conditional entropy and improve information utilization efficiency, thereby suppressing unintended shortcut reasoning. Experiments on IntentBench, WorldSense, and Daily-Omni validate the method's generality and robust gains; compared with their respective baselines, the complete "three-module" scheme yields consistent improvements across different reasoning engines and pipeline combinations, with gains up to approximately 9.51 percentage points, demonstrating the practical value and portability of the "intent sketch" reasoning component in zero-shot scenarios.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 9 of its 12 references that are in the map. First posted on arXiv 8 Sep 2025.
Builds on
9 of 12 references.
Closest ancestors · 4
Same direction, newest first
- 2025HumanOmniV2: From Understanding to Omni-Modal Reasoning with Context26 Jun
- 2025Machine Mental Imagery: Empower Multimodal Reasoning with Latent Visual Tokens20 Jun
- 2025Can MLLMs Reason in Multimodality? EMMA: An Enhanced MultiModal ReAsoning Benchmark9 Jan
- 2023Multimodal Chain-of-Thought Reasoning in Language Models2 Feb
Other references · 5
- 2024MM-LLMs: Recent Advances in MultiModal Large Language Modelscited by 277
- 2025WorldSense: Evaluating Real-world Omnimodal Understanding for Multimodal LLMscited by 147
- 2025Daily-Omni: Towards Audio-Visual Reasoning with Temporal Alignment across Modalitiescited by 101
- 2025MLLMs are Deeply Affected by Modality Biascited by 38
- 2024Task Preference Optimization: Improving Multimodal Large Language Models with Vision Task Alignmentcited by 29
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Models
- 2023Enhancing Human-like Multi-Modal Reasoning: A New Challenging Dataset and Comprehensive Framework
- 2025Mind with Eyes: from Language Reasoning to Multimodal Reasoning
- 2025MM-IQ: Benchmarking Human-Like Abstraction and Reasoning in Multimodal Models
- 2025ROVER: Benchmarking Reciprocal Cross-Modal Reasoning for Omnimodal Generation
- 2026ThinkOmni: Lifting Textual Reasoning to Omni-modal Scenarios via Guidance Decoding
- 2026OmniGAIA: Towards Native Omni-Modal AI Agents
- 2025Omni-AutoThink: Adaptive Multimodal Reasoning via Reinforcement Learning