AIM-CoT: Active Information-driven Multimodal Chain-of-Thought for Vision-Language Reasoning
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Interleaved-Modal Chain-of-Thought (I-MCoT) advances vision-language reasoning, such as Visual Question Answering (VQA). This paradigm integrates specially selected visual evidence from the input image into the context of Vision-Language Models (VLMs), enabling them to ground their reasoning logic in these details. Accordingly, the efficacy of an I-MCoT framework relies on identifying what to see (evidence selection) and when to see it (triggering of insertions). However, existing methods fall short in both aspects. First, for selection, they rely on attention signals, which are unreliable -- particularly under severe granularity imbalance between the brief textual query and the informative image. Second, for triggering, they adopt static triggers, which fail to capture the VLMs' dynamic needs for visual evidence. To this end, we propose a novel I-MCoT framework, Active Information-driven Multi-modal Chain-of-Thought (AIM-CoT), which aims to improve both evidence selection and insertion triggering via: (1) Context-enhanced Attention-map Generation (CAG) to mitigate granularity imbalance via textual context enhancement; (2) Active Visual Probing (AVP) to proactively select the most informative evidence via an information foraging process; and (3) Dynamic Attention-shift Trigger (DAT) to precisely activate insertions when VLM's attention shifts from text to visual context. Experiments across three benchmarks and four backbones demonstrate AIM-CoT's consistent superiority. Our code is available at https://anonymous.4open.science/r/AIMCoT.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 5 of its 58 references that are in the map. First posted on arXiv 30 Sep 2025.
Builds on
5 of 58 references.
References · 5
- 2023GPT-4 Technical Reportcited by 18,396
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 927
- 2023Fast Segment Anythingcited by 290
- 2025Incomplete In-context Learningcited by 2
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Beyond Semantic Relevance: Counterfactual Risk Minimization for Robust Retrieval-Augmented Generationcited by 1
- 2026Look on Demand: A Cognitive Scheduling Framework for Visual Evidence Acquisition in Multimodal Reasoningcited by 1
- 2026Model Guides You How to Draw: Adaptive Visual Gating for Unified Multimodal Reasoningcited by 0
- 2026Beyond Visual Similarity: Entity-Aligned Retrieval for Knowledge-Based Visual Question Answeringcited by 0
- 2026Beyond Visual Similarity: Entity-Aligned Retrieval for Knowledge-Based Visual Question Answering19 Aug 2026
- 2026Model Guides You How to Draw: Adaptive Visual Gating for Unified Multimodal Reasoning10 Jul 2026
- 2026Look on Demand: A Cognitive Scheduling Framework for Visual Evidence Acquisition in Multimodal Reasoning27 May 2026
- 2026Beyond Semantic Relevance: Counterfactual Risk Minimization for Robust Retrieval-Augmented Generation2 May 2026
Similar, not cited
Close in wording, no citation either way
- 2024Interleaved-Modal Chain-of-Thought
- 2024M3CoT: A Novel Benchmark for Multi-Domain Multi-step Multi-modal Chain-of-Thought
- 2026TVI-CoT: Text-Visual Interleaved Chain-of-Thought Reasoning for Multimodal Understanding
- 2025From Perception to Reasoning: Deep Thinking Empowers Multimodal Large Language Models
- 2026Let's Think with Images Efficiently! An Interleaved-Modal Chain-of-Thought Reasoning Framework with Dynamic and Precise Visual Thoughts
- 2025Uni-cot: Towards Unified Chain-of-Thought Reasoning Across Text and Vision
- 2025Retrieval-Based Interleaved Visual Chain-of-Thought in Real-World Driving Scenarios
- 2025MM-CoT:A Benchmark for Probing Visual Chain-of-Thought Reasoning in Multimodal Models