ViThinker: Active Vision-Language Reasoning via Dynamic Perceptual Querying
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Chain-of-Thought (CoT) reasoning excels in language models but struggles in vision-language models due to premature visual-to-text conversion that discards continuous information such as geometry and spatial layout. While recent methods enhance CoT through static enumeration or attention-based selection, they remain passive, i.e., processing pre-computed inputs rather than actively seeking task-relevant details. Inspired by human active perception, we introduce ViThinker, a framework that enables vision-language models to autonomously generate decision (query) tokens triggering the synthesis of expert-aligned visual features on demand. ViThinker internalizes vision-expert capabilities during training, performing generative mental simulation during inference without external tool calls. Through a two-stage curriculum: first distilling frozen experts into model parameters, then learning task-driven querying via sparsity penalties, i.e., ViThinker discovers minimal sufficient perception for each reasoning step. Evaluations across vision-centric benchmarks demonstrate consistent improvements, validating that active query generation outperforms passive approaches in both perceptual grounding and reasoning accuracy.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 22 of its 25 references that are in the map. First posted on arXiv 2 Feb 2026.
Builds on
22 of 25 references.
Closest ancestors · 5
Same direction, newest first
- 2025Chain-of-Visual-Thought: Teaching VLMs to See and Think Better with Continuous Visual Tokens24 Nov
- 2025MINT-CoT: Enabling Interleaved Visual Tokens in Mathematical Chain-of-Thought Reasoning5 Jun
- 2024Perception Tokens Enhance Visual Reasoning in Multimodal Language Models4 Dec
- 2024Interleaved-Modal Chain-of-Thought29 Nov
- 2024Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought Reasoning25 Mar
Other references · 17
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2023Segment Anythingcited by 8,158
- 2023Visual Instruction Tuningcited by 7,792
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2016Semantic Understanding of Scenes through the ADE20K Datasetcited by 1,063
- 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 893
- 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 822
- 2024Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMscited by 719
5 more
- 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 529
- 2024VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Modelscited by 443
- 2021Pixel Difference Networks for Efficient Edge Detectioncited by 167
- 2018TallyQA: Answering Complex Counting Questionscited by 152
- 2024Divide, Conquer and Combine: A Training-Free Framework for High-Resolution Image Perception in Multimodal Large Language Modelscited by 151
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning
- 2026The Perceptual Bandwidth Bottleneck in Vision-Language Models: Active Visual Reasoning via Sequential Experimental Design
- 2025From Illusion to Intention: Visual Rationale Learning for Vision-Language Reasoning
- 2023Measuring and Improving Chain-of-Thought Reasoning in Vision-Language Models
- 2026Act2See: Emergent Active Visual Perception for Video Reasoning
- 2026Addressing Overthinking in Large Vision-Language Models via Gated Perception-Reasoning Optimization
- 2026Foveated Reasoning: Stateful, Action-based Visual Focusing for Vision-Language Models
- 2025See, Think, Learn: A Self-Taught Multimodal Reasoner