mlsanityData to 7 Oct 2026

ViThinker: Active Vision-Language Reasoning via Dynamic Perceptual Querying

arXiv 2602.02873 ↗First posted 2 Feb 2026cs.CVcited by 0

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Chain-of-Thought (CoT) reasoning excels in language models but struggles in vision-language models due to premature visual-to-text conversion that discards continuous information such as geometry and spatial layout. While recent methods enhance CoT through static enumeration or attention-based selection, they remain passive, i.e., processing pre-computed inputs rather than actively seeking task-relevant details. Inspired by human active perception, we introduce ViThinker, a framework that enables vision-language models to autonomously generate decision (query) tokens triggering the synthesis of expert-aligned visual features on demand. ViThinker internalizes vision-expert capabilities during training, performing generative mental simulation during inference without external tool calls. Through a two-stage curriculum: first distilling frozen experts into model parameters, then learning task-driven querying via sparsity penalties, i.e., ViThinker discovers minimal sufficient perception for each reasoning step. Evaluations across vision-centric benchmarks demonstrate consistent improvements, validating that active query generation outperforms passive approaches in both perceptual grounding and reasoning accuracy.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 22 of its 25 references that are in the map. First posted on arXiv 2 Feb 2026.

Builds on

22 of 25 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025Chain-of-Visual-Thought: Teaching VLMs to See and Think Better with Continuous Visual Tokens24 Nov
  2. 2025MINT-CoT: Enabling Interleaved Visual Tokens in Mathematical Chain-of-Thought Reasoning5 Jun
  3. 2024Perception Tokens Enhance Visual Reasoning in Multimodal Language Models4 Dec
  4. 2024Interleaved-Modal Chain-of-Thought29 Nov
  5. 2024Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought Reasoning25 Mar

Other references · 17

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2023Segment Anythingcited by 8,158
  4. 2023Visual Instruction Tuningcited by 7,792
  5. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  6. 2025Qwen2.5-VL Technical Reportcited by 5,418
  7. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  8. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  9. 2016Semantic Understanding of Scenes through the ADE20K Datasetcited by 1,063
  10. 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 893
  11. 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 822
  12. 2024Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMscited by 719
5 more
  1. 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 529
  2. 2024VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Modelscited by 443
  3. 2021Pixel Difference Networks for Efficient Edge Detectioncited by 167
  4. 2018TallyQA: Answering Complex Counting Questionscited by 152
  5. 2024Divide, Conquer and Combine: A Training-Free Framework for High-Resolution Image Perception in Multimodal Large Language Modelscited by 151

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning
  2. 2026The Perceptual Bandwidth Bottleneck in Vision-Language Models: Active Visual Reasoning via Sequential Experimental Design
  3. 2025From Illusion to Intention: Visual Rationale Learning for Vision-Language Reasoning
  4. 2023Measuring and Improving Chain-of-Thought Reasoning in Vision-Language Models
  5. 2026Act2See: Emergent Active Visual Perception for Video Reasoning
  6. 2026Addressing Overthinking in Large Vision-Language Models via Gated Perception-Reasoning Optimization
  7. 2026Foveated Reasoning: Stateful, Action-based Visual Focusing for Vision-Language Models
  8. 2025See, Think, Learn: A Self-Taught Multimodal Reasoner