mlsanityData to 14 Oct 2026

Test-time Scaling over Perception: Resolving the Grounding Paradox in Thinking with Images

arXiv 2604.11025 ↗First posted 13 Apr 2026cs.CVcited by 1

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Recent multimodal large language models (MLLMs) support Thinking with Images, invoking visual tools such as zooming and cropping to inspect image regions during inference. Yet these systems remain brittle in fine-grained reasoning: to acquire a decisive detail, a model must ground its attention on the correct region, but knowing which region is correct presupposes having already observed that detail. We identify this circular dependency as the grounding paradox, show that grounding errors are rarely self-corrected within a single trajectory---once a misleading region is inspected, all subsequent reasoning conditions on that observation and the error propagates to the final answer---and observe that because each trajectory constructs its own evidence, answer-level aggregation discards the very information that distinguishes trajectories. We propose Test-Time Scaling over Perception (TTSP), a closed-loop framework that treats perception as the unit of scalable inference and allocates compute along two axes: Entropy-Gated Perceptual Exploration samples diverse trajectories and uses critical-token entropy to withhold evidence the model cannot commit to, while Evidence-Guided Iterative Refinement distills validated observations into a correctable Evidence Ledger that steers later rounds to re-inspect unresolved regions. Across high-resolution and general multimodal benchmarks, TTSP consistently outperforms strong test-time scaling baselines, while improving grounding quality with favorable token efficiency.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 41 of its 50 references that are in the map. First posted on arXiv 13 Apr 2026.

Builds on

41 of 50 references.

Closest ancestors · 16

Same direction, newest first

  1. 2026Reliable Thinking with Images13 Feb
  2. 2025Latent Visual Reasoning29 Sep
  3. 2025Thyme: Think Beyond Images15 Aug
  4. 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontiers30 Jun
  5. 2025Multi-Step Visual Reasoning with Visual Tokens Scaling and Verification8 Jun
  6. 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learning21 May
  7. 2025GRIT: Teaching MLLMs to Think with Images21 May
  8. 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
  9. 2025VisuLogic: A Benchmark for Evaluating Visual Reasoning in Multi-modal Large Language Models21 Apr
  10. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling6 Dec
  11. 2024Insight-V: Exploring Long-Chain Visual Reasoning with Multimodal Large Language Models21 Nov
  12. 2024LogicVista: Multimodal LLM Logical Reasoning Benchmark in Visual Contexts6 Jul
4 more
  1. 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Dataset22 Feb
  2. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct
  3. 2023MMBench: Is Your Multi-modal Model an All-around Player?12 Jul
  4. 2022Visual Programming: Compositional visual reasoning without training18 Nov

Other references · 25

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  3. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  4. 2025Qwen3-VL Technical Reportcited by 2,793
  5. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
  6. 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 914
  7. 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 482
  8. 2024MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?cited by 292
  9. 2025A Survey on Test-Time Scaling in Large Language Models: What, How, Where, and How Well?cited by 223
  10. 2025Large Language Model Agent: A Survey on Methodology, Applications and Challengescited by 205
  11. 2025Deep Think with Confidencecited by 205
  12. 2025Scalable Best-of-N Selection for Large Language Models via Self-Certaintycited by 187
13 more
  1. 2024Divide, Conquer and Combine: A Training-Free Framework for High-Resolution Image Perception in Multimodal Large Language Modelscited by 161
  2. 2025Reinforcing Spatial Reasoning in Vision-Language Models with Interwoven Thinking and Visual Drawingcited by 136
  3. 2025Mini-o3: Scaling Up Reasoning Patterns and Interaction Turns for Visual Searchcited by 120
  4. 2023Let's Sample Step by Step: Adaptive-Consistency for Efficient Reasoning and Coding with LLMscited by 115
  5. 2025Confidence Improves Self-Consistency in LLMscited by 113
  6. 2024Escape Sky-high Cost: Early-stopping Self-Consistency for Multi-step Reasoningcited by 108
  7. 2025Rank1: Test-Time Compute for Reranking in Information Retrievalcited by 70
  8. 2025Traceable Evidence Enhanced Visual Grounded Reasoning: Evaluation and Methodologycited by 69
  9. 2025Learning Adaptive Parallel Reasoning with Language Modelscited by 58
  10. 2026Zooming without Zooming: Region-to-Image Distillation for Fine-Grained Multimodal Perceptioncited by 50
  11. 2025MUR: Momentum Uncertainty guided Reasoning for Large Language Modelscited by 17
  12. 2026Test-time Recursive Thinking: Self-Improvement without External Feedbackcited by 7
  13. 2026MedVR: Annotation-Free Medical Visual Reasoning via Agentic Reinforcement Learningcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Think with Structured Grounding: Perceptual Reinforcement Learning for Chart and Visual-Tabular Understanding
  2. 2026Step-Level Visual Grounding Faithfulness Predicts Out-of-Distribution Generalization in Long-Horizon Vision-Language Models
  3. 2026Vision-Default, Prior-Override: Causal Mechanisms of Perception-Knowledge Conflict in Vision-Language Models
  4. 2026MM-OPD: Towards One More Bottleneck Between Perception and Reasoning
  5. 2026The Perceptual Bandwidth Bottleneck in Vision-Language Models: Active Visual Reasoning via Sequential Experimental Design
  6. 2026Mixture-of-Thought-Tokens: Unifying Perception and Reasoning for Free-form Multimodal Grounding
  7. 2025Journey Before Destination: On the importance of Visual Faithfulness in Slow Thinking
  8. 2026Mind What Matters for Reasoning: Aligning Cross-Modal Attention via Selective Probability Mass Concentration