Visual Reasoning Tracer: Object-Level Grounded Reasoning Benchmark
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Recent advances in Multimodal Large Language Models (MLLMs) have significantly improved performance on tasks such as visual grounding and visual question answering. However, the reasoning processes of these models remain largely opaque; they typically output only final predictions without revealing the intermediate steps or fine-grained evidence (e.g., pixels, locations) that lead to the result. This contrasts with human intelligence, which naturally operates through a chain of visual reasoning. To address this limitation, we introduce the Visual Reasoning Tracer (VRT) task, which requires models to not only localize the target object but also explicitly predict the intermediate objects that form the reasoning path. To advance research in this area, we contribute: (1) VRT-Bench, a human-annotated benchmark for evaluating visual reasoning; (2) a new metric for assessing the quality of reasoning traces; and (3) VRT-80k, a large-scale dataset for reasoning model training. Our experiments reveal that while existing models often produce the correct final output, they struggle to ground their intermediate reasoning. In contrast, models trained on VRT-80k achieve substantial improvements in tracing the reasoning path.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 32 of its 67 references that are in the map. First posted on arXiv 4 Dec 2025.
Builds on
32 of 67 references.
Closest ancestors · 14
Same direction, newest first
- 2025When Visualizing is the First Step to Reasoning: MIRA, a Benchmark for Visual Chain-of-Thought4 Nov
- 2025Small Drafts, Big Verdict: Information-Intensive Visual Reasoning via Speculation23 Oct
- 2025Beyond Seeing: Evaluating Multimodal LLMs on Tool-Enabled Image Perception, Transformation, and Reasoning14 Oct
- 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontiers30 Jun
- 2025RSVP: Reasoning Segmentation via Visual Prompting and Multi-modal Chain-of-Thought4 Jun
- 2025MMCR: Advancing Visual Language Model in Multimodal Multi-Turn Contextual Reasoning24 Mar
- 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalization13 Mar
- 2025Think Before You Segment: High-Quality Reasoning Segmentation with GPT Chain of Thoughts10 Mar
- 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning10 Mar
- 2025Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcement9 Mar
- 2025MM-Verify: Enhancing Multimodal Reasoning with Chain-of-Thought Verification19 Feb
- 2025Pixel-Level Reasoning Segmentation via Multi-turn Conversations13 Feb
2 more
Other references · 18
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2024OpenAI o1 System Cardcited by 1,244
- 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,089
- 2023Shikra: Unleashing Multimodal LLM's Referential Dialogue Magiccited by 906
- 2023GPT4RoI: Instruction Tuning Large Language Model on Region-of-Interestcited by 302
- 2025Towards Large Reasoning Models: A Survey of Reinforced Reasoning with Large Language Modelscited by 293
- 2025Sa2VA: Marrying SAM2 with MLLM for Dense Grounded Understanding of Images and Videoscited by 159
- 2024Ferret-v2: An Improved Baseline for Referring and Grounding with Large Language Modelscited by 97
6 more
- 2025Traceable Evidence Enhanced Visual Grounded Reasoning: Evaluation and Methodologycited by 69
- 2023Thinking Like an Expert:Multimodal Hypergraph-of-Thought (HoT) Reasoning to boost Foundation Modalscited by 24
- 2025Pixel-SAIL: Single Transformer For Pixel-Grounded Understandingcited by 22
- 2024On The Planning Abilities of OpenAI's o1 Models: Feasibility, Optimality, and Generalizabilitycited by 18
- 2025DenseWorld-1M: Towards Detailed Dense Grounded Caption in the Real Worldcited by 16
- 2024Can GPT-O1 Kill All Bugs? An Evaluation of GPT-Family LLMs on QuixBugscited by 7
Built on by
Citing papers per year: 2026: 11.
11 papers.
- 2026Vision-OPD: Learning to See Fine Details for Multimodal LLMs via On-Policy Self-Distillationcited by 77
- 2026Zooming without Zooming: Region-to-Image Distillation for Fine-Grained Multimodal Perceptioncited by 50
- 2026SAMTok: Representing Any Mask with Two Wordscited by 11
- 2026VISTAQA: Benchmarking Joint Visual Question Answering and Pixel-Level Evidencecited by 4
- 2026Attend to Evidence: Evidence-Anchored Spatial Attention Supervision for Multimodal RLVRcited by 4
- 2026GeoBrowse: A Geolocation Benchmark for Agentic Tool Use with Expert-Annotated Reasoning Tracescited by 3
- 2026Reason Twice: Segmentation via Candidate Discovery and Comparative Reasoningcited by 2
- 2026PerceptionDLM: Parallel Region Perception with Multimodal Diffusion Language Modelscited by 1
- 2026VideoSEG-O3: A Multi-turn Reinforcement Learning Framework for Reasoning Video Object Segmentationcited by 0
- 2026The Low Frequency Trap: Video Language Models Fail at Simple Event Bookkeepingcited by 0
- 2026ReferFlow: Beyond Final-Target Localization for Complex Referring Expressionscited by 0
- 2026ReferFlow: Beyond Final-Target Localization for Complex Referring Expressions14 Oct 2026
- 2026The Low Frequency Trap: Video Language Models Fail at Simple Event Bookkeeping6 Aug 2026
- 2026PerceptionDLM: Parallel Region Perception with Multimodal Diffusion Language Models17 Jun 2026
- 2026Reason Twice: Segmentation via Candidate Discovery and Comparative Reasoning8 Jun 2026
- 2026VideoSEG-O3: A Multi-turn Reinforcement Learning Framework for Reasoning Video Object Segmentation5 Jun 2026
- 2026Attend to Evidence: Evidence-Anchored Spatial Attention Supervision for Multimodal RLVR29 May 2026
- 2026VISTAQA: Benchmarking Joint Visual Question Answering and Pixel-Level Evidence20 May 2026
- 2026Vision-OPD: Learning to See Fine Details for Multimodal LLMs via On-Policy Self-Distillation18 May 2026
- 2026GeoBrowse: A Geolocation Benchmark for Agentic Tool Use with Expert-Annotated Reasoning Traces5 Apr 2026
- 2026Zooming without Zooming: Region-to-Image Distillation for Fine-Grained Multimodal Perception12 Feb 2026
- 2026SAMTok: Representing Any Mask with Two Words22 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2025VERIFY: A Benchmark of Visual Explanation and Reasoning for Investigating Multimodal Reasoning Fidelity
- 2026VRIQ: Benchmarking and Analyzing Visual-Reasoning IQ of VLMs
- 2025VER-Bench: Evaluating MLLMs on Reasoning with Fine-Grained Visual Evidence
- 2025VGR: Visual Grounded Reasoning
- 2025RVTBench: A Benchmark for Visual Reasoning Tasks
- 2026ViSTR-Bench: Can MLLMs Reason from Continuous Visual Cues in Dynamic Scenes?
- 2025VisRes Bench: On Evaluating the Visual Reasoning Capabilities of VLMs
- 2026Can MLLMs Reason Beyond Language? VisReason: A Comprehensive Benchmark for Vision-Centric Reasoning