mlsanityData to 14 Oct 2026

Think, Look, and Revise: Inconsistency-Aware Visual Self-Correction in MLLMs

arXiv 2608.29374 ↗First posted 29 Aug 2026cs.CVcited by 0

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Tool-augmented multimodal reasoning integrates external tools (e.g., object detection, depth estimation) into multimodal large language models (MLLMs) to address perceptual bottlenecks in complex visual tasks. However, existing approaches rarely verify tool outputs, limiting their ability to detect and recover from tool failures. We propose ReVISE, a framework that equips MLLMs with verification and dynamic error recovery for tool-augmented reasoning. ReVISE introduces (1) a curated training dataset that supervises reflective behaviors, enabling models to validate tool-derived evidence, reformulate queries when visual mismatches arise, and fall back to intrinsic grounding when external tools are unreliable; and (2) a reinforcement learning based targeted rewards that encourage internal reflection and penalize spatial misalignment. Experiments on several benchmarks demonstrate consistent improvements over existing methods, highlighting the importance of error detection and correction in tool-augmented multimodal reasoning.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 25 of its 27 references that are in the map. First posted on arXiv 29 Aug 2026.

Builds on

25 of 27 references.

Closest ancestors · 8

Same direction, newest first

  1. 2025CodeDance: A Dynamic Tool-integrated MLLM for Executable Visual Reasoning19 Dec
  2. 2025Thyme: Think Beyond Images15 Aug
  3. 2025GRIT: Teaching MLLMs to Think with Images21 May
  4. 2024LATTE: Learning to Think with Vision Specialists7 Dec
  5. 2024Perception Tokens Enhance Visual Reasoning in Multimodal Language Models4 Dec
  6. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct
  7. 2023ViperGPT: Visual Inference via Python Execution for Reasoning14 Mar
  8. 2022Visual Programming: Compositional visual reasoning without training18 Nov

Other references · 17

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  3. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  4. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  5. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
  6. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
  7. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  8. 2024Depth Anything V2cited by 1,422
  9. 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 914
  10. 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 838
  11. 2024Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMscited by 735
  12. 2024NVILA: Efficient Frontier Visual Language Modelscited by 209
5 more
  1. 2023Teaching CLIP to Count to Tencited by 198
  2. 2018TallyQA: Answering Complex Counting Questionscited by 153
  3. 2024SAT: Dynamic Spatial Aptitude Training for Multimodal Language Modelscited by 114
  4. 2025PyVision: Agentic Vision with Dynamic Toolingcited by 79
  5. 2024MLLM-Tool: A Multimodal Large Language Model For Tool Agent Learningcited by 69

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Reflect to Inform: Boosting Multimodal Reasoning via Information-Gain-Driven Verification
  2. 2025Beyond Seeing: Evaluating Multimodal LLMs on Tool-Enabled Image Perception, Transformation, and Reasoning
  3. 2026Don't Show Pixels, Show Cues: Unlocking Visual Tool Reasoning in Language Models via Perception Programs
  4. 2025VERIFY: A Benchmark of Visual Explanation and Reasoning for Investigating Multimodal Reasoning Fidelity
  5. 2026Improving Visual Reasoning with Iterative Evidence Refinement
  6. 2026Evaluating Self-Correcting Vision Agents Through Quantitative and Qualitative Metrics
  7. 2026LookWise: Knowing When and Where to Look for Fine-Grained Visual Reasoning in Multimodal Large Language Models
  8. 2026Bridging Modality Disconnect in Self-Reflection via Closed-Loop Visually Grounded Verification