mlsanityData to 14 Oct 2026

Journey Before Destination: On the importance of Visual Faithfulness in Slow Thinking

arXiv 2512.12218 ↗First posted 13 Dec 2025cs.CV cs.CL cs.LGcited by 6

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Reasoning-augmented vision language models (VLMs) generate explicit chains of thought that promise greater capability and transparency but also introduce new failure modes: models may reach correct answers via visually unfaithful intermediate steps, or reason faithfully yet fail on the final prediction. Standard evaluations that only measure final-answer accuracy cannot distinguish these behaviors. We introduce the visual faithfulness of reasoning chains as a distinct evaluation dimension, focusing on whether the perception steps of a reasoning chain are grounded in the image. We propose a training- and reference-free framework that decomposes chains into perception versus reasoning steps and uses off-the-shelf VLM judges for step-level faithfulness, additionally verifying this approach through a human meta-evaluation. Building on this metric, we present a lightweight self-reflection procedure that detects and locally regenerates unfaithful perception steps without any training. Across multiple reasoning-trained VLMs and perception-heavy benchmarks, our method reduces Unfaithful Perception Rate while preserving final-answer accuracy, improving the reliability of multimodal reasoning.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 23 of its 88 references that are in the map. First posted on arXiv 13 Dec 2025.

Builds on

23 of 88 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning10 Apr
  2. 2025SoTA with Less: MCTS-Guided Sample Selection for Data-Efficient Visual Reasoning Self-Improvement10 Apr
  3. 2025OpenVLThinker: Complex Vision-Language Reasoning via Iterative SFT-RL Cycles21 Mar
  4. 2024AtomThink: Multimodal Slow Thinking with Atomic Step Reasoning18 Nov
  5. 2024Improve Vision Language Model Chain-of-thought Reasoning21 Oct

Other references · 18

  1. 2025Qwen2.5-VL Technical Reportcited by 5,587
  2. 2024Qwen2 Technical Reportcited by 2,120
  3. 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,652
  4. 2024Hallucination of Multimodal Large Language Models: A Surveycited by 388
  5. 2025The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexitycited by 302
  6. 2023AMBER: An LLM-free Multi-dimensional Benchmark for MLLMs Hallucination Evaluationcited by 300
  7. 2023Beyond Hallucinations: Enhancing LVLMs through Hallucination-Aware Direct Preference Optimizationcited by 225
  8. 2025Unified Reward Model for Multimodal Understanding and Generationcited by 199
  9. 2024Vision language models are blind: Failing to translate detailed visual features into wordscited by 147
  10. 2023Evaluation and Analysis of Hallucination in Large Vision-Language Modelscited by 99
  11. 2025More Thinking, Less Seeing? Assessing Amplified Hallucination in Multimodal Reasoning Modelscited by 86
  12. 2024VL-Uncertainty: Detecting Hallucination in Large Vision-Language Model via Uncertainty Estimationcited by 73
6 more
  1. 2025A Survey of Multimodal Hallucination Evaluation and Detectioncited by 27
  2. 2024VaLiD: Mitigating the Hallucination of Large Vision Language Models by Visual Layer Fusion Contrastive Decodingcited by 12
  3. 2024DHCP: Detecting Hallucinations by Cross-modal Attention Pattern in Large Vision-Language Modelscited by 11
  4. 2025PAINT: Paying Attention to INformed Tokens to Mitigate Hallucination in Large Vision-Language Modelcited by 8
  5. 2025Mitigating Image Captioning Hallucinations in Vision-Language Modelscited by 7
  6. 2025CutPaste&Find: Efficient Multimodal Hallucination Detector with Visual-aid Knowledge Basecited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025On the Faithfulness of Visual Thinking: Measurement and Enhancement
  2. 2026Reasoning Dynamics and the Limits of Monitoring Modality Reliance in Vision-Language Models
  3. 2025VERIFY: A Benchmark of Visual Explanation and Reasoning for Investigating Multimodal Reasoning Fidelity
  4. 2026Faithful-MR1: Faithful Multimodal Reasoning via Anchoring and Reinforcing Visual Attention
  5. 2026SPD-Faith Bench: Diagnosing and Improving Faithfulness in Chain-of-Thought for Multimodal Large Language Models
  6. 2025CoRGI: Verified Chain-of-Thought Reasoning with Post-hoc Visual Grounding
  7. 2025See, Think, Learn: A Self-Taught Multimodal Reasoner
  8. 2025A Closer Look at Bias and Chain-of-Thought Faithfulness of Large (Vision) Language Models