mlsanityData to 7 Oct 2026

SPD-Faith Bench: Diagnosing and Improving Faithfulness in Chain-of-Thought for Multimodal Large Language Models

arXiv 2602.07833 ↗First posted 8 Feb 2026cs.CV cs.AI cs.CLcited by 2

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Chain-of-Thought reasoning is widely used to improve the interpretability of multimodal large language models (MLLMs), yet the faithfulness of the generated reasoning traces remains unclear. Prior work has mainly focused on perceptual hallucinations, leaving reasoning level unfaithfulness underexplored. To isolate faithfulness from linguistic priors, we introduce SPD-Faith Bench, a diagnostic benchmark based on fine-grained image difference reasoning that enforces explicit visual comparison. Evaluations on state-of-the-art MLLMs reveal two systematic failure modes, perceptual blindness and perception-reasoning dissociation. We trace these failures to decaying visual attention and representation shifts in the residual stream. Guided by this analysis, we propose SAGE, a train-free visual evidence-calibrated framework that improves visual routing and aligns reasoning with perception. Our results highlight the importance of explicitly evaluating faithfulness beyond response correctness. Our benchmark and codes are available at https://github.com/Johanson-colab/SPD-Faith-Bench.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 43 of its 76 references that are in the map. First posted on arXiv 8 Feb 2026.

Builds on

43 of 76 references.

Closest ancestors · 10

Same direction, newest first

  1. 2025MM-CoT:A Benchmark for Probing Visual Chain-of-Thought Reasoning in Multimodal Models9 Dec
  2. 2025Faithful-First Reasoning, Planning, and Acting for Multimodal LLMs11 Nov
  3. 2025On the Faithfulness of Visual Thinking: Measurement and Enhancement27 Oct
  4. 2025Skywork R1V: Pioneering Multimodal Reasoning with Chain-of-Thought8 Apr
  5. 2025Grounded Chain-of-Thought for Multimodal Large Language Models17 Mar
  6. 2025Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey16 Mar
  7. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling6 Dec
  8. 2024CoCoT: Contrastive Chain-of-Thought Prompting for Large Multimodal Models with Multiple Image Inputs5 Jan
  9. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct
  10. 2023Multimodal Chain-of-Thought Reasoning in Language Models2 Feb

Other references · 33

  1. 2025Qwen3 Technical Reportcited by 8,195
  2. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  3. 2025Qwen2.5-VL Technical Reportcited by 5,418
  4. 2024GPT-4o System Cardcited by 4,467
  5. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  6. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  7. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
  8. 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,696
  9. 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,061
  10. 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 730
  11. 2023Measuring Faithfulness in Chain-of-Thought Reasoningcited by 668
  12. 2018Object Hallucination in Image Captioningcited by 661
21 more
  1. 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 559
  2. 2024Hallucination of Multimodal Large Language Models: A Surveycited by 380
  3. 2024MM-LLMs: Recent Advances in MultiModal Large Language Modelscited by 277
  4. 2023MultiModal-GPT: A Vision and Language Model for Dialogue with Humanscited by 255
  5. 2025GUI-R1 : A Generalist R1-Style Vision-Language Action Model For GUI Agentscited by 240
  6. 2024Mitigating Hallucinations in Large Vision-Language Models with Instruction Contrastive Decodingcited by 198
  7. 2025MLLMs Know Where to Look: Training-free Perception of Small Visual Details with Multimodal LLMscited by 172
  8. 2025Chain-of-Thought Reasoning In The Wild Is Not Always Faithfulcited by 166
  9. 2018Learning to Describe Differences Between Pairs of Similar Imagescited by 114
  10. 2019Expressing Visual Relationships via Languagecited by 49
  11. 2025Seeing but Not Believing: Probing the Disconnect Between Visual Attention and Answer Correctness in VLMscited by 48
  12. 2019Neural Naturalist: Generating Fine-Grained Image Comparisonscited by 36
  13. 2025A Survey on Mechanistic Interpretability for Multi-Modal Foundation Modelscited by 34
  14. 2025Token Activation Map to Visually Explain Multimodal LLMscited by 30
  15. 2025FaithCoT-Bench: Benchmarking Instance-Level Faithfulness of Chain-of-Thought Reasoningcited by 25
  16. 2024MC-CoT: A Modular Collaborative CoT Framework for Zero-shot Medical-VQA with LLM and MLLM Integrationcited by 21
  17. 2024Making LLMs Better Many-to-Many Speech-to-Text Translators with Curriculum Learningcited by 20
  18. 2025Zoom-Refine: Boosting High-Resolution Multimodal Understanding via Localized Zoom and Self-Refinementcited by 18
  19. 2025Transformer Dynamics: A neuroscientific approach to interpretability of large language modelscited by 11
  20. 2025FRIT: Using Causal Importance to Improve Chain-of-Thought Faithfulnesscited by 9
  21. 2026Generalizable Multimodal Large Language Model Editing via Invariant Trajectory Learningcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Thinking Before Looking: Improving Multimodal LLM Reasoning via Mitigating Visual Hallucination
  2. 2026Seeing Is Believing? A Benchmark for Multimodal Large Language Models on Visual Illusions and Anomalies
  3. 2026MM-OPD: Towards One More Bottleneck Between Perception and Reasoning
  4. 2025Journey Before Destination: On the importance of Visual Faithfulness in Slow Thinking
  5. 2024JourneyBench: A Challenging One-Stop Vision-Language Understanding Benchmark of Generated Images
  6. 2025VERIFY: A Benchmark of Visual Explanation and Reasoning for Investigating Multimodal Reasoning Fidelity
  7. 2026Can MLLMs Reason Beyond Language? VisReason: A Comprehensive Benchmark for Vision-Centric Reasoning
  8. 2025Peek-a-Boo Reasoning: Contrastive Region Masking in MLLMs