Faithful-First Reasoning, Planning, and Acting for Multimodal LLMs
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Multimodal Large Language Models (MLLMs) frequently suffer from unfaithfulness, generating reasoning chains that drift from visual evidence or contradict final predictions. We propose Faithful-First Reasoning, Planning, and Acting (RPA) framework in which FaithEvi provides step-wise and chain-level supervision by evaluating the faithfulness of intermediate reasoning, and FaithAct uses these signals to plan and execute faithfulness-aware actions during inference. Experiments across multiple multimodal reasoning benchmarks show that faithful-first RPA improves perceptual faithfulness by up to 24% over prompt-based and tool-augmented reasoning frameworks, without degrading task accuracy. Our analysis shows that treating faithfulness as a guiding principle perceptually faithful reasoning trajectories and mitigates hallucination behavior. This work thereby establishes a unified framework for both evaluating and enforcing faithfulness in multimodal reasoning. Code is at https://github.com/lijunxian111/Faithful-First-RPA.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 25 of its 57 references that are in the map. First posted on arXiv 11 Nov 2025.
Builds on
25 of 57 references.
Closest ancestors · 5
Same direction, newest first
- 2025Thinking with Visual Abstract: Enhancing Multimodal Reasoning via Visual Abstraction26 May
- 2025VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning10 Apr
- 2025MM-Verify: Enhancing Multimodal Reasoning with Chain-of-Thought Verification19 Feb
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling6 Dec
- 2023Multimodal Chain-of-Thought Reasoning in Language Models2 Feb
Other references · 20
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2024Qwen2 Technical Reportcited by 2,076
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
- 2023Aligning Large Multimodal Models with Factually Augmented RLHFcited by 703
- 2023Measuring Faithfulness in Chain-of-Thought Reasoningcited by 668
- 2023TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answeringcited by 416
- 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Trainingcited by 233
- 2025When More is Less: Understanding Chain-of-Thought Length in LLMscited by 182
- 2025Chain-of-Thought Reasoning In The Wild Is Not Always Faithfulcited by 166
- 2024FaithEval: Can Your Language Model Stay Faithful to Context, Even If "The Moon is Made of Marshmallows"cited by 85
- 2023On Measuring Faithfulness or Self-consistency of Natural Language Explanationscited by 71
- 2025UniCTokens: Boosting Personalized Understanding and Generation via Unified Concept Tokenscited by 55
8 more
- 2024MC-LLaVA: Multi-Concept Personalized Vision-Language Modelcited by 53
- 2025Perceive Anything: Recognize, Explain, Caption, and Segment Anything in Images and Videoscited by 49
- 2023FaithScore: Fine-grained Evaluations of Hallucinations in Large Vision-Language Modelscited by 44
- 2025Walk the Talk? Measuring the Faithfulness of Large Language Model Explanationscited by 44
- 2024Visual Description Grounding Reduces Hallucinations and Boosts Reasoning in LVLMscited by 33
- 2025TACO: Enhancing Multimodal In-context Learning via Task Mapping-Guided Sequence Configurationcited by 23
- 2025Logic Jailbreak: Efficiently Unlocking LLM Safety Restrictions Through Formal Logical Expressioncited by 16
- 2025Logic Unseen: Revealing the Logical Blindspots of Vision-Language Modelscited by 7
Built on by
Citing papers per year: 2025: 2; 2026: 5.
7 papers.
- 2026ChartVerse: Scaling Chart Reasoning via Reliable Programmatic Synthesis from Scratchcited by 8
- 2025Reward Auditor: Inference on Reward Modeling Suitability in Real-World Perturbed Scenarioscited by 7
- 2025S2-MLLM: Boosting Spatial Reasoning Capability of MLLMs for 3D Visual Grounding with Structural Guidancecited by 5
- 2026SPD-Faith Bench: Diagnosing and Improving Faithfulness in Chain-of-Thought for Multimodal Large Language Modelscited by 2
- 2026EditSleuth: A Dataset of Grounded Reasoning Chains for Image-Edit Forensicscited by 1
- 2026NoRA: Evaluating Grounded Reasonableness in Visual First-person Normative Action Reasoningcited by 0
- 2026Devils in Question Relay: Source-Conditioned Relay Steering to Mitigate Hallucinations in Audio-visual Large Language Modelscited by 0
- 2026Devils in Question Relay: Source-Conditioned Relay Steering to Mitigate Hallucinations in Audio-visual Large Language Models29 Sep 2026
- 2026NoRA: Evaluating Grounded Reasonableness in Visual First-person Normative Action Reasoning3 Jun 2026
- 2026EditSleuth: A Dataset of Grounded Reasoning Chains for Image-Edit Forensics9 May 2026
- 2026SPD-Faith Bench: Diagnosing and Improving Faithfulness in Chain-of-Thought for Multimodal Large Language Models8 Feb 2026
- 2026ChartVerse: Scaling Chart Reasoning via Reliable Programmatic Synthesis from Scratch20 Jan 2026
- 2025S2-MLLM: Boosting Spatial Reasoning Capability of MLLMs for 3D Visual Grounding with Structural Guidance1 Dec 2025
- 2025Reward Auditor: Inference on Reward Modeling Suitability in Real-World Perturbed Scenarios30 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2026Faithful-MR1: Faithful Multimodal Reasoning via Anchoring and Reinforcing Visual Attention
- 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Models
- 2025Hidden in Plain Sight: Reasoning in Underspecified and Misspecified Scenarios for Multimodal LLMs
- 2025Journey Before Destination: On the importance of Visual Faithfulness in Slow Thinking
- 2026DLWM: Diverse Latent World Models for Efficient Multimodal Reasoning
- 2026Understanding the Role of Hallucination in Reinforcement Post-Training of Multimodal Reasoning Models
- 2024Thinking Before Looking: Improving Multimodal LLM Reasoning via Mitigating Visual Hallucination
- 2026See It, Say It, Sorted: An Iterative Training-Free Framework for Visually-Grounded Multimodal Reasoning in LVLMs