mlsanityData to 7 Oct 2026

Faithful-First Reasoning, Planning, and Acting for Multimodal LLMs

arXiv 2511.08409 ↗First posted 11 Nov 2025cs.AIcited by 7

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Multimodal Large Language Models (MLLMs) frequently suffer from unfaithfulness, generating reasoning chains that drift from visual evidence or contradict final predictions. We propose Faithful-First Reasoning, Planning, and Acting (RPA) framework in which FaithEvi provides step-wise and chain-level supervision by evaluating the faithfulness of intermediate reasoning, and FaithAct uses these signals to plan and execute faithfulness-aware actions during inference. Experiments across multiple multimodal reasoning benchmarks show that faithful-first RPA improves perceptual faithfulness by up to 24% over prompt-based and tool-augmented reasoning frameworks, without degrading task accuracy. Our analysis shows that treating faithfulness as a guiding principle perceptually faithful reasoning trajectories and mitigates hallucination behavior. This work thereby establishes a unified framework for both evaluating and enforcing faithfulness in multimodal reasoning. Code is at https://github.com/lijunxian111/Faithful-First-RPA.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 25 of its 57 references that are in the map. First posted on arXiv 11 Nov 2025.

Builds on

25 of 57 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025Thinking with Visual Abstract: Enhancing Multimodal Reasoning via Visual Abstraction26 May
  2. 2025VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning10 Apr
  3. 2025MM-Verify: Enhancing Multimodal Reasoning with Chain-of-Thought Verification19 Feb
  4. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling6 Dec
  5. 2023Multimodal Chain-of-Thought Reasoning in Language Models2 Feb

Other references · 20

  1. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  2. 2024Qwen2 Technical Reportcited by 2,076
  3. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
  4. 2023Aligning Large Multimodal Models with Factually Augmented RLHFcited by 703
  5. 2023Measuring Faithfulness in Chain-of-Thought Reasoningcited by 668
  6. 2023TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answeringcited by 416
  7. 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Trainingcited by 233
  8. 2025When More is Less: Understanding Chain-of-Thought Length in LLMscited by 182
  9. 2025Chain-of-Thought Reasoning In The Wild Is Not Always Faithfulcited by 166
  10. 2024FaithEval: Can Your Language Model Stay Faithful to Context, Even If "The Moon is Made of Marshmallows"cited by 85
  11. 2023On Measuring Faithfulness or Self-consistency of Natural Language Explanationscited by 71
  12. 2025UniCTokens: Boosting Personalized Understanding and Generation via Unified Concept Tokenscited by 55
8 more
  1. 2024MC-LLaVA: Multi-Concept Personalized Vision-Language Modelcited by 53
  2. 2025Perceive Anything: Recognize, Explain, Caption, and Segment Anything in Images and Videoscited by 49
  3. 2023FaithScore: Fine-grained Evaluations of Hallucinations in Large Vision-Language Modelscited by 44
  4. 2025Walk the Talk? Measuring the Faithfulness of Large Language Model Explanationscited by 44
  5. 2024Visual Description Grounding Reduces Hallucinations and Boosts Reasoning in LVLMscited by 33
  6. 2025TACO: Enhancing Multimodal In-context Learning via Task Mapping-Guided Sequence Configurationcited by 23
  7. 2025Logic Jailbreak: Efficiently Unlocking LLM Safety Restrictions Through Formal Logical Expressioncited by 16
  8. 2025Logic Unseen: Revealing the Logical Blindspots of Vision-Language Modelscited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 5.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Faithful-MR1: Faithful Multimodal Reasoning via Anchoring and Reinforcing Visual Attention
  2. 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Models
  3. 2025Hidden in Plain Sight: Reasoning in Underspecified and Misspecified Scenarios for Multimodal LLMs
  4. 2025Journey Before Destination: On the importance of Visual Faithfulness in Slow Thinking
  5. 2026DLWM: Diverse Latent World Models for Efficient Multimodal Reasoning
  6. 2026Understanding the Role of Hallucination in Reinforcement Post-Training of Multimodal Reasoning Models
  7. 2024Thinking Before Looking: Improving Multimodal LLM Reasoning via Mitigating Visual Hallucination
  8. 2026See It, Say It, Sorted: An Iterative Training-Free Framework for Visually-Grounded Multimodal Reasoning in LVLMs