Do Vision-Language-Action Models Mean What They Say? On the Role of Faithfulness in Embodied Reasoning
On the map: LLM reasoning → Spatial and embodied reasoning
also in 1 more
Abstract (arXiv)
Embodied Chain-of-Thought has emerged as a promising mechanism to enhance robot decision-making and interpretability in black-box Vision-Language Action (VLA) models. However, whether this verbalized Chain-of-Thought truthfully reflects the policy's underlying decision process remains poorly understood. We distinguish between functional reasoning, in which reasoning improves task performance, and faithful reasoning, in which reasoning truly reflects the policy's internal decision process. We argue that SoTA alignment strategies offer a necessary but insufficient notion of faithfulness, admitting reasoning whose intermediate steps can mask the causal links in action prediction through confounding factors (e.g., reasoning that is ungrounded in the environment and internally disconnected or inconsistent), restricting policy generalization. We study this gap through a human evaluation of a SoTA reasoning model for autonomous driving, revealing an inconsistent coupling between reasoning quality and downstream trajectory improvement. We then operationalize a behavioral surrogate for embodied faithfulness through a learned critic, Pinocchio, scoring observation grounding and stepwise coherence, and use this critic as a dense reward signal in post-training an embodied policy with reinforcement learning. Across withheld driving benchmarks, our post-trained planner improves faithfulness by 4% and 18% over SoTA alignment and trajectory error post-training baselines, respectively, while maintaining competitive downstream task performance. Finally, on a synthetic out-of-distribution test set, post-training for faithfulness improves policy responsiveness to rare counterfactual scenarios by 1.6x that of a SoTA policy, suggesting that faithful reasoning traces contribute to more robust, generalizable, and interpretable embodied intelligence. Project page: https://mjf-su.github.io/pinocchio/
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 36 of its 41 references that are in the map. First posted on arXiv 6 Jul 2026.
Builds on
36 of 41 references.
Closest ancestors · 5
Same direction, newest first
- 2026Self-Supervised Bootstrapping of Action-Predictive Embodied Reasoning9 Feb
- 2025Mind to Hand: Purposeful Robotic Control via Embodied Reasoning9 Dec
- 2025Do What You Say: Steering Vision-Language-Action Models via Runtime Reasoning-Action Alignment Verification18 Oct
- 2025Training Strategies for Efficient Embodied Reasoning13 May
- 2024Robotic Control via Embodied Chain-of-Thought Reasoning11 Jul
Other references · 31
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,122
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
- 2023Measuring Faithfulness in Chain-of-Thought Reasoningcited by 703
19 more
- 2025Open-Reasoner-Zero: An Open Source Approach to Scaling Up Reinforcement Learning on the Base Modelcited by 461
- 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuningcited by 260
- 2024EMMA: End-to-End Multimodal Model for Autonomous Drivingcited by 231
- 2025OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Modelcited by 176
- 2025Chain-of-Thought Reasoning In The Wild Is Not Always Faithfulcited by 170
- 2025SimLingo: Vision-Only Closed-Loop Autonomous Driving with Language-Action Alignmentcited by 150
- 2025Alpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long Tailcited by 146
- 2024Making Reasoning Matter: Measuring and Improving Faithfulness of Chain-of-Thought Reasoningcited by 110
- 2025AlphaDrive: Unleashing the Power of VLMs in Autonomous Driving via Reinforcement Learning and Reasoningcited by 108
- 2025RLPR: Extrapolating RLVR to General Domains without Verifierscited by 85
- 2025WOD-E2E: Waymo Open Dataset for End-to-End Driving in Challenging Long-tail Scenarioscited by 62
- 2025AdaThinkDrive: Adaptive Thinking via Reinforcement Learning for Autonomous Drivingcited by 58
- 2025Walk the Talk? Measuring the Faithfulness of Large Language Model Explanationscited by 45
- 2025Drive-R1: Bridging Reasoning and Planning in VLMs for Autonomous Driving with Reinforcement Learningcited by 38
- 2026The Llama 4 Herd: Architecture, Training, Evaluation, and Deployment Notescited by 30
- 2025Counterfactual VLA: Self-Reflective Vision-Language-Action Model with Adaptive Reasoningcited by 22
- 2025A Causal Lens for Evaluating Faithfulness Metricscited by 12
- 2026SteerVLA: Steering Vision-Language-Action Models in Long-Tail Driving Scenarioscited by 11
- 2025FRIT: Using Causal Importance to Improve Chain-of-Thought Faithfulnesscited by 9
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026When Reasoning Helps Action: Monitoring and Steering Chain-of-Thought in Vision-Language-Action Policies
- 2026Unmasking the Illusion of Embodied Reasoning in Vision-Language-Action Models
- 2026Reasoning as a Double-Edged Sword: Architecture and Cross-Stage Robustness in Vision-Language-Action Models
- 2026Reasoning models do not yet follow their reasoning in autonomous driving: The KITScenes LongTail Dataset
- 2026Revisiting Embodied Chain-of-Thought for Generalizable Robot Manipulation
- 2026Is VLA Reasoning Faithful? Probing Safety of Chain-of-Causation in Autonomous Driving Models
- 2026Capek 0.5: An Execution-Centric Vision-Language Model for Embodied Intelligence
- 2026Planning Takes More Than Token Prediction: Causal Plan for Benchmarking and Building Physically Grounded Embodied Reasoners