Is VLA Reasoning Faithful? Probing Safety of Chain-of-Causation in Autonomous Driving Models
On the map: Vision-language-action models → VLA for autonomous driving
also in 1 more
Abstract (arXiv)
We present the first systematic study of faithfulness in Vision-Language-Action (VLA) driving models, analyzing 300 Alpamayo-R1-10B inferences across 100 diverse PhysicalAI-AV scenarios. Our main finding is that output natural-language rationales with trajectories may be significantly unfaithful: (i) overall reasoning fidelity is only 42.5%, with Chain-of-Causation matching scene reality less than half the time; (ii) 94 missed pedestrians in one-third of pedestrian-relevant scenes; (iii) 97.7% trajectory fragility under mild visual perturbations; and (iv) only 48.3% mean reasoning-action consistency, with 53.3% of inferences exhibiting low consistency, including 37.9% of stop-claimed cases where the model continues instead. We formalize faithfulness information-theoretically, define entity and action fidelity with verification criteria, and outline a four-component safety architecture aligned with these results.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in VLA for autonomous driving, one of 13 directions in Vision-language-action models. Builds on 7 of its 13 references that are in the map. First posted on arXiv 17 May 2026.
Builds on
7 of 13 references.
Closest ancestors · 1
Same direction, newest first
Other references · 6
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
- 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,122
- 2023Measuring Faithfulness in Chain-of-Thought Reasoningcited by 703
- 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 490
- 2017On a Formal Model of Safe and Scalable Self-driving Carscited by 131
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026ReasonBreak: Probing Vulnerabilities in Reasoning-Enabled Vision-Language-Action Models for Autonomous Driving
- 2026Lost in Fog: Sensor Perturbations Expose Reasoning Fragility in Driving VLAs
- 2025A Survey on Vision-Language-Action Models for Autonomous Driving
- 2026Rethinking Language's Role in Efficient VLA for Autonomous Vehicles: Toward Smarter, Trustworthy Driving
- 2026Reasoning-aware Speculative Decoding for Efficient Vision-Language-Action Models in Autonomous Driving
- 2026VLADriveBench: Evaluating CoT-Action Relationship in VLA for Autonomous Driving
- 2025Are VLMs Ready for Autonomous Driving? An Empirical Study from the Reliability, Data, and Metric Perspectives
- 2025Counterfactual VLA: Self-Reflective Vision-Language-Action Model with Adaptive Reasoning