Deferred Exposure of Future Trajectories for Verifiable Reasoning in Autonomous Driving VLMs
On the map: LLM reasoning → Chain-of-thought reasoning for driving
also in 3 more
Abstract (arXiv)
Recent Vision-Language-Action (VLA) models for autonomous driving (AD) increasingly utilize chain-of-thought (CoT) supervision to enhance the reasoning capabilities of their Vision-Language Model (VLM) components, yet existing annotation pipelines commonly expose the teacher model to the logged ground-truth (GT) future trajectory. We empirically show that this induces trajectory anchoring bias: teacher models rationalize the revealed outcome rather than infer a decision from scene evidence, producing less causally faithful CoTs and substantially more severe hallucinations, especially in causally challenging scenes. Removing the GT trajectory eliminates this shortcut, but open-ended trajectory generation entangles high-level decision-making with precise geometric synthesis and low-level dynamics. To make trajectory-level driving decisions verifiable without requiring open-ended trajectory synthesis, we introduce Autonomous-Driving Multiple-Choice Question (AD-MCQ), which casts planning as selection among explicit trajectory candidates. Taking this a step further, we propose Deferred Exposure of Future Trajectories for RLVR (DEFT-RLVR) to transform future trajectories from pre-decision anchors into post-decision verification targets. Experimental results show that DEFT-RLVR improves AD reasoning while preserving or even enhancing general visual capabilities. With VLM-only inference and controllable difficulty through candidate construction, AD-MCQ provides a flexible, scalable, and extensible foundation for future research on verifiable AD reasoning.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Chain-of-thought reasoning for driving, one of 17 directions in LLM reasoning. Builds on 51 of its 88 references that are in the map. First posted on arXiv 3 Aug 2026.
Builds on
51 of 88 references.
Closest ancestors · 5
Same direction, newest first
- 2026Accelerating Structured Chain-of-Thought in Autonomous Vehicles2 Feb
- 2025NuScenes-SpatialQA: A Spatial Understanding and Reasoning Benchmark for Vision-Language Models in Autonomous Driving4 Apr
- 2024WiseAD: Knowledge Augmented End-to-End Autonomous Driving with Vision-Language Model13 Dec
- 2024WOMD-Reasoning: A Large-Scale Dataset for Interaction Reasoning in Driving5 Jul
- 2024DriveCoT: Integrating Chain-of-Thought Reasoning with End-to-End Driving25 Mar
Other references · 46
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3 Technical Reportcited by 8,820
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 665
- 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 490
- 2024VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Modelscited by 455
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 451
- 2025Reasoning Models Don't Always Say What They Thinkcited by 415
- 2025Rubrics as Rewards: Reinforcement Learning Beyond Verifiable Domainscited by 366
- 2023GPT-Driver: Learning to Drive with GPTcited by 347
34 more
- 2024DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Drivingcited by 334
- 2025LIBERO-Plus: In-depth Robustness Analysis of Vision-Language-Action Modelscited by 303
- 2024SparseDrive: End-to-End Autonomous Driving via Sparse Scene Representationcited by 241
- 2023DriveMLM: Aligning Multi-Modal Large Language Models with Behavioral Planning States for Autonomous Drivingcited by 233
- 2024EMMA: End-to-End Multimodal Model for Autonomous Drivingcited by 231
- 2025MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligencecited by 183
- 2025LIBERO-PRO: Towards Robust and Fair Evaluation of Vision-Language-Action Models Beyond Memorizationcited by 179
- 2025OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Modelcited by 176
- 2025Chain-of-Thought Reasoning In The Wild Is Not Always Faithfulcited by 170
- 2024Senna: Bridging Large Vision-Language Models and End-to-End Autonomous Drivingcited by 156
- 2024RoboSpatial: Teaching Spatial Understanding to 2D and 3D Vision-Language Models for Roboticscited by 136
- 2025ViewSpatial-Bench: Evaluating Multi-perspective Spatial Localization in Vision-Language Modelscited by 118
- 2025SRFT: A Single-Stage Method with Supervised and Reinforcement Fine-Tuning for Reasoningcited by 84
- 2025Gemini Robotics: Bringing AI into the Physical Worldcited by 83
- 2023Trajeglish: Traffic Modeling as Next-Token Predictioncited by 60
- 2025Online Rubrics Elicitation from Pairwise Comparisonscited by 46
- 2024Gen-Drive: Enhancing Diffusion Generative Driving Policies with Reward Modeling and Reinforcement Learning Fine-tuningcited by 42
- 2025Answer Matching Outperforms Multiple Choice for Language Model Evaluationcited by 41
- 2024Closed-Loop Supervised Fine-Tuning of Tokenized Traffic Modelscited by 40
- 2025NuPlanQA: A Large-Scale Dataset and Benchmark for Multi-View Driving Scene Understanding in Multi-Modal Large Language Modelscited by 30
- 2026Autorubric: A Unifying Framework for Rubric-Based LLM Evaluation on Non-Verifiable Taskscited by 26
- 2025Discrete Diffusion for Reflective Vision-Language-Action Models in Autonomous Drivingcited by 24
- 2026Thinking with Blueprints: Assisting Vision-Language Models in Spatial Reasoning via Structured Object Representationcited by 21
- 2024Separate the Wheat from the Chaff: A Post-Hoc Approach to Safety Re-Alignment for Fine-Tuned Language Modelscited by 20
- 2026Does Your Reasoning Model Implicitly Know When to Stop Thinking?cited by 19
- 2025Adaptive Batch-Wise Sample Scheduling for Direct Preference Optimizationcited by 17
- 2026Heterogeneous Agent Collaborative Reinforcement Learningcited by 15
- 2026Automated Optimization Modeling via a Localizable Error-Driven Perspectivecited by 14
- 2025Probing Perceptual Constancy in Large Vision-Language Modelscited by 7
- 2025Evidence-Grounded Trustworthy Multimodal Reasoning and Evaluation Benchmark in Complex Urban Scenescited by 7
- 2025StyleTailor: Towards Personalized Fashion Styling via Hierarchical Negative Feedbackcited by 5
- 2026STAR-S: Improving Safety Alignment through Self-Taught Reasoning on Safety Rulescited by 3
- 2026VULCA-Bench: A Multicultural Vision-Language Benchmark for Evaluating Cultural Understandingcited by 3
- 2026ToolAnchor: Anchoring Counterfactual Context to Boost Agentic Tool-use Capabilitycited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026SquidAgent: Parallelize Wisely, Coordinate Efficientlycited by 0
- 2026SquidAgent: Parallelize Wisely, Coordinate Efficiently6 Oct 2026
Similar, not cited
Close in wording, no citation either way
- 2025Drive-R1: Bridging Reasoning and Planning in VLMs for Autonomous Driving with Reinforcement Learning
- 2026Drive the Thoughts: Runtime Monitoring of VLA Reasoning-Trajectory Consistency
- 2025CoT4AD: A Vision-Language-Action Model with Explicit Chain-of-Thought Reasoning for Autonomous Driving
- 2026LaST-VLA: Thinking in Latent Spatio-Temporal Space for Vision-Language-Action in Autonomous Driving
- 2026AnchorVLA: Bridging Discrete Decisions and Continuous Trajectories for Vision-Language-Action Planning
- 2026AnchorReasoning: A Visual Grounding and Causal Reasoning Dataset in Long-Tail Autonomous Driving Scenarios
- 2026Xiaomi OneVL: One-Step Latent Reasoning and Planning with Vision-Language Explanation
- 2025ColaVLA: Leveraging Cognitive Latent Reasoning for Hierarchical Parallel Trajectory Planning in Autonomous Driving