DynVLA: Learning World Dynamics for Action Reasoning in Autonomous Driving
On the map: Vision-language-action models → VLA for autonomous driving
also in 1 more
Abstract (arXiv)
We propose DynVLA, a driving VLA model that introduces a new CoT paradigm termed Dynamics CoT. DynVLA forecasts compact world dynamics before action generation, enabling more informed and physically grounded decision-making. To obtain compact dynamics representations, DynVLA introduces a Dynamics Tokenizer that compresses future evolution into a small set of dynamics tokens. Considering the rich environment dynamics in interaction-intensive driving scenarios, DynVLA decouples ego-centric and environment-centric dynamics, yielding more accurate world dynamics modeling. We then train DynVLA to generate dynamics tokens before actions through SFT and RFT, improving decision quality while maintaining latency-efficient inference. Compared to Textual CoT, which lacks fine-grained spatiotemporal understanding, and Visual CoT, which introduces substantial redundancy due to dense image prediction, Dynamics CoT captures the evolution of the world in a compact, interpretable, and efficient form. Extensive experiments on NAVSIM, Bench2Drive, and a large-scale in-house dataset demonstrate that DynVLA consistently outperforms Textual CoT and Visual CoT methods, validating the effectiveness and practical value of Dynamics CoT. Project Page: https://yaoyao-jpg.github.io/dynvla.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in VLA for autonomous driving, one of 13 directions in Vision-language-action models. Builds on 76 of its 82 references that are in the map. First posted on arXiv 11 Mar 2026.
Builds on
76 of 82 references.
Closest ancestors · 7
Same direction, newest first
- 2025MindDrive: A Vision-Language-Action Model for Autonomous Driving via Online Reinforcement Learning15 Dec
- 2025DriveVLA-W0: World Models Amplify Data Scaling Law in Autonomous Driving14 Oct
- 2025AutoDrive-R2: Incentivizing Reasoning and Self-Reflection Capacity for VLA Model in Autonomous Driving2 Sep
- 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuning16 Jun
- 2025FutureSightDrive: Thinking Visually with Spatio-Temporal CoT for Autonomous Driving23 May
- 2025DriveMoE: Mixture-of-Experts for Vision-Language-Action Model in End-to-End Autonomous Driving22 May
- 2025OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Model30 Mar
Other references · 69
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2017Neural Discrete Representation Learningcited by 4,650
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2022Planning-oriented Autonomous Drivingcited by 1,068
38 more
- 2024Emu3: Next-Token Prediction is All You Needcited by 761
- 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 613
- 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 482
- 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Drivingcited by 477
- 2023DriveGPT4: Interpretable End-to-end Autonomous Driving via Large Language Modelcited by 455
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 440
- 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 386
- 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 381
- 2023GPT-Driver: Learning to Drive with GPTcited by 344
- 2024NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarkingcited by 343
- 2024Robotic Control via Embodied Chain-of-Thought Reasoningcited by 340
- 2024Latent Action Pretraining from Videoscited by 302
- 2023LMDrive: Closed-Loop End-to-End Driving with Large Language Modelscited by 301
- 2024VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planningcited by 287
- 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 279
- 2024Bench2Drive: Towards Multi-Ability Benchmarking of Closed-Loop End-To-End Autonomous Drivingcited by 250
- 2022Trajectory-guided Control Prediction for End-to-end Autonomous Driving: A Simple yet Strong Baselinecited by 247
- 2024Hydra-MDP: End-to-end Multimodal Planning with Multi-target Hydra-Distillationcited by 244
- 2023Rethinking the Open-Loop Evaluation of End-to-End Autonomous Driving in nuScenescited by 191
- 2025ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Drivingcited by 190
- 2025ORION: A Holistic End-to-End Autonomous Driving Framework by Vision-Language Instructed Action Generationcited by 177
- 2025Multimodal Chain-of-Thought Reasoning: A Comprehensive Surveycited by 176
- 2023Think Twice before Driving: Towards Scalable Decoders for End-to-End Autonomous Drivingcited by 168
- 2024Enhancing End-to-End Autonomous Driving with Latent World Modelcited by 161
- 2024Predictive Inverse Dynamics Models are Scalable Learners for Robotic Manipulationcited by 159
- 2025SimLingo: Vision-Only Closed-Loop Autonomous Driving with Language-Action Alignmentcited by 149
- 2025End-to-End Driving with Online Trajectory Evaluation via BEV World Modelcited by 145
- 2023DriveAdapter: Breaking the Coupling Barrier of Perception and Planning in End-to-End Autonomous Drivingcited by 142
- 2025OmniDrive: A Holistic Vision-Language Dataset for Autonomous Driving with Counterfactual Reasoningcited by 142
- 2025Unified Vision-Language-Action Modelcited by 128
- 2025DriveTransformer: Unified Transformer for Scalable End-to-End Autonomous Drivingcited by 125
- 2025GoalFlow: Goal-Driven Flow Matching for Multimodal Trajectories Generation in End-to-End Autonomous Drivingcited by 117
- 2023Learning to Act without Actionscited by 116
- 2025Epona: Autoregressive Diffusion World Model for Autonomous Drivingcited by 115
- 2025OneTwoVLA: A Unified Vision-Language-Action Model with Adaptive Reasoningcited by 105
- 2023Hidden Biases of End-to-End Driving Modelscited by 95
- 2024OpenEMMA: Open-Source Multimodal Model for End-to-End Autonomous Drivingcited by 93
- 2025F1: A Vision-Language-Action Model Bridging Understanding and Generation to Actionscited by 85
50 most cited of 69 All 69 (JSON)
Built on by
Citing papers per year: 2026: 11.
11 papers.
- 2026UniDriveVLA: Unifying Understanding, Perception, and Action Planning for Autonomous Drivingcited by 17
- 2026Xiaomi OneVL: One-Step Latent Reasoning and Planning with Vision-Language Explanationcited by 9
- 2026CRAFT: Counterfactual-to-Interactive Reinforcement Fine-Tuning for Driving Policiescited by 2
- 2026PhiZero: A World Model Built Around Physical Languagecited by 2
- 2026ST-Prune: Training-Free Spatio-Temporal Token Pruning for Vision-Language Models in Autonomous Drivingcited by 1
- 2026BrainWAM: Action-Space Coordination of Semantic Priors and Predictive Dynamics for Autonomous Drivingcited by 1
- 2026SPVC: Structured and Panoptic Video Fixing for Cross-Dataset Driving Scene Renderingcited by 0
- 2026Geo-VLA: Geometry-Aware Vision-Language-Action Planning via Internalization of Map Semanticscited by 0
- 2026Beyond Textual Chain-of-Thought: A Survey on Action-Grounded Reasoning in Autonomous Drivingcited by 0
- 2026Towards Zero-Shot Transfer Across Embodiments For Driving VLAscited by 0
- 2026FocusDrive: Reasoning with Visual Focus for Autonomous Drivingcited by 0
- 2026FocusDrive: Reasoning with Visual Focus for Autonomous Driving27 Sep 2026
- 2026Towards Zero-Shot Transfer Across Embodiments For Driving VLAs2 Sep 2026
- 2026Beyond Textual Chain-of-Thought: A Survey on Action-Grounded Reasoning in Autonomous Driving31 Aug 2026
- 2026Geo-VLA: Geometry-Aware Vision-Language-Action Planning via Internalization of Map Semantics18 Aug 2026
- 2026SPVC: Structured and Panoptic Video Fixing for Cross-Dataset Driving Scene Rendering18 Aug 2026
- 2026BrainWAM: Action-Space Coordination of Semantic Priors and Predictive Dynamics for Autonomous Driving13 Aug 2026
- 2026PhiZero: A World Model Built Around Physical Language30 Jul 2026
- 2026CRAFT: Counterfactual-to-Interactive Reinforcement Fine-Tuning for Driving Policies6 May 2026
- 2026ST-Prune: Training-Free Spatio-Temporal Token Pruning for Vision-Language Models in Autonomous Driving21 Apr 2026
- 2026Xiaomi OneVL: One-Step Latent Reasoning and Planning with Vision-Language Explanation20 Apr 2026
- 2026UniDriveVLA: Unifying Understanding, Perception, and Action Planning for Autonomous Driving2 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026Learning Vision-Language-Action World Models for Autonomous Driving
- 2026CoWorld-VLA: Thinking in a Multi-Expert World Model for Autonomous Driving
- 2026DynFlowDrive: Flow-Based Dynamic World Modeling for Autonomous Driving
- 2025CoT4AD: A Vision-Language-Action Model with Explicit Chain-of-Thought Reasoning for Autonomous Driving
- 2026DriveWorld-VLA: Unified Latent-Space World Modeling with Vision-Language-Action for Autonomous Driving
- 2026ExploreVLA: Dense World Modeling and Exploration for End-to-End Autonomous Driving
- 2026Uni-World VLA: Interleaved World Modeling and Planning for Autonomous Driving
- 2026WorldVLM: Combining World Model Forecasting and Vision-Language Reasoning