Vehicle Dynamics Embedded World Models for Autonomous Driving
On the map: World models → World models for autonomous driving
also in 1 more
Abstract (arXiv)
World models have gained significant attention as a promising approach for autonomous driving. By emulating human-like perception and decision-making processes, these models can predict and adapt to dynamic environments. Existing methods typically map high-dimensional observations into compact latent spaces and learn optimal policies within these latent representations. However, prior work usually jointly learns ego-vehicle dynamics and environmental transition dynamics from the image input, leading to inefficiencies and a lack of robustness to variations in vehicle dynamics. To address these issues, we propose the Vehicle Dynamics embedded Dreamer (VDD) method, which decouples the modeling of ego-vehicle dynamics from environmental transition dynamics. This separation allows the world model to generalize effectively across vehicles with diverse parameters. Additionally, we introduce two strategies to further enhance the robustness of the learned policy: Policy Adjustment during Deployment (PAD) and Policy Augmentation during Training (PAT). Comprehensive experiments in simulated environments demonstrate that the proposed model significantly improves both driving performance and robustness to variations in vehicle dynamics, outperforming existing approaches.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 48 of its 62 references that are in the map. First posted on arXiv 2 Dec 2025.
Builds on
48 of 62 references.
Closest ancestors · 13
Same direction, newest first
- 2024CarDreamer: Open-Source Learning Platform for World Model based Autonomous Driving15 May
- 2024World Models for Autonomous Driving: An Initial Survey5 Mar
- 2024Think2Drive: Efficient Reinforcement Learning by Thinking in Latent World Model for Quasi-Realistic Autonomous Driving (in CARLA-v2)26 Feb
- 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Driving29 Nov
- 2023OccWorld: Learning a 3D Occupancy World Model for Autonomous Driving27 Nov
- 2023MUVO: A Multimodal Generative World Model for Autonomous Driving with Geometric Representations20 Nov
- 2023GAIA-1: A Generative World Model for Autonomous Driving29 Sep
- 2022Enhance Sample Efficiency and Robustness of End-to-end Urban Autonomous Driving via Semantic Masked World Model8 Oct
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformers31 Mar
- 2021MetaDrive: Composing Diverse Driving Scenarios for Generalizable Reinforcement Learning26 Sep
- 2021NuPlan: A closed-loop ML-based planning benchmark for autonomous vehicles22 Jun
- 2019Model-free Deep Reinforcement Learning for Urban Autonomous Driving20 Apr
1 more
- 2017CARLA: An Open Urban Driving Simulator10 Nov
Other references · 35
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,635
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
- 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,401
- 2023Mastering Diverse Domains through World Modelscited by 1,193
- 2022Planning-oriented Autonomous Drivingcited by 1,068
- 2020Mastering Atari with Discrete World Modelscited by 990
- 2016Improving Variational Inference with Inverse Autoregressive Flowcited by 636
- 2023End-to-end Autonomous Driving: Challenges and Frontierscited by 485
- 2022Trajectory-guided Control Prediction for End-to-end Autonomous Driving: A Simple yet Strong Baselinecited by 247
- 2023Is Ego Status All You Need for Open-Loop End-to-End Autonomous Driving?cited by 242
23 more
- 2023Parting with Misconceptions about Learning-based Vehicle Motion Planningcited by 238
- 2022Model-Based Imitation Learning for Urban Drivingcited by 149
- 2022SHIFT: A Synthetic Driving Dataset for Continuous Multi-Task Domain Adaptationcited by 146
- 2020Can Autonomous Vehicles Identify, Recover From, and Adapt to Distribution Shifts?cited by 139
- 2021Learning to drive from a world on railscited by 114
- 2020Context-aware Dynamics Model for Generalization in Model-Based Reinforcement Learningcited by 95
- 2023ScenarioNet: Open-Source Platform for Large-Scale Traffic Scenario Simulation and Modelingcited by 60
- 2022Iso-Dream: Isolating and Leveraging Noncontrollable Visual Dynamics in World Modelscited by 53
- 2021Augmented World Models Facilitate Zero-Shot Dynamics Generalization From a Single Offline Environmentcited by 41
- 2022Domain Adaptive Object Detection for Autonomous Driving under Foggy Weathercited by 41
- 2023Efficient Reinforcement Learning for Autonomous Driving with Parameterized Skills and Priorscited by 36
- 2023World Models and Predictive Coding for Cognitive and Developmental Robotics: Frontiers and Challengescited by 35
- 2021Domain Adaptation In Reinforcement Learning Via Latent Unified State Representationcited by 33
- 2023Implicit Occupancy Flow Fields for Perception and Prediction in Self-Drivingcited by 30
- 2024Open-world machine learning: A review and new outlookscited by 27
- 2021EPSILON: An Efficient Planning System for Automated Vehicles in Highly Interactive Environmentscited by 22
- 2024Dreaming of Many Worlds: Learning Contextual World Models Aids Zero-Shot Generalizationcited by 16
- 2023ReSimAD: Zero-Shot 3D Domain Transfer for Autonomous Driving with Source Reconstruction and Target Simulationcited by 13
- 2022Accelerating Reinforcement Learning for Autonomous Driving using Task-Agnostic and Ego-Centric Motion Skillscited by 12
- 2022Sim-to-Real via Sim-to-Seg: End-to-end Off-road Autonomous Driving Without Real Datacited by 9
- 2023Novelty Detection in Reinforcement Learning with World Modelscited by 8
- 2023Model-Based Reinforcement Learning with Isolated Imaginationscited by 4
- 2024LoRD: Adapting Differentiable Driving Policies to Distribution Shiftscited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025A Survey of World Models for Autonomous Driving
- 2026Ego-Dynamics-Augmented World Model for Autonomous Driving with Zero-Shot Cross-Embodiment Adaptation
- 2025Other Vehicle Trajectories Are Also Needed: A Driving World Model Unifies Ego-Other Vehicle Trajectories in Video Latent Space
- 2026Dreamer-SAC: Off-Policy Learning in Latent World Models for Sample-Efficient Autonomous Driving
- 2026FlowAD: Ego-Scene Interactive Modeling for Autonomous Driving
- 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllability
- 2026Long-Horizon Consistent and Interaction-Aware World Models for Multi-Style End-to-End Driving
- 2026From Virtual Environments to Real-World Trials: Emerging Trends in Autonomous Driving