mlsanityData to 7 Oct 2026

Kinematics-Aware Latent World Models for Data-Efficient Autonomous Driving

arXiv 2603.07264 ↗First posted 7 Mar 2026cs.RO cs.AIcited by 0

On the map: World models → World models for autonomous driving

also in 1 more
Abstract (arXiv)

Data-efficient learning remains a central challenge in autonomous driving due to the high cost and safety risks of large-scale real-world interaction. Although world-model-based reinforcement learning enables policy optimization through latent imagination, existing approaches often lack explicit mechanisms to encode spatial and kinematic structure essential for driving tasks. In this work, we build upon the Recurrent State-Space Model (RSSM) and propose a kinematics-aware latent world model framework for autonomous driving. Vehicle kinematic information is incorporated into the observation encoder to ground latent transitions in physically meaningful motion dynamics, while geometry-aware supervision regularizes the RSSM latent state to capture task-relevant spatial structure beyond pixel reconstruction. The resulting structured latent dynamics improve long-horizon imagination fidelity and stabilize policy optimization. Experiments in a driving simulation benchmark demonstrate consistent gains over both model-free and pixel-based world-model baselines in terms of sample efficiency and driving performance. Ablation studies further verify that the proposed design enhances spatial representation quality within the latent space. These results suggest that integrating kinematic grounding into RSSM-based world models provides a scalable and physically grounded paradigm for autonomous driving policy learning.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 11 of its 15 references that are in the map. First posted on arXiv 7 Mar 2026.

Builds on

11 of 15 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025Raw2Drive: Reinforcement Learning with Aligned World Models for End-to-End Autonomous Driving (in CARLA v2)22 May
  2. 2022Enhance Sample Efficiency and Robustness of End-to-end Urban Autonomous Driving via Semantic Masked World Model8 Oct
  3. 2021MetaDrive: Composing Diverse Driving Scenarios for Generalizable Reinforcement Learning26 Sep

Other references · 8

  1. 2017Proximal Policy Optimization Algorithmscited by 14,441
  2. 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,635
  3. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
  4. 2018Learning Latent Dynamics for Planning from Pixelscited by 1,221
  5. 2018Recurrent World Models Facilitate Policy Evolutioncited by 761
  6. 2024Genie: Generative Interactive Environmentscited by 706
  7. 2025WOD-E2E: Waymo Open Dataset for End-to-End Driving in Challenging Long-tail Scenarioscited by 60
  8. 2024Explainable AI for Safe and Trustworthy Autonomous Driving: A Systematic Reviewcited by 52

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Latent-WAM: Latent World Action Modeling for End-to-End Autonomous Driving
  2. 2026Latent World Models for Automated Driving: A Unified Taxonomy, Evaluation Framework, and Open Challenges
  3. 2026Drive-HWM: Hierarchical World Models for Dynamic-Latent Guided Autonomous Driving
  4. 2026DreamerAD: Efficient Reinforcement Learning via Latent World Model for Autonomous Driving
  5. 2026WALT: Learning World-Model-Aligned Latent Trajectories for Autonomous Driving
  6. 2025WorldRFT: Latent World Model Planning with Reinforcement Fine-Tuning for Autonomous Driving
  7. 2026DriveFuture: Future-Aware Latent World Models for Autonomous Driving
  8. 2025DriveLaW:Unifying Planning and Video Generation in a Latent Driving World