PLAN-S: Bridging Planning with Latent Style Dynamics for Autonomous Driving World Models
On the map: World models → World models for autonomous driving
also in 1 more
Abstract (arXiv)
Latent world models (LWMs) have strengthened end-to-end autonomous driving by forecasting compact scene dynamics for downstream planning. However, existing LWM-based planners usually generate trajectories directly from entangled latent representations. This compact latent-to-planner pathway lacks explicit modeling of risk, drivability, and diverse style preferences, making driving-style dynamics difficult to supervise, inspect, or modulate before a final trajectory is selected. We propose PLAN-S (PLANning with latent Style dynamics), a planner-facing bridge that addresses this compactness-controllability dilemma by decoding a style-conditioned, four-channel semantic cost map from the latent representation. The cost map is conditioned on ego state and driving style and is consumed up-stream of the planning decision through two host-side interfaces: attention-level fusion for regression planners and reward-level fusion for anchor-score planners. We validate PLAN-S on two architecturally distinct hosts, ResWorld on nuScenes and WoTE on NAVSIM, while keeping the host backbones frozen to isolate the contribution of the proposed bridge. On nuScenes, PLAN-S reduces L2 at every horizon over the baseline, with 0.55 m average L2 and a 42% relative reduction in the 3 s collision rate. On NAVSIM, the rule-cost variant reaches 89.4 Predictive Driver Model Score (PDMS), while the learned cost variant provides complementary gains on baseline-challenging scenes. Ablations show that the cost pathway contributes most directly to safer trajectory selection. Qualitative results further show that PLAN-S can produce diverse cost maps, with spatially consistent variations aligned to different driving styles.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 7 of its 41 references that are in the map. First posted on arXiv 4 Jun 2026.
Builds on
7 of 41 references.
Closest ancestors · 3
Same direction, newest first
- 2024Navigation-Guided Sparse Scene Representation for End-to-End Autonomous Driving26 Sep
- 2024BEVWorld: A Multimodal World Simulator for Autonomous Driving via Scene-Level BEV Latents8 Jul
- 2023GAIA-1: A Generative World Model for Autonomous Driving29 Sep
Other references · 4
- 2024Hydra-MDP: End-to-end Multimodal Planning with Multi-target Hydra-Distillationcited by 244
- 2024DRAMA: An Efficient End-to-end Motion Planner for Autonomous Driving with Mambacited by 87
- 2026Drive My Way: Preference Alignment of Vision-Language-Action Model for Personalized Drivingcited by 4
- 2026Driving Like Yourself: A Benchmark for Closed-Loop Personalized End-to-End Autonomous Drivingcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Map-World: Masked Action planning and Path-Integral World Model for Autonomous Driving
- 2026Latent-WAM: Latent World Action Modeling for End-to-End Autonomous Driving
- 2026GraphWorld: Long-Horizon Planning with World Models for End-to-End Autonomous Driving
- 2026Latent World Models for Automated Driving: A Unified Taxonomy, Evaluation Framework, and Open Challenges
- 2025FutureX: Enhance End-to-End Autonomous Driving via Latent Chain-of-Thought World Model
- 2026DriveFuture: Future-Aware Latent World Models for Autonomous Driving
- 2025WorldRFT: Latent World Model Planning with Reinforcement Fine-Tuning for Autonomous Driving
- 2026Long-Horizon Consistent and Interaction-Aware World Models for Multi-Style End-to-End Driving