mlsanityData to 14 Oct 2026

PlanWAM: Planning-Shaped Future Representations for End-to-End Autonomous Driving

arXiv 2610.11382 ↗First posted 8 Oct 2026cs.RO cs.LGcited by 0

On the map: World models → World models for autonomous driving

also in 1 more
Abstract (arXiv)

World models in end-to-end autonomous driving predict future scene evolution to provide foresight for trajectory planning. Existing methods mainly study how to predict the future and how to use it, but less often ask which future representation is actually most useful for planning. To this end, we propose PlanWAM, a Planning-Shaped World Action Model. The key idea is to let the planning task shape the future-state representation, so that it retains the information most useful for planning. A latent world model then predicts this planning-shaped future latent representation from historical observations and uses it for planning, enabling foresighted planning. Specifically, we first use a Temporal Register Pyramid to compress multi-frame historical information in a recency-aware manner, learning a compact history representation oriented toward future reasoning and planning. We then introduce a privileged future posterior branch that observes ground-truth future frames, and shape its future latent representation with trajectory-planning objectives to obtain a planning-shaped future latent representation. Hindsight-to-Foresight Distillation trains a prior branch that depends only on history to predict this future latent representation. The predicted future latent representation serves as planning context and guides trajectory generation and selection. PlanWAM achieves 93.8 PDMS / 90.9 EPDMS on NAVSIM-v1/v2 navtest and reaches 38.7 HD-Score on closed-loop HUGSIM in a zero-shot setting, demonstrating leading planning performance across both open-loop and closed-loop evaluations. Extensive experiments further demonstrate that planning-shaped future representations provide an effective and deployable form of foresight for world-action models.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 6 of its 40 references that are in the map. First posted on arXiv 8 Oct 2026.

Builds on

6 of 40 references.

Closest ancestors · 4

Same direction, newest first

  1. 2026DriveFuture: Future-Aware Latent World Models for Autonomous Driving10 May
  2. 2026Latent-WAM: Latent World Action Modeling for End-to-End Autonomous Driving25 Mar
  3. 2026Bridging Scene Generation and Planning: Driving with World Model via Unifying Vision and Motion Representation16 Mar
  4. 2021NuPlan: A closed-loop ML-based planning benchmark for autonomous vehicles22 Jun

Other references · 2

  1. 2025Generalized Trajectory Scoring for End-to-end Multimodal Planningcited by 67
  2. 2026Qwen-Drive-1.0: An Initial Step towards a Vision-Language Foundation Model for Autonomous Drivingcited by 9

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026DA-WAM: Decision-Aligned Future Latents for Driving World Models
  2. 2026ForeDrive: Foresight-Guided End-to-End Autonomous Driving with a Planning-Relevant Latent World Model
  3. 2025FutureX: Enhance End-to-End Autonomous Driving via Latent Chain-of-Thought World Model
  4. 2026See Tomorrow, Act Today: Foresight-Driven Autonomous Driving
  5. 2025Bridging Past and Future: End-to-End Autonomous Driving with Historical Prediction and Planning
  6. 2026ReDrive: Shaping Representations with World Modeling for End-to-End Driving
  7. 2025Future-Aware End-to-End Driving: Bidirectional Modeling of Trajectory Planning and Scene Evolution
  8. 2026EponaV2: Driving World Model with Comprehensive Future Reasoning