mlsanityData to 7 Oct 2026

ForeDrive: Foresight-Guided End-to-End Autonomous Driving with a Planning-Relevant Latent World Model

arXiv 2609.26299 ↗First posted 22 Sep 2026cs.CVcited by 0

On the map: World models → World models for autonomous driving

also in 1 more
Abstract (arXiv)

Existing latent world models are typically optimized for future predictability, yet the resulting representations are not necessarily useful for planning in autonomous driving. Predictions are commonly used for pretraining or auxiliary supervision rather than as direct conditioning signals for trajectory generation. We propose ForeDrive, which learns a planning-relevant latent representation and couples it asymmetrically to a Diffusion Transformer (DiT) planner. The planner consumes multi-horizon latent future representations learned with a JEPA-style world model; planning gradients update the shared online encoder, while stop-gradient routing trains the latent predictor with forecasting losses only. Because predicted futures have varying reliability across horizons and BEV trajectories are misaligned with image tokens, we use gated visual fusion, future-status injection, and Trajectory-Adaptive Bias (TAB) to inject future latents as guidance without overriding the current observation. Trained with pure imitation learning and using only the current front-view image as visual input at inference, ForeDrive attains 89.9 PDMS on NAVSIM v1 and 90.0 one-stage EPDMS on NAVSIM v2, without reinforcement learning or an external trajectory scorer.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 1 of its 36 references that are in the map. First posted on arXiv 22 Sep 2026.

Builds on

1 of 36 references.

Closest ancestors · 1

Same direction, newest first

  1. 2026Latent-WAM: Latent World Action Modeling for End-to-End Autonomous Driving25 Mar

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026DriveFuture: Future-Aware Latent World Models for Autonomous Driving
  2. 2026DA-WAM: Decision-Aligned Future Latents for Driving World Models
  3. 2026WALT: Learning World-Model-Aligned Latent Trajectories for Autonomous Driving
  4. 2025World4Drive: End-to-End Autonomous Driving via Intention-aware Physical Latent World Model
  5. 2026ReDrive: Shaping Representations with World Modeling for End-to-End Driving
  6. 2026Bridging Scene Generation and Planning: Driving with World Model via Unifying Vision and Motion Representation
  7. 2025DriveLaW:Unifying Planning and Video Generation in a Latent Driving World
  8. 2026EponaV2: Driving World Model with Comprehensive Future Reasoning