See Tomorrow, Act Today: Foresight-Driven Autonomous Driving
On the map: World models → World models for autonomous driving
also in 1 more
Abstract (arXiv)
Current end-to-end autonomous driving planners are fundamentally reactive: they condition on historical and present observations to predict future actions. We argue that autonomous agents should instead imagine future scenes before deciding, just as human drivers mentally simulate ``what will happen next" before acting. We introduce ForeSight, a foundation world model centric planning framework that reframes autonomous driving as anticipatory decision-making. Rather than treating world models as auxiliary components, ForeSight makes future scene imagination the primary driver of action prediction. Our approach operates in two stages: (1) generating plausible future visual worlds via a pretrained world model, and (2) planning actions conditioned on these imagined futures. This paradigm shift from ``what should I do now?" to ``what will happen, and how should I respond?" enables genuinely anticipatory rather than reactive planning. By grounding decisions in anticipated contexts rather than present observations alone, ForeSight navigates dynamic, interactive scenarios more effectively. Extensive experiments on NAVSIM and nuScenes demonstrate that explicit future imagination significantly outperforms previous state-of-the-art alternatives, validating our foresight-driven approach.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 0 of its 90 references that are in the map. First posted on arXiv 8 May 2026.
Builds on
0 of 90 references.
No references here yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026PlanWAM: Planning-Shaped Future Representations for End-to-End Autonomous Driving
- 2026X-Mind: Efficient Visual Chain-of-Thought via Predictive World Model for End-to-End Driving
- 2025FutureX: Enhance End-to-End Autonomous Driving via Latent Chain-of-Thought World Model
- 2025Future-Aware End-to-End Driving: Bidirectional Modeling of Trajectory Planning and Scene Evolution
- 2026ForeDrive: Foresight-Guided End-to-End Autonomous Driving with a Planning-Relevant Latent World Model
- 2026Learning Vision-Language-Action World Models for Autonomous Driving
- 2026DriveFuture: Future-Aware Latent World Models for Autonomous Driving
- 2026BrainWAM: Action-Space Coordination of Semantic Priors and Predictive Dynamics for Autonomous Driving