Future-Aware End-to-End Driving: Bidirectional Modeling of Trajectory Planning and Scene Evolution
On the map: End-to-end autonomous driving → Generative simulation for driving
Abstract (arXiv)
End-to-end autonomous driving methods aim to directly map raw sensor inputs to future driving actions such as planned trajectories, bypassing traditional modular pipelines. While these approaches have shown promise, they often operate under a one-shot paradigm that relies heavily on the current scene context, potentially underestimating the importance of scene dynamics and their temporal evolution. This limitation restricts the model's ability to make informed and adaptive decisions in complex driving scenarios. We propose a new perspective: the future trajectory of an autonomous vehicle is closely intertwined with the evolving dynamics of its environment, and conversely, the vehicle's own future states can influence how the surrounding scene unfolds. Motivated by this bidirectional relationship, we introduce SeerDrive, a novel end-to-end framework that jointly models future scene evolution and trajectory planning in a closed-loop manner. Our method first predicts future bird's-eye view (BEV) representations to anticipate the dynamics of the surrounding scene, then leverages this foresight to generate future-context-aware trajectories. Two key components enable this: (1) future-aware planning, which injects predicted BEV features into the trajectory planner, and (2) iterative scene modeling and vehicle planning, which refines both future scene prediction and trajectory generation through collaborative optimization. Extensive experiments on the NAVSIM and nuScenes benchmarks show that SeerDrive significantly outperforms existing state-of-the-art methods.
Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). Placed in Generative simulation for driving, one of 9 directions in End-to-end autonomous driving. Builds on 0 of its 58 references that are in the map. First posted on arXiv 13 Oct 2025.
Builds on
0 of 58 references.
No references here yet.
Built on by
Citing papers per year: 2025: 2; 2026: 20.
22 papers.
Sort:
By area:
- 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Modelcited by 104
- 2026Driving on Registerscited by 38
- 2026SGDrive: Scene-to-Goal Hierarchical World Cognition for Autonomous Drivingcited by 34
- 2025Vision-Language-Action Models for Autonomous Driving: Past, Present, and Futurecited by 32
- 2025SpaceDrive: Infusing Spatial Awareness into VLM-based Autonomous Drivingcited by 28
- 2026UniDriveVLA: Unifying Understanding, Perception, and Action Planning for Autonomous Drivingcited by 17
- 2026EponaV2: Driving World Model with Comprehensive Future Reasoningcited by 12
- 2026Metis: A Generalizable and Efficient World-Action Model for Autonomous Driving and Urban Navigationcited by 10
- 2026Uni-World VLA: Interleaved World Modeling and Planning for Autonomous Drivingcited by 9
- 2026nuReasoning: A Reasoning-Centric Dataset and Benchmark for Long-Tail Autonomous Drivingcited by 8
- 2026SafeDrive: Fine-Grained Safety Reasoning for End-to-End Driving in a Sparse Worldcited by 7
- 2026The DAWN of World-Action Interactive Modelscited by 7
10 more
- 2026SimWAM: A Simple World Action Model for End-to-End Autonomous Drivingcited by 5
- 2026Reasoning models do not yet follow their reasoning in autonomous driving: The KITScenes LongTail Datasetcited by 4
- 2026ProDrive: Proactive Planning for Autonomous Driving via Ego-Environment Co-Evolutioncited by 4
- 2026Zero-Shot Cross-City Generalization in End-to-End Autonomous Driving: Self-Supervised versus Supervised Representationscited by 3
- 2026VLGA: Vision-Language-Geometry-Action Models for Autonomous Drivingcited by 3
- 2026IDOL: Inverse-Dynamics-Guided Future Prediction for End-to-End Autonomous Drivingcited by 2
- 2026Causality-Aware End-to-End Autonomous Driving via Ego-Centric Joint Scene Modelingcited by 1
- 2026SUV: Future Scene Understanding as Video Generation for End-to-End Drivingcited by 0
- 2026Data-Driven Risk Fields for Safer End-to-End Autonomous Drivingcited by 0
- 2026FeasibleFlow: One-Step Joint Transport of Configuration Feasibility and Trajectories for End-to-End Drivingcited by 0
- 2026FeasibleFlow: One-Step Joint Transport of Configuration Feasibility and Trajectories for End-to-End Driving20 Sep 2026
- 2026Data-Driven Risk Fields for Safer End-to-End Autonomous Driving9 Sep 2026
- 2026SimWAM: A Simple World Action Model for End-to-End Autonomous Driving7 Aug 2026
- 2026SUV: Future Scene Understanding as Video Generation for End-to-End Driving4 Aug 2026
- 2026Metis: A Generalizable and Efficient World-Action Model for Autonomous Driving and Urban Navigation14 Jun 2026
- 2026VLGA: Vision-Language-Geometry-Action Models for Autonomous Driving10 Jun 2026
- 2026nuReasoning: A Reasoning-Centric Dataset and Benchmark for Long-Tail Autonomous Driving29 May 2026
- 2026IDOL: Inverse-Dynamics-Guided Future Prediction for End-to-End Autonomous Driving29 May 2026
- 2026EponaV2: Driving World Model with Comprehensive Future Reasoning14 May 2026
- 2026Causality-Aware End-to-End Autonomous Driving via Ego-Centric Joint Scene Modeling13 May 2026
- 2026The DAWN of World-Action Interactive Models12 May 2026
- 2026ProDrive: Proactive Planning for Autonomous Driving via Ego-Environment Co-Evolution28 Apr 2026
10 more
- 2026UniDriveVLA: Unifying Understanding, Perception, and Action Planning for Autonomous Driving2 Apr 2026
- 2026Uni-World VLA: Interleaved World Modeling and Planning for Autonomous Driving28 Mar 2026
- 2026Reasoning models do not yet follow their reasoning in autonomous driving: The KITScenes LongTail Dataset24 Mar 2026
- 2026Zero-Shot Cross-City Generalization in End-to-End Autonomous Driving: Self-Supervised versus Supervised Representations12 Mar 2026
- 2026SafeDrive: Fine-Grained Safety Reasoning for End-to-End Driving in a Sparse World21 Feb 2026
- 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Model10 Feb 2026
- 2026SGDrive: Scene-to-Goal Hierarchical World Cognition for Autonomous Driving9 Jan 2026
- 2026Driving on Registers8 Jan 2026
- 2025Vision-Language-Action Models for Autonomous Driving: Past, Present, and Future18 Dec 2025
- 2025SpaceDrive: Infusing Spatial Awareness into VLM-based Autonomous Driving11 Dec 2025
- 2026Driving on Registerscited by 38
- 2026nuReasoning: A Reasoning-Centric Dataset and Benchmark for Long-Tail Autonomous Drivingcited by 8
- 2026SafeDrive: Fine-Grained Safety Reasoning for End-to-End Driving in a Sparse Worldcited by 7
- 2026Zero-Shot Cross-City Generalization in End-to-End Autonomous Driving: Self-Supervised versus Supervised Representationscited by 3
- 2026Causality-Aware End-to-End Autonomous Driving via Ego-Centric Joint Scene Modelingcited by 1
- 2026SUV: Future Scene Understanding as Video Generation for End-to-End Drivingcited by 0
- 2026Data-Driven Risk Fields for Safer End-to-End Autonomous Drivingcited by 0
- 2026FeasibleFlow: One-Step Joint Transport of Configuration Feasibility and Trajectories for End-to-End Drivingcited by 0
- 2026FeasibleFlow: One-Step Joint Transport of Configuration Feasibility and Trajectories for End-to-End Driving20 Sep 2026
- 2026Data-Driven Risk Fields for Safer End-to-End Autonomous Driving9 Sep 2026
- 2026SUV: Future Scene Understanding as Video Generation for End-to-End Driving4 Aug 2026
- 2026nuReasoning: A Reasoning-Centric Dataset and Benchmark for Long-Tail Autonomous Driving29 May 2026
- 2026Causality-Aware End-to-End Autonomous Driving via Ego-Centric Joint Scene Modeling13 May 2026
- 2026Zero-Shot Cross-City Generalization in End-to-End Autonomous Driving: Self-Supervised versus Supervised Representations12 Mar 2026
- 2026SafeDrive: Fine-Grained Safety Reasoning for End-to-End Driving in a Sparse World21 Feb 2026
- 2026Driving on Registers8 Jan 2026
- 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Modelcited by 104
- 2026EponaV2: Driving World Model with Comprehensive Future Reasoningcited by 12
- 2026Metis: A Generalizable and Efficient World-Action Model for Autonomous Driving and Urban Navigationcited by 10
- 2026Uni-World VLA: Interleaved World Modeling and Planning for Autonomous Drivingcited by 9
- 2026The DAWN of World-Action Interactive Modelscited by 7
- 2026SimWAM: A Simple World Action Model for End-to-End Autonomous Drivingcited by 5
- 2026ProDrive: Proactive Planning for Autonomous Driving via Ego-Environment Co-Evolutioncited by 4
- 2026IDOL: Inverse-Dynamics-Guided Future Prediction for End-to-End Autonomous Drivingcited by 2
- 2026SimWAM: A Simple World Action Model for End-to-End Autonomous Driving7 Aug 2026
- 2026Metis: A Generalizable and Efficient World-Action Model for Autonomous Driving and Urban Navigation14 Jun 2026
- 2026IDOL: Inverse-Dynamics-Guided Future Prediction for End-to-End Autonomous Driving29 May 2026
- 2026EponaV2: Driving World Model with Comprehensive Future Reasoning14 May 2026
- 2026The DAWN of World-Action Interactive Models12 May 2026
- 2026ProDrive: Proactive Planning for Autonomous Driving via Ego-Environment Co-Evolution28 Apr 2026
- 2026Uni-World VLA: Interleaved World Modeling and Planning for Autonomous Driving28 Mar 2026
- 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Model10 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2025Echo Planning for Autonomous Driving: From Current Observations to Future Trajectories and Back
- 2026Bridging Scene Generation and Planning: Driving with World Model via Unifying Vision and Motion Representation
- 2025FutureX: Enhance End-to-End Autonomous Driving via Latent Chain-of-Thought World Model
- 2026ReDrive: Shaping Representations with World Modeling for End-to-End Driving
- 2025World4Drive: End-to-End Autonomous Driving via Intention-aware Physical Latent World Model
- 2026OWMDrive: Causality-Aware End-to-End Autonomous Driving via 4D Occupancy World Model
- 2026SparseWorld: Enhancing End-to-End Autonomous Driving via World Models with Sparse Scene Representation
- 2025Bridging Past and Future: End-to-End Autonomous Driving with Historical Prediction and Planning