Echo Planning for Autonomous Driving: From Current Observations to Future Trajectories and Back
On the map: End-to-end autonomous driving → Generative simulation for driving
Abstract (arXiv)
Modern end-to-end autonomous driving systems suffer from a critical limitation: their planners lack mechanisms to enforce temporal consistency between predicted trajectories and evolving scene dynamics. This absence of self-supervision allows early prediction errors to compound catastrophically over time. We introduce Echo Planning (EchoP), a new self-correcting framework that establishes an end-to-end Current - Future - Current (CFC) cycle to harmonize trajectory prediction with scene coherence. Our key insight is that plausible future trajectories should be bi-directionally consistent, i.e., not only generated from current observations but also capable of reconstructing them. The CFC mechanism first predicts future trajectories from the Bird's-Eye-View (BEV) scene representation, then inversely maps these trajectories back to estimate the current BEV state. By enforcing consistency between the original and reconstructed BEV representations through a cycle loss, the framework intrinsically penalizes physically implausible or misaligned trajectories. Experiments on nuScenes show that the proposed method yields competitive performance, reducing L2 error (Avg) by -0.04 m and collision rate by -0.12% compared to one-shot planners. Moreover, EchoP seamlessly extends to closed-loop evaluation, i.e., Bench2Drive, attaining a 26.54% success rate. Notably, EchoP requires no additional supervision: the CFC cycle acts as an inductive bias that stabilizes long-horizon planning. Overall, EchoP offers a simple, deployable pathway to improve reliability in safety-critical autonomous driving.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Generative simulation for driving, one of 9 directions in End-to-end autonomous driving. Builds on 59 of its 73 references that are in the map. First posted on arXiv 25 May 2025.
Builds on
59 of 73 references.
Closest ancestors · 4
Same direction, newest first
- 2025Bridging Past and Future: End-to-End Autonomous Driving with Historical Prediction and Planning18 Mar
- 2025A Survey of World Models for Autonomous Driving20 Jan
- 2024GraphAD: Interaction Scene Graph for End-to-end Autonomous Driving28 Mar
- 2024GenAD: Generative End-to-End Autonomous Driving18 Feb
Other references · 55
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2017Squeeze-and-Excitation Networkscited by 4,789
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2022Planning-oriented Autonomous Drivingcited by 1,087
- 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,044
- 2016End to End Learning for Self-Driving Carscited by 1,009
- 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 850
- 20173D Semantic Segmentation with Submanifold Sparse Convolutional Networkscited by 748
- 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 713
- 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 622
- 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 572
38 more
- 2017End-to-end Driving via Conditional Imitation Learningcited by 485
- 2021Multi-Modal Fusion Transformer for End-to-End Autonomous Drivingcited by 377
- 2022ST-P3: End-to-end Vision-based Autonomous Driving via Spatial-Temporal Feature Learningcited by 368
- 2019Exploring the Limitations of Behavior Cloning for Autonomous Drivingcited by 346
- 2024DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Drivingcited by 334
- 2023Exploring Object-Centric Temporal Modeling for Efficient Multi-View 3D Object Detectioncited by 315
- 2022MapTR: Structured Modeling and Learning for Online Vectorized HD Map Constructioncited by 314
- 2024VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planningcited by 289
- 2024Bench2Drive: Towards Multi-Ability Benchmarking of Closed-Loop End-To-End Autonomous Drivingcited by 252
- 2022Trajectory-guided Control Prediction for End-to-end Autonomous Driving: A Simple yet Strong Baselinecited by 248
- 2021Voxel Transformer for 3D Object Detectioncited by 247
- 2021End-to-end Interpretable Neural Motion Plannercited by 242
- 2023Parting with Misconceptions about Learning-based Vehicle Motion Planningcited by 242
- 2023Is Ego Status All You Need for Open-Loop End-to-End Autonomous Driving?cited by 242
- 2024SparseDrive: End-to-End Autonomous Driving via Sparse Scene Representationcited by 241
- 2021FIERY: Future Instance Prediction in Bird's-Eye View from Surround Monocular Camerascited by 239
- 2023VoxelNeXt: Fully Sparse VoxelNet for 3D Object Detection and Trackingcited by 222
- 2023Scene as Occupancycited by 209
- 2022BEVerse: Unified Perception and Prediction in Birds-Eye-View for Vision-Centric Autonomous Drivingcited by 191
- 2023Rethinking the Open-Loop Evaluation of End-to-End Autonomous Driving in nuScenescited by 191
- 2023Think Twice before Driving: Towards Scalable Decoders for End-to-End Autonomous Drivingcited by 169
- 2024Enhancing End-to-End Autonomous Driving with Latent World Modelcited by 166
- 2023ReasonNet: End-to-End Driving with Temporal and Global Reasoningcited by 93
- 2024DRAMA: An Efficient End-to-end Motion Planner for Autonomous Driving with Mambacited by 87
- 2022Differentiable Raycasting for Self-supervised Occupancy Forecastingcited by 84
- 2025Don't Shake the Wheel: Momentum-Aware Planning in End-to-End Autonomous Drivingcited by 84
- 2022Efficient and Robust 2D-to-BEV Representation Learning via Geometry-guided Kernel Transformercited by 80
- 2023FusionAD: Multi-modality Fusion for Prediction and Planning Tasks of Autonomous Drivingcited by 67
- 2023Lane Graph as Path: Continuity-preserving Path-wise Modeling for Online Lane Graph Constructioncited by 50
- 2024SparseAD: Sparse Query-Centric Paradigm for Efficient End-to-End Autonomous Drivingcited by 47
- 2024Navigation-Guided Sparse Scene Representation for End-to-End Autonomous Drivingcited by 46
- 2022Towards Data-and Knowledge-Driven Artificial Intelligence: A Survey on Neuro-Symbolic Computingcited by 35
- 2023PPAD: Iterative Interactions of Prediction and Planning for End-to-end Autonomous Drivingcited by 33
- 2024End-to-End Autonomous Driving without Costly Modularization and 3D Manual Annotationcited by 28
- 2022Vision-based Uneven BEV Representation Learning with Polar Rasterization and Surface Estimationcited by 23
- 2024Video2BEV: Transforming Drone Videos to BEVs for Video-based Geo-localizationcited by 17
- 2024DeepInteraction++: Multi-Modality Interaction for Autonomous Drivingcited by 15
- 2022Jointly Harnessing Prior Structures and Temporal Consistency for Sign Language Video Generationcited by 14
50 most cited of 55 All 55 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.
- 2025Vision-Language-Action Models for Autonomous Driving: Past, Present, and Futurecited by 33
- 2026DLWM: Dual Latent World Models enable Holistic Gaussian-centric Pre-training in Autonomous Drivingcited by 2
- 2026Not All History Helps: Velocity-Aware Selective Memory for Long-Horizon End-to-End Autonomous Drivingcited by 0
- 2026Not All History Helps: Velocity-Aware Selective Memory for Long-Horizon End-to-End Autonomous Driving16 Aug 2026
- 2026DLWM: Dual Latent World Models enable Holistic Gaussian-centric Pre-training in Autonomous Driving1 Apr 2026
- 2025Vision-Language-Action Models for Autonomous Driving: Past, Present, and Future18 Dec 2025
Similar, not cited
Close in wording, no citation either way
- 2025Future-Aware End-to-End Driving: Bidirectional Modeling of Trajectory Planning and Scene Evolution
- 2026IDOL: Inverse-Dynamics-Guided Future Prediction for End-to-End Autonomous Driving
- 2026A Reliable Context-Aware and Temporal Planning Framework for Autonomous Driving
- 2026Planning-Oriented End-to-End Autonomous Driving: Architectures, Evaluation, and Emerging Paradigms
- 2025OccStress: Stress-Testing the 4D Occupancy Forecasting Chain
- 2025DriveLaW:Unifying Planning and Video Generation in a Latent Driving World
- 2026Bridging Scene Generation and Planning: Driving with World Model via Unifying Vision and Motion Representation
- 2026DriveFuture: Future-Aware Latent World Models for Autonomous Driving