Test-Time Trajectory Optimization for Autonomous Driving
On the map: End-to-end autonomous driving → Imitation-learning end-to-end planners
Abstract (arXiv)
End-to-end planners for autonomous driving typically generate a set of candidate trajectories, score each one, and return the highest-scoring candidate. However, the scorer is applied only after the proposals are generated and cannot influence the set of trajectories: a weak set of candidates limits planning performance regardless of the scorer's quality. We instead treat the scorer as a learned trajectory-level reward function and search for trajectories that maximize it. Our method, TOAD, runs the Cross-Entropy Method at test time, warm-started from the planner's proposals. It requires no retraining and is plug-and-play for existing planners. Across six base planners, TOAD improves results on NAVSIM-v1 (94.7 PDMS), NAVSIM-v2 (56.3 EPDMS), and the closed-loop HUGSIM benchmark. The code will be made publicly available via the project page: https://valeoai.github.io/TOAD/.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Imitation-learning end-to-end planners, one of 9 directions in End-to-end autonomous driving. Builds on 55 of its 62 references that are in the map. First posted on arXiv 5 Jun 2026.
Builds on
55 of 62 references.
Closest ancestors · 11
Same direction, newest first
- 2026Risk-Aware World Model Predictive Control for Generalizable End-to-End Autonomous Driving26 Feb
- 2025GuideFlow: Constraint-Guided Flow Matching for Planning in End-to-End Autonomous Driving24 Nov
- 2025Zero-Human Demonstration End-to-end Autonomous Driving with Trajectory Scorer28 Oct
- 2025RAP: 3D Rasterization Augmented End-to-End Planning5 Oct
- 2025DIVER: Reinforced Diffusion Breaks Imitation Bottlenecks in End-to-End Autonomous Driving5 Jul
- 2025Learning Personalized Driving Styles via Reinforcement Learning from Human Feedback13 Mar
- 2025GoalFlow: Goal-Driven Flow Matching for Multimodal Trajectories Generation in End-to-End Autonomous Driving7 Mar
- 2024DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Driving22 Nov
- 2024VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planning20 Feb
- 2022Differentiable Integrated Motion Prediction and Planning with Learnable Cost Function for Autonomous Driving21 Jul
- 2022KING: Generating Safety-Critical Driving Scenarios for Robust Imitation via Kinematics Gradients28 Apr
Other references · 44
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
- 2022Planning-oriented Autonomous Drivingcited by 1,068
- 2016End to End Learning for Self-Driving Carscited by 1,000
- 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 946
- 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 613
- 2021KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3Dcited by 570
- 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Drivingcited by 477
- 2019A Survey of Autonomous Driving: Common Practices and Emerging Technologiescited by 373
- 2024NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarkingcited by 343
- 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuningcited by 252
32 more
- 2024Hydra-MDP: End-to-end Multimodal Planning with Multi-target Hydra-Distillationcited by 244
- 2021End-to-end Interpretable Neural Motion Plannercited by 240
- 2023Parting with Misconceptions about Learning-based Vehicle Motion Planningcited by 238
- 2025ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Drivingcited by 190
- 2021PandaSet: Advanced Sensor Suite Dataset for Autonomous Drivingcited by 186
- 2024Senna: Bridging Large Vision-Language Models and End-to-End Autonomous Drivingcited by 156
- 2025SimLingo: Vision-Only Closed-Loop Autonomous Driving with Language-Action Alignmentcited by 149
- 2025End-to-End Driving with Online Trajectory Evaluation via BEV World Modelcited by 145
- 2025Pseudo-Simulation for Autonomous Drivingcited by 141
- 2025Unified Vision-Language-Action Modelcited by 128
- 2025DriveVLA-W0: World Models Amplify Data Scaling Law in Autonomous Drivingcited by 127
- 2024DrivingGPT: Unifying Driving World Modeling and Planning with Multi-modal Autoregressive Transformerscited by 96
- 2025Hydra-MDP++: Advancing End-to-End Driving via Expert-Guided Hydra-Distillationcited by 93
- 2025DriveSuprim: Towards Precise Trajectory Selection for End-to-End Planningcited by 91
- 2025World4Drive: End-to-End Autonomous Driving via Intention-aware Physical Latent World Modelcited by 91
- 2020Sample-efficient Cross-Entropy Method for Real-time Planningcited by 90
- 2024DRAMA: An Efficient End-to-end Motion Planner for Autonomous Driving with Mambacited by 87
- 2024HUGSIM: A Real-Time, Photo-Realistic and Closed-Loop Simulator for Autonomous Drivingcited by 84
- 2025DiffVLA: Vision-Language Guided Diffusion Planning for Autonomous Drivingcited by 64
- 2025Generalized Trajectory Scoring for End-to-end Multimodal Planningcited by 63
- 2025Centaur: Robust End-to-End Autonomous Driving with Test-Time Trainingcited by 41
- 2025iPad: Iterative Proposal-centric End-to-End Autonomous Drivingcited by 41
- 2026Driving on Registerscited by 38
- 2025SimScale: Learning to Drive via Real-World Simulation at Scalecited by 34
- 2026SparseDriveV2: Scoring is All You Need for End-to-End Autonomous Drivingcited by 21
- 2025DriveX: Omni Scene Modeling for Learning Generalizable World Knowledge in Autonomous Drivingcited by 20
- 2025PRIX: Learning to Plan from Raw Pixels for End-to-End Autonomous Drivingcited by 16
- 2026SpanVLA: Efficient Action Bridging and Learning from Negative-Recovery Samples for Vision-Language-Action Modelcited by 15
- 2026DriveFuture: Future-Aware Latent World Models for Autonomous Drivingcited by 15
- 2025MindDrive: An All-in-One Framework Bridging World Models and Vision-Language Model for End-to-End Autonomous Drivingcited by 12
- 2024ReGentS: Real-World Safety-Critical Driving Scenario Generation Made Stablecited by 8
- 2025SimpleVSF: VLM-Scoring Fusion for Trajectory Prediction of End-to-End Autonomous Drivingcited by 2
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026Physics-Grounded Causal Auditing of End-to-End Driving Plannerscited by 0
- 2026DriveReferee: Geometric Safety Verdicts Need Not Be Learned for Driving World-Action Modelscited by 0
- 2026Evaluation Is All You Need for Multi-Modal Autonomous Drivingcited by 0
- 2026INTERACT: Interactive Planning for Autonomous Driving via Anchor-Conditioned Prediction and Trust-Region Refinementcited by 0
- 2026Guiding End-to-End Driving Models with Endpoint-Constrained Trajectory Optimizationcited by 0
- 2026When the Score Becomes the Target: Rethinking Metric Validity in Autonomous Drivingcited by 0
- 2026Closed-Loop Refinement and Execution for Learned Driving Plannerscited by 0
- 2026Closed-Loop Refinement and Execution for Learned Driving Planners1 Oct 2026
- 2026When the Score Becomes the Target: Rethinking Metric Validity in Autonomous Driving28 Sep 2026
- 2026Guiding End-to-End Driving Models with Endpoint-Constrained Trajectory Optimization25 Sep 2026
- 2026INTERACT: Interactive Planning for Autonomous Driving via Anchor-Conditioned Prediction and Trust-Region Refinement25 Sep 2026
- 2026Evaluation Is All You Need for Multi-Modal Autonomous Driving25 Sep 2026
- 2026DriveReferee: Geometric Safety Verdicts Need Not Be Learned for Driving World-Action Models19 Sep 2026
- 2026Physics-Grounded Causal Auditing of End-to-End Driving Planners12 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026CLOVER: Closed-Loop Value Estimation and Ranking for End-to-End Autonomous Driving Planning
- 2026Designing Versatile Samples for Learned Trajectory Scoring
- 2025A Framework for Learning Scoring Rules in Autonomous Driving Planning Systems
- 2025Benchmarking Autonomous Driving Planners Across Leaderboards: A Unified CARLA-Based Evaluation
- 2024Diffusion-ES: Gradient-free Planning with Diffusion for Autonomous Driving and Zero-Shot Instruction Following
- 2026DriveVer: Lightweight Trajectory Evaluator as Test-Time Verifier for Autonomous Driving
- 2023Rethinking Closed-loop Training for Autonomous Driving
- 2026Efficient Multi-Modal Planning with Reward-Guided Preference Optimization for Autonomous Driving