World Engine: Towards the Era of Post-Training for Autonomous Driving
On the map: End-to-end autonomous driving → Generative simulation for driving
Abstract (arXiv)
Autonomous vehicles must operate safely in the real world, where errors can have severe consequences. Although modern end-to-end driving policies excel in routine scenarios, their reliability is limited by the scarcity of safety-critical ``long-tail'' events in real driving datasets. These rare interactions define the practical safety boundary of the learned policy, yet they are difficult to collect at scale in the real world. Here we show that this fundamental limitation can be addressed by post-training pre-trained driving models on synthesized high-stakes interactions. We introduce World Engine, a generative framework that reconstructs high-fidelity interactive environments from real-world logs and systematically extrapolates them into realistic safety-critical variations. This paradigm enables reinforcement-based post-training to align policies with safety constraints, circumventing the physical risks inherent in real-world exploration. On a public benchmark built on nuPlan, World Engine substantially reduces failures in rare safety-critical scenarios and yields significantly larger gains than scaling pre-training data alone. Furthermore, when deployed on a production-scale autonomous driving system, the resulting policy reduces simulated collisions and demonstrates measurable improvements in on-road testing, showing that post-training on synthesized, safety-critical interactions offers a scalable and effective pathway to safer autonomous driving. The full codebase suite, including training, is released to the public.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Generative simulation for driving, one of 9 directions in End-to-end autonomous driving. Builds on 72 of its 98 references that are in the map. First posted on arXiv 18 Jun 2026.
Builds on
72 of 98 references.
Closest ancestors · 5
Same direction, newest first
- 2025DriveVLA-W0: World Models Amplify Data Scaling Law in Autonomous Driving14 Oct
- 2025ReSim: Reliable World Simulation for Autonomous Driving11 Jun
- 2025AdaWM: Adaptive World Model based Planning for Autonomous Driving22 Jan
- 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllability27 May
- 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Driving29 Nov
Other references · 67
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2023Segment Anythingcited by 8,234
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2022Emergent Abilities of Large Language Modelscited by 2,512
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
38 more
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,218
- 2022Planning-oriented Autonomous Drivingcited by 1,087
- 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 622
- 2023DriveLM: Driving with Graph Visual Question Answeringcited by 536
- 2023End-to-end Autonomous Driving: Challenges and Frontierscited by 490
- 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 490
- 2024NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarkingcited by 354
- 2020Neural Scene Graphs for Dynamic Scenescited by 298
- 2023UniSim: A Neural Closed-Loop Sensor Simulatorcited by 297
- 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuningcited by 260
- 2024Bench2Drive: Towards Multi-Ability Benchmarking of Closed-Loop End-To-End Autonomous Drivingcited by 252
- 2023Parting with Misconceptions about Learning-based Vehicle Motion Planningcited by 242
- 2023Driving with LLMs: Fusing Object-Level Vector Modality for Explainable Autonomous Drivingcited by 232
- 2024EMMA: End-to-End Multimodal Model for Autonomous Drivingcited by 231
- 2025World Simulation with Video Foundation Models for Physical AIcited by 200
- 2025ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Drivingcited by 198
- 2017DART: Noise Injection for Robust Imitation Learningcited by 191
- 2024Precise and Dexterous Robotic Manipulation via Human-in-the-Loop Reinforcement Learningcited by 189
- 2021Embodied Intelligence via Learning and Evolutioncited by 163
- 2025End-to-End Driving with Online Trajectory Evaluation via BEV World Modelcited by 151
- 2019Self-Driving Cars: A Surveycited by 148
- 2021Offboard 3D Object Detection from Point Cloud Sequencescited by 145
- 2023LLM4Drive: A Survey of Large Language Models for Autonomous Drivingcited by 136
- 2022Imitation Is Not Enough: Robustifying Imitation with Reinforcement Learning for Challenging Driving Scenarioscited by 129
- 2025RoboTwin: Dual-Arm Robot Benchmark with Generative Digital Twinscited by 121
- 2024UniScene: Unified Occupancy-centric Driving Scene Generationcited by 106
- 2024Towards learning-based planning:The nuPlan benchmark for real-world autonomous drivingcited by 104
- 2024MagicDrive-V2: High-Resolution Long Video Generation for Autonomous Driving with Adaptive Controlcited by 92
- 2023The Waymo Open Sim Agents Challengecited by 86
- 2025DriveMoE: Mixture-of-Experts for Vision-Language-Action Model in End-to-End Autonomous Drivingcited by 86
- 2025RAD: Training an End-to-End Driving Policy via Large-Scale 3DGS-based Reinforcement Learningcited by 79
- 2022CLIP model is an Efficient Continual Learnercited by 65
- 2022"Curse of rarity" for autonomous vehiclescited by 63
- 2025DiffusionDriveV2: Reinforcement Learning-Constrained Truncated Diffusion Modeling in End-to-End Autonomous Drivingcited by 56
- 2025Raw2Drive: Reinforcement Learning with Aligned World Models for End-to-End Autonomous Driving (in CARLA v2)cited by 47
- 2023RealGen: Retrieval Augmented Generation for Controllable Traffic Scenarioscited by 46
- 2025iPad: Iterative Proposal-centric End-to-End Autonomous Drivingcited by 42
- 2026RISE: Self-Improving Robot Policy with Compositional World Modelcited by 40
50 most cited of 67 All 67 (JSON)
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026DriveZero: End-to-End Driving Beyond Human Demonstrationscited by 3
- 2026MeRoPE: Metric Rotary Position Embedding for Camera-Controlled Video Generationcited by 1
- 2026OPTED: On-Policy Fine-Tuning for End-to-End Driving using a Render-Free Teachercited by 1
- 2026SimVTA: Simulation-Grounded Video-Trajectory Alignment for Driving World Action Modelscited by 1
- 2026BehaviorWorldGen: Closing the Loop between Action Models and World Simulators via Controllable Behavior-Aware Structured World Generationcited by 0
- 2026NavSafe-∞: Benchmarking Closed-Loop Driving Safety in Photorealistic Environmentscited by 0
- 2026Beyond Retrieval Relevance: Scene-Grounded Risk Entailment for Vision-Language Drivingcited by 0
- 2026Human Behavior-Informed Crash Scenario Generation with Real-World Crash Priors for Autonomous Vehicle Safety Evaluationcited by 0
- 2026SimVTA: Simulation-Grounded Video-Trajectory Alignment for Driving World Action Models9 Oct 2026
- 2026Human Behavior-Informed Crash Scenario Generation with Real-World Crash Priors for Autonomous Vehicle Safety Evaluation3 Oct 2026
- 2026Beyond Retrieval Relevance: Scene-Grounded Risk Entailment for Vision-Language Driving28 Sep 2026
- 2026NavSafe-∞: Benchmarking Closed-Loop Driving Safety in Photorealistic Environments22 Sep 2026
- 2026OPTED: On-Policy Fine-Tuning for End-to-End Driving using a Render-Free Teacher17 Sep 2026
- 2026DriveZero: End-to-End Driving Beyond Human Demonstrations5 Sep 2026
- 2026MeRoPE: Metric Rotary Position Embedding for Camera-Controlled Video Generation1 Sep 2026
- 2026BehaviorWorldGen: Closing the Loop between Action Models and World Simulators via Controllable Behavior-Aware Structured World Generation23 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026Post-Training in End-to-End Autonomous Driving
- 2026Threat-guided Policy-aware Scene Perturbation for Safe Autonomous Driving with Online Reinforcement Learning
- 2025VLM-SAFE: Vision-Language Model-Guided Safety-Aware Reinforcement Learning with World Models for Autonomous Driving
- 2023(Re)2H2O: Autonomous Driving Scenario Generation via Reversely Regularized Hybrid Offline-and-Online Reinforcement Learning
- 2021Learning to drive from a world on rails
- 2026From Virtual Environments to Real-World Trials: Emerging Trends in Autonomous Driving
- 2025World Model-Based End-to-End Scene Generation for Accident Anticipation in Autonomous Driving
- 2026Safety-Critical Scenarios Emerge from Initial Scenes ↗