mlsanityData to 14 Oct 2026

World Engine: Towards the Era of Post-Training for Autonomous Driving

arXiv 2606.19836 ↗First posted 18 Jun 2026cs.RO cs.CVcited by 8

On the map: End-to-end autonomous driving → Generative simulation for driving

Abstract (arXiv)

Autonomous vehicles must operate safely in the real world, where errors can have severe consequences. Although modern end-to-end driving policies excel in routine scenarios, their reliability is limited by the scarcity of safety-critical ``long-tail'' events in real driving datasets. These rare interactions define the practical safety boundary of the learned policy, yet they are difficult to collect at scale in the real world. Here we show that this fundamental limitation can be addressed by post-training pre-trained driving models on synthesized high-stakes interactions. We introduce World Engine, a generative framework that reconstructs high-fidelity interactive environments from real-world logs and systematically extrapolates them into realistic safety-critical variations. This paradigm enables reinforcement-based post-training to align policies with safety constraints, circumventing the physical risks inherent in real-world exploration. On a public benchmark built on nuPlan, World Engine substantially reduces failures in rare safety-critical scenarios and yields significantly larger gains than scaling pre-training data alone. Furthermore, when deployed on a production-scale autonomous driving system, the resulting policy reduces simulated collisions and demonstrates measurable improvements in on-road testing, showing that post-training on synthesized, safety-critical interactions offers a scalable and effective pathway to safer autonomous driving. The full codebase suite, including training, is released to the public.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Generative simulation for driving, one of 9 directions in End-to-end autonomous driving. Builds on 72 of its 98 references that are in the map. First posted on arXiv 18 Jun 2026.

Builds on

72 of 98 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025DriveVLA-W0: World Models Amplify Data Scaling Law in Autonomous Driving14 Oct
  2. 2025ReSim: Reliable World Simulation for Autonomous Driving11 Jun
  3. 2025AdaWM: Adaptive World Model based Planning for Autonomous Driving22 Jan
  4. 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllability27 May
  5. 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Driving29 Nov

Other references · 67

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  3. 2020Denoising Diffusion Implicit Modelscited by 9,781
  4. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  5. 2023Segment Anythingcited by 8,234
  6. 2020Scaling Laws for Neural Language Modelscited by 6,586
  7. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  8. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  9. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  10. 2016Feature Pyramid Networks for Object Detectioncited by 5,036
  11. 2022Emergent Abilities of Large Language Modelscited by 2,512
  12. 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
38 more
  1. 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,218
  2. 2022Planning-oriented Autonomous Drivingcited by 1,087
  3. 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 622
  4. 2023DriveLM: Driving with Graph Visual Question Answeringcited by 536
  5. 2023End-to-end Autonomous Driving: Challenges and Frontierscited by 490
  6. 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 490
  7. 2024NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarkingcited by 354
  8. 2020Neural Scene Graphs for Dynamic Scenescited by 298
  9. 2023UniSim: A Neural Closed-Loop Sensor Simulatorcited by 297
  10. 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuningcited by 260
  11. 2024Bench2Drive: Towards Multi-Ability Benchmarking of Closed-Loop End-To-End Autonomous Drivingcited by 252
  12. 2023Parting with Misconceptions about Learning-based Vehicle Motion Planningcited by 242
  13. 2023Driving with LLMs: Fusing Object-Level Vector Modality for Explainable Autonomous Drivingcited by 232
  14. 2024EMMA: End-to-End Multimodal Model for Autonomous Drivingcited by 231
  15. 2025World Simulation with Video Foundation Models for Physical AIcited by 200
  16. 2025ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Drivingcited by 198
  17. 2017DART: Noise Injection for Robust Imitation Learningcited by 191
  18. 2024Precise and Dexterous Robotic Manipulation via Human-in-the-Loop Reinforcement Learningcited by 189
  19. 2021Embodied Intelligence via Learning and Evolutioncited by 163
  20. 2025End-to-End Driving with Online Trajectory Evaluation via BEV World Modelcited by 151
  21. 2019Self-Driving Cars: A Surveycited by 148
  22. 2021Offboard 3D Object Detection from Point Cloud Sequencescited by 145
  23. 2023LLM4Drive: A Survey of Large Language Models for Autonomous Drivingcited by 136
  24. 2022Imitation Is Not Enough: Robustifying Imitation with Reinforcement Learning for Challenging Driving Scenarioscited by 129
  25. 2025RoboTwin: Dual-Arm Robot Benchmark with Generative Digital Twinscited by 121
  26. 2024UniScene: Unified Occupancy-centric Driving Scene Generationcited by 106
  27. 2024Towards learning-based planning:The nuPlan benchmark for real-world autonomous drivingcited by 104
  28. 2024MagicDrive-V2: High-Resolution Long Video Generation for Autonomous Driving with Adaptive Controlcited by 92
  29. 2023The Waymo Open Sim Agents Challengecited by 86
  30. 2025DriveMoE: Mixture-of-Experts for Vision-Language-Action Model in End-to-End Autonomous Drivingcited by 86
  31. 2025RAD: Training an End-to-End Driving Policy via Large-Scale 3DGS-based Reinforcement Learningcited by 79
  32. 2022CLIP model is an Efficient Continual Learnercited by 65
  33. 2022"Curse of rarity" for autonomous vehiclescited by 63
  34. 2025DiffusionDriveV2: Reinforcement Learning-Constrained Truncated Diffusion Modeling in End-to-End Autonomous Drivingcited by 56
  35. 2025Raw2Drive: Reinforcement Learning with Aligned World Models for End-to-End Autonomous Driving (in CARLA v2)cited by 47
  36. 2023RealGen: Retrieval Augmented Generation for Controllable Traffic Scenarioscited by 46
  37. 2025iPad: Iterative Proposal-centric End-to-End Autonomous Drivingcited by 42
  38. 2026RISE: Self-Improving Robot Policy with Compositional World Modelcited by 40

50 most cited of 67 All 67 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 8.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Post-Training in End-to-End Autonomous Driving
  2. 2026Threat-guided Policy-aware Scene Perturbation for Safe Autonomous Driving with Online Reinforcement Learning
  3. 2025VLM-SAFE: Vision-Language Model-Guided Safety-Aware Reinforcement Learning with World Models for Autonomous Driving
  4. 2023(Re)2H2O: Autonomous Driving Scenario Generation via Reversely Regularized Hybrid Offline-and-Online Reinforcement Learning
  5. 2021Learning to drive from a world on rails
  6. 2026From Virtual Environments to Real-World Trials: Emerging Trends in Autonomous Driving
  7. 2025World Model-Based End-to-End Scene Generation for Accident Anticipation in Autonomous Driving
  8. 2026Safety-Critical Scenarios Emerge from Initial Scenes ↗