mlsanityData to 7 Oct 2026

Solving Motion Planning Tasks with a Scalable Generative Model

arXiv 2407.02797 ↗First posted 3 Jul 2024cs.RO cs.CVcited by 40

Not on the map. Why?

Abstract (arXiv)

As autonomous driving systems being deployed to millions of vehicles, there is a pressing need of improving the system's scalability, safety and reducing the engineering cost. A realistic, scalable, and practical simulator of the driving world is highly desired. In this paper, we present an efficient solution based on generative models which learns the dynamics of the driving scenes. With this model, we can not only simulate the diverse futures of a given driving scenario but also generate a variety of driving scenarios conditioned on various prompts. Our innovative design allows the model to operate in both full-Autoregressive and partial-Autoregressive modes, significantly improving inference and training speed without sacrificing generative capability. This efficiency makes it ideal for being used as an online reactive environment for reinforcement learning, an evaluator for planning policies, and a high-fidelity simulator for testing. We evaluated our model against two real-world datasets: the Waymo motion dataset and the nuPlan dataset. On the simulation realism and scene generation benchmark, our model achieves the state-of-the-art performance. And in the planning benchmarks, our planner outperforms the prior arts. We conclude that the proposed generative model may serve as a foundation for a variety of motion planning tasks, including data generation, simulation, planning, and online training. Source code is public at https://github.com/HorizonRobotics/GUMP/

Key facts. Cited by 40 papers in the map (data through 7 Oct 2026). Builds on 64 of its 82 references that are in the map. First posted on arXiv 3 Jul 2024.

Builds on

64 of 82 references.

References · 64

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2017Proximal Policy Optimization Algorithmscited by 14,441
  4. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  5. 2020Scaling Laws for Neural Language Modelscited by 6,411
  6. 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,635
  7. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
  8. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
  9. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
  10. 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
  11. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
  12. 2023Mastering Diverse Domains through World Modelscited by 1,193
38 more
  1. 2018Hierarchical Neural Story Generationcited by 1,182
  2. 2022MaskGIT: Masked Generative Image Transformercited by 1,082
  3. 2022Planning-oriented Autonomous Drivingcited by 1,068
  4. 2020Mastering Atari with Discrete World Modelscited by 990
  5. 2018Recurrent World Models Facilitate Policy Evolutioncited by 761
  6. 2021VideoGPT: Video Generation using VQ-VAE and Transformerscited by 651
  7. 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 618
  8. 2021Large Scale Interactive Motion Forecasting for Autonomous Driving : The Waymo Open Motion Datasetcited by 532
  9. 2023DriveLM: Driving with Graph Visual Question Answeringcited by 527
  10. 2021NuPlan: A closed-loop ML-based planning benchmark for autonomous vehiclescited by 485
  11. 2019MultiPath: Multiple Probabilistic Anchor Trajectory Hypotheses for Behavior Predictioncited by 417
  12. 2022MapTR: Structured Modeling and Learning for Online Vectorized HD Map Constructioncited by 311
  13. 2021DenseTNT: End-to-end Trajectory Prediction from Dense Goal Setscited by 292
  14. 2021MetaDrive: Composing Diverse Driving Scenarios for Generalizable Reinforcement Learningcited by 281
  15. 2022Wayformer: Motion Forecasting via Simple & Efficient Attention Networkscited by 279
  16. 2022Motion Transformer with Global Intention Localization and Local Movement Refinementcited by 267
  17. 2021MultiPath++: Efficient Information Fusion and Trajectory Aggregation for Behavior Predictioncited by 246
  18. 2022VectorMapNet: End-to-end Vectorized HD Map Learningcited by 243
  19. 2023Parting with Misconceptions about Learning-based Vehicle Motion Planningcited by 238
  20. 2021TrafficSim: Learning to Simulate Realistic Multi-Agent Behaviorscited by 192
  21. 2023MapTRv2: An End-to-End Framework for Online Vectorized HD Map Constructioncited by 192
  22. 2021Scene Transformer: A unified architecture for predicting multiple agent trajectoriescited by 165
  23. 2023MotionLM: Multi-Agent Motion Forecasting as Language Modelingcited by 154
  24. 2022Model-Based Imitation Learning for Urban Drivingcited by 149
  25. 2023GameFormer: Game-theoretic Modeling and Learning of Transformer-based Interactive Prediction and Planning for Autonomous Drivingcited by 141
  26. 2023MTR++: Multi-Agent Motion Prediction with Symmetric Scene Modeling and Guided Intention Queryingcited by 139
  27. 2019Meta-Sim: Learning to Generate Synthetic Datasetscited by 128
  28. 2021Urban Driver: Learning to Drive from Real-world Demonstrations Using Policy Gradientscited by 122
  29. 2021Learning to drive from a world on railscited by 114
  30. 2022PlanT: Explainable Planning Transformers via Object-Level Representationscited by 105
  31. 2023Copilot4D: Learning Unsupervised World Models for Autonomous Driving via Discrete Diffusioncited by 105
  32. 2022TrafficGen: Learning to Generate Diverse and Realistic Traffic Scenarioscited by 104
  33. 2018Structured Domain Randomization: Bridging the Reality Gap by Context-Aware Synthetic Datacited by 94
  34. 2023ReasonNet: End-to-End Driving with Temporal and Global Reasoningcited by 92
  35. 2023The Waymo Open Sim Agents Challengecited by 86
  36. 2021SceneGen: Learning to Generate Realistic Traffic Scenescited by 83
  37. 2023DrivingDiffusion: Layout-Guided multi-view driving scene video generation with latent diffusion modelcited by 75
  38. 2022When to Trust Your Simulator: Dynamics-Aware Hybrid Offline-and-Online Reinforcement Learningcited by 59

50 most cited of 64 All 64 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 7; 2025: 23; 2026: 10.

40 papers.

Sort:

By area:

  1. 2025Diffusion-Based Planning for Autonomous Driving with Flexible Guidancecited by 138
  2. 2025RAD: Training an End-to-End Driving Policy via Large-Scale 3DGS-based Reinforcement Learningcited by 76
  3. 2025DiffusionDriveV2: Reinforcement Learning-Constrained Truncated Diffusion Modeling in End-to-End Autonomous Drivingcited by 52
  4. 2024Gen-Drive: Enhancing Diffusion Generative Driving Policies with Reward Modeling and Reinforcement Learning Fine-tuningcited by 41
  5. 2024Closed-Loop Supervised Fine-Tuning of Tokenized Traffic Modelscited by 40
  6. 2024DriveGPT: Scaling Autoregressive Behavior Models for Drivingcited by 29
  7. 2025Scenario Dreamer: Vectorized Latent Diffusion for Generating Driving Simulation Environmentscited by 27
  8. 2024Generalizing Motion Planners with Mixture of Experts for Autonomous Drivingcited by 22
  9. 2025Plan-R1: Safe and Feasible Trajectory Planning as Language Modelingcited by 19
  10. 2024KiGRAS: Kinematic-Driven Generative Model for Realistic Agent Simulationcited by 17
  11. 2025DIVER: Reinforced Diffusion Breaks Imitation Bottlenecks in End-to-End Autonomous Drivingcited by 17
  12. 2025Data Scaling Laws for End-to-End Autonomous Drivingcited by 14
28 more
  1. 2025Advancing Multi-agent Traffic Simulation via R1-Style Reinforcement Fine-Tuningcited by 14
  2. 2025UniMM: A Unified Mixture Model Framework for Multi-Agent Simulationcited by 13
  3. 2025Generating Multimodal Driving Scenes via Next-Scene Predictioncited by 12
  4. 2025Decoupled Diffusion Sparks Adaptive Scene Generationcited by 12
  5. 2025DRoPE: Directional Rotary Position Embedding for Efficient Agent Interaction Modelingcited by 9
  6. 2024Learning Multiple Probabilistic Decisions from Latent World Model in Autonomous Drivingcited by 8
  7. 2025When Planners Meet Reality: How Learned, Reactive Traffic Agents Shift nuPlan Benchmarkscited by 7
  8. 2025VLMPlanner: Integrating Visual Language Models with Motion Planningcited by 6
  9. 2025The Safety Challenge of World Models for Embodied AI Agents: A Reviewcited by 5
  10. 2025DecompGAIL: Learning Realistic Traffic Behaviors with Decomposed Multi-Agent Generative Adversarial Imitation Learningcited by 5
  11. 2025RIFT: Group-Relative RL Fine-Tuning for Realistic and Controllable Traffic Simulationcited by 4
  12. 2025Do LLM Modules Generalize? A Study on Motion Generation for Autonomous Drivingcited by 4
  13. 2025Autoregressive Meta-Actions for Unified Controllable Trajectory Generationcited by 2
  14. 2025Long-term Traffic Simulation with Interleaved Autoregressive Motion and Scenario Generationcited by 2
  15. 2025SceneStreamer: Continuous Scenario Generation as Next Token Group Predictioncited by 2
  16. 2025Optimization-Guided Diffusion for Interactive Scene Generationcited by 2
  17. 2026CorrectionPlanner: Self-Correction Planner with Reinforcement Learning in Autonomous Drivingcited by 2
  18. 2026RLFTSim: Realistic and Controllable Multi-Agent Traffic Simulation via Reinforcement Learning Fine-Tuningcited by 2
  19. 2024TrafficGamer: Reliable and Flexible Traffic Simulation for Safety-Critical Scenarios with Game-Theoretic Oraclescited by 1
  20. 2026SaFeR: Safety-Critical Scenario Generation for Autonomous Driving Test via Feasibility-Constrained Token Resamplingcited by 1
  21. 2026Learning Rollout from Sampling:An R1-Style Tokenized Traffic Simulation Modelcited by 1
  22. 2026ASSCG: Just-Right Gating over Chattering for Fast-Slow LLM Planning in Autonomous Drivingcited by 1
  23. 2026World Models as Adversaries: Multi-Agent Self-Play Fine-Tuning for Robust Motion Planningcited by 1
  24. 2026DiffuSearch: How Hybrid Trajectory Planning Benefits from Aligned Objectives in Diffusion and Action Spacecited by 1
  25. 2025Pseudo-Expert Regularized Offline RL for End-to-End Autonomous Driving in Photorealistic Closed-Loop Environmentscited by 0
  26. 2026Bridging Local Observation and Global Simulation in Closed-Loop Traffic Modelingcited by 0
  27. 2026Controllable Sim Agents with Behavior Latentscited by 0
  28. 2026Agent-driven Long-tail Simulation for Autonomous Drivingcited by 0