Trends in Motion Prediction Toward Deployable and Generalizable Autonomy: A Revisit and Perspectives
On the map: World models → World models for autonomous driving
Abstract (arXiv)
Motion prediction, recently popularized as world models, refers to the anticipation of future agent states or scene evolution, which is rooted in human cognition, bridging perception and decision-making. It enables intelligent systems, such as robots and self-driving cars, to act safely in dynamic, human-involved environments, and informs broader time-series reasoning challenges. With advances in methods, representations, and datasets, the field has seen rapid progress, reflected in quickly evolving benchmark results. Yet, when state-of-the-art methods are deployed in the real world, they often struggle to generalize to open-world conditions and fall short of deployment standards. This reveals a gap between research benchmarks, which are often idealized or ill-posed, and real-world complexity. To address this gap, this survey revisits the generalization and deployability of motion prediction models, with an emphasis on applications of robotics, autonomous driving, and human motion. We first offer a comprehensive taxonomy of motion prediction methods, covering representations, modeling strategies, application domains, and evaluation protocols. We then study two key challenges: (1) how to push motion prediction models to be deployable to realistic deployment standards, where motion prediction does not act in a vacuum, but functions as one module of closed-loop autonomy stacks - it takes input localization and perception, and informs downstream planning and control. 2) How to generalize motion prediction models from limited seen scenarios/datasets to the open-world settings. Throughout the paper, we highlight critical open challenges to guide future work, aiming to recalibrate the community's efforts, fostering progress that is not only measurable but also meaningful for real-world applications. The project webpage can be found here https://trends-in-motion-prediction-2025.github.io/.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 112 of its 686 references that are in the map. First posted on arXiv 14 May 2025.
Builds on
112 of 686 references.
Closest ancestors · 9
Same direction, newest first
- 2024DrivingDojo Dataset: Advancing Interactive and Knowledge-Enriched Driving World Model14 Oct
- 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllability27 May
- 2024GenAD: Generative End-to-End Autonomous Driving18 Feb
- 2023ADriver-I: A General World Model for Autonomous Driving22 Nov
- 2023Copilot4D: Learning Unsupervised World Models for Autonomous Driving via Discrete Diffusion2 Nov
- 2023Waymax: An Accelerated, Data-Driven Simulator for Large-Scale Autonomous Driving Research12 Oct
- 2023GAIA-1: A Generative World Model for Autonomous Driving29 Sep
- 2023DriveDreamer: Towards Real-world-driven World Models for Autonomous Driving18 Sep
- 2021NuPlan: A closed-loop ML-based planning benchmark for autonomous vehicles22 Jun
Other references · 103
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2017Graph Attention Networkscited by 8,923
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
- 2013Auto-Encoding Variational Bayescited by 4,053
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
- 2022Training Compute-Optimal Large Language Modelscited by 3,019
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2019Invariant Risk Minimizationcited by 1,854
38 more
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
- 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,628
- 2018Relational inductive biases, deep learning, and graph networkscited by 1,360
- 2018Efficient Lifelong Learning with A-GEMcited by 1,058
- 2016End to End Learning for Self-Driving Carscited by 1,009
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
- 2021Generalized Out-of-Distribution Detection: A Surveycited by 802
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 707
- 2021VideoGPT: Video Generation using VQ-VAE and Transformerscited by 658
- 2022MagicVideo: Efficient Video Generation With Latent Diffusion Modelscited by 465
- 2023Learning Interactive Real-World Simulatorscited by 458
- 2019MultiPath: Multiple Probabilistic Anchor Trajectory Hypotheses for Behavior Predictioncited by 420
- 2018ChauffeurNet: Learning to Drive by Imitating the Best and Synthesizing the Worstcited by 397
- 2018Measuring the Intrinsic Dimension of Objective Landscapescited by 370
- 2024NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarkingcited by 354
- 2020TNT: Target-driveN Trajectory Predictioncited by 347
- 2022BEVDet4D: Exploit Temporal Cues in Multi-camera 3D Object Detectioncited by 341
- 2023Synthetic Data from Diffusion Models Improves ImageNet Classificationcited by 327
- 2023MagicDrive: Street View Generation with Diverse 3D Geometry Controlcited by 252
- 2017Stochastic Variational Video Predictioncited by 234
- 2019INTERACTION Dataset: An INTERnational, Adversarial and Cooperative moTION Dataset in Interactive Driving Scenarios with Semantic Mapscited by 231
- 2021HyperNeRF: A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fieldscited by 214
- 2021Fixing Data Augmentation to Improve Adversarial Robustnesscited by 204
- 2022Generating Videos with Dynamics-aware Implicit Generative Adversarial Networkscited by 186
- 2021Efficient Large Scale Language Modeling with Mixtures of Expertscited by 175
- 20203D Dynamic Scene Graphs: Actionable Spatial Perception with Places, Objects, and Humanscited by 144
- 2023GameFormer: Game-theoretic Modeling and Learning of Transformer-based Interactive Prediction and Planning for Autonomous Drivingcited by 141
- 2022Diffusion Models for Video Prediction and Infillingcited by 135
- 2023SelfOcc: Self-Supervised Vision-Based 3D Occupancy Predictioncited by 133
- 2025DriveTransformer: Unified Transformer for Scalable End-to-End Autonomous Drivingcited by 126
- 2023StreetSurf: Extending Multi-view Implicit Surface Reconstruction to Street Viewscited by 120
- 2023Language-Guided Traffic Simulation via Scene-Level Diffusioncited by 111
- 2023Sparse4D v2: Recurrent Temporal Fusion with Sparse Modelcited by 93
- 2023Language Conditioned Traffic Generationcited by 87
- 2024Video as the New Language for Real-World Decision Makingcited by 87
- 2019GRIP++: Enhanced Graph-based Interaction-aware Trajectory Prediction for Autonomous Drivingcited by 73
- 2023UniPAD: A Universal Pre-training Paradigm for Autonomous Drivingcited by 73
50 most cited of 103 All 103 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 4.
5 papers.
- 2026nuReasoning: A Reasoning-Centric Dataset and Benchmark for Long-Tail Autonomous Drivingcited by 9
- 2026Digital Twin AI: Opportunities and Challenges from Large Language Models to World Modelscited by 4
- 2025Recent Advances in Multi-Agent Human Trajectory Prediction: A Comprehensive Reviewcited by 2
- 2026Priority-Aware Multi-Robot Coverage Path Planningcited by 2
- 2026BeyondSight: Object Permanence for End-to-End Autonomous Drivingcited by 0
- 2026BeyondSight: Object Permanence for End-to-End Autonomous Driving10 Jul 2026
- 2026nuReasoning: A Reasoning-Centric Dataset and Benchmark for Long-Tail Autonomous Driving29 May 2026
- 2026Digital Twin AI: Opportunities and Challenges from Large Language Models to World Models4 Jan 2026
- 2026Priority-Aware Multi-Robot Coverage Path Planning2 Jan 2026
- 2025Recent Advances in Multi-Agent Human Trajectory Prediction: A Comprehensive Review13 Jun 2025
Similar, not cited
Close in wording, no citation either way
- 2025DriveLaW:Unifying Planning and Video Generation in a Latent Driving World
- 2025A Survey of World Models for Autonomous Driving
- 2022Narrowing the Coordinate-frame Gap in Behavior Prediction Models: Distillation for Efficient and Accurate Scene-centric Motion Forecasting
- 2025ProphetDWM: A Driving World Model for Rolling Out Future Actions and Videos
- 2025A Comprehensive Survey on World Models for Embodied AI
- 2026World Model for Robot Learning: A Comprehensive Survey
- 2026IDOL: Inverse-Dynamics-Guided Future Prediction for End-to-End Autonomous Driving
- 2026Drive-HWM: Hierarchical World Models for Dynamic-Latent Guided Autonomous Driving