Trajectory-Prediction with Vision: A Survey
Not on the map. Why?
Abstract (arXiv)
To plan a safe and efficient route, an autonomous vehicle should anticipate future trajectories of other agents around it. Trajectory prediction is an extremely challenging task which recently gained a lot of attention in the autonomous vehicle research community. Trajectory-prediction forecasts future state of all the dynamic agents in the scene given their current and past states. A good prediction model can prevent collisions on the road, and hence the ultimate goal for autonomous vehicles: Collision rate: collisions per Million miles. The objective of this paper is to provide an overview of the field trajectory-prediction. We categorize the relevant algorithms into different classes so that researchers can follow through the trends in the trajectory-prediction research field. Moreover we also touch upon the background knowledge required to formulate a trajectory-prediction problem.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 19 of its 28 references that are in the map. First posted on arXiv 15 Mar 2023.
Builds on
19 of 28 references.
References · 19
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
- 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 728
- 2021AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent Forecastingcited by 327
- 2020V2VNet: Vehicle-to-Vehicle Communication for Joint Perception and Predictioncited by 292
- 2020One Thousand and One Hours: Self-driving Motion Prediction Datasetcited by 239
- 2020Fast and Furious: Real Time End-to-End 3D Detection, Tracking and Motion Forecasting with a Single Convolutional Netcited by 228
- 2017Social Attention: Modeling Attention in Human Crowdscited by 185
- 2019PRECOG: PREdiction Conditioned On Goals in Visual Multi-Agent Settingscited by 178
- 2020PnPNet: End-to-End Perception and Prediction with Tracking in the Loopcited by 143
- 2018An LSTM Network for Highway Trajectory Predictioncited by 81
- 2019GRIP++: Enhanced Graph-based Interaction-aware Trajectory Prediction for Autonomous Drivingcited by 73
7 more
- 2021LOKI: Long Term and Key Intentions for Trajectory Predictioncited by 57
- 2021MVFuseNet: Improving End-to-End Object Detection and Motion Forecasting through Multi-View Fusion of LiDAR Datacited by 18
- 2016A Random Finite Set Approach for Dynamic Occupancy Grid Maps with Real-Time Applicationcited by 17
- 2023Vision-RADAR fusion for Robotics BEV Detections: A Surveycited by 14
- 2023Surround-View Vision-based 3D Detection for Autonomous Driving: A Surveycited by 14
- 2023Transformer-Based Sensor Fusion for Autonomous Driving: A Surveycited by 14
- 20233M3D: Multi-view, Multi-path, Multi-representation for 3D Object Detectioncited by 3
Built on by
Citing papers per year: 2023: 1; 2024: 0; 2025: 0; 2026: 3.
4 papers.
- 2023An Overview about Emerging Technologies of Autonomous Drivingcited by 2
- 2026From Observation to Prediction: LSTM for Vehicle Lane Change Forecasting on Highway On/Off-Rampscited by 1
- 2026Agent-Centric Social Trajectory Prediction: A Free Energy Principle Perspectivecited by 0
- 2026SD-RouteFusion: Ego-Trajectory Prediction with SD-Map Route Conditioningcited by 0
- 2026SD-RouteFusion: Ego-Trajectory Prediction with SD-Map Route Conditioning1 Jul 2026
- 2026Agent-Centric Social Trajectory Prediction: A Free Energy Principle Perspective25 May 2026
- 2026From Observation to Prediction: LSTM for Vehicle Lane Change Forecasting on Highway On/Off-Ramps21 Jan 2026
- 2023An Overview about Emerging Technologies of Autonomous Driving23 Jun 2023