Vehicle Motion Forecasting using Prior Information and Semantic-assisted Occupancy Grid Maps
Not on the map. Why?
Abstract (arXiv)
Motion prediction is a challenging task for autonomous vehicles due to uncertainty in the sensor data, the non-deterministic nature of future, and complex behavior of agents. In this paper, we tackle this problem by representing the scene as dynamic occupancy grid maps (DOGMs), associating semantic labels to the occupied cells and incorporating map information. We propose a novel framework that combines deep-learning-based spatio-temporal and probabilistic approaches to predict vehicle behaviors.Contrary to the conventional OGM prediction methods, evaluation of our work is conducted against the ground truth annotations. We experiment and validate our results on real-world NuScenes dataset and show that our model shows superior ability to predict both static and dynamic vehicles compared to OGM predictions. Furthermore, we perform an ablation study and assess the role of semantic labels and map in the architecture.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 19 of its 26 references that are in the map. First posted on arXiv 8 Aug 2023.
Builds on
19 of 26 references.
References · 19
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,715
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,436
- 2020VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representationcited by 530
- 2021MP3: A Unified Model to Map, Perceive, Predict and Plancited by 212
- 2021PredRNN: A Recurrent Neural Network for Spatiotemporal Predictive Learningcited by 182
- 2015Delving Deeper into Convolutional Networks for Learning Video Representationscited by 148
- 2020PnPNet: End-to-End Perception and Prediction with Tracking in the Loopcited by 144
- 2020MotionNet: Joint Perception and Motion Prediction for Autonomous Driving Based on Bird's Eye View Mapscited by 100
- 2021Video Prediction Recalling Long-term Motion Context via Memory Alignment Learningcited by 62
- 2022Occupancy Flow Fields for Motion Forecasting in Autonomous Drivingcited by 62
- 2020FISHING Net: Future Inference of Semantic Heatmaps In Gridscited by 55
7 more
- 2020Probabilistic Future Prediction for Video Scene Understandingcited by 45
- 2018Long-Term Occupancy Grid Prediction Using Recurrent Neural Networkscited by 29
- 2018Multi-Step Prediction of Occupancy Grid Maps with Recurrent Neural Networkscited by 24
- 2022Dynamics-Aware Spatiotemporal Occupancy Prediction in Urban Environmentscited by 17
- 2020Attention Augmented ConvLSTM for Environment Predictioncited by 12
- 2022Predicting Future Occupancy Grids in Dynamic Environment with Spatio-Temporal Learningcited by 7
- 2023Allo-centric Occupancy Grid Prediction for Urban Traffic Scene Using Video Prediction Networkscited by 3
Built on by
Citing papers per year: 2024: 1; 2025: 1; 2026: 1.
3 papers.
- 2024Flow-guided Motion Prediction with Semantics and Dynamic Occupancy Grid Mapscited by 2
- 2025Trajectory prediction for heterogeneous agents: A performance analysis on small and imbalanced datasetscited by 0
- 2026Integrating Specialized and Generic Agent Motion Prediction with Dynamic Occupancy Grid Mapscited by 0
- 2026Integrating Specialized and Generic Agent Motion Prediction with Dynamic Occupancy Grid Maps8 Feb 2026
- 2025Trajectory prediction for heterogeneous agents: A performance analysis on small and imbalanced datasets4 Oct 2025
- 2024Flow-guided Motion Prediction with Semantics and Dynamic Occupancy Grid Maps22 Jul 2024