Vehicle Trajectory Prediction on Highways Using Bird Eye View Representations and Deep Learning
Not on the map. Why?
Abstract (arXiv)
This work presents a novel method for predicting vehicle trajectories in highway scenarios using efficient bird's eye view representations and convolutional neural networks. Vehicle positions, motion histories, road configuration, and vehicle interactions are easily included in the prediction model using basic visual representations. The U-net model has been selected as the prediction kernel to generate future visual representations of the scene using an image-to-image regression approach. A method has been implemented to extract vehicle positions from the generated graphical representations to achieve subpixel resolution. The method has been trained and evaluated using the PREVENTION dataset, an on-board sensor dataset. Different network configurations and scene representations have been evaluated. This study found that U-net with 6 depth levels using a linear terminal layer and a Gaussian representation of the vehicles is the best performing configuration. The use of lane markings was found to produce no improvement in prediction performance. The average prediction error is 0.47 and 0.38 meters and the final prediction error is 0.76 and 0.53 meters for longitudinal and lateral coordinates, respectively, for a predicted trajectory length of 2.0 seconds. The prediction error is up to 50% lower compared to the baseline method.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 15 of its 40 references that are in the map. First posted on arXiv 4 Jul 2022.
Builds on
15 of 40 references.
References · 15
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 728
- 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 687
- 2018The highD Dataset: A Drone Dataset of Naturalistic Vehicle Trajectories on German Highways for Validation of Highly Automated Driving Systemscited by 276
- 2019INTERACTION Dataset: An INTERnational, Adversarial and Cooperative moTION Dataset in Interactive Driving Scenarios with Semantic Mapscited by 231
- 2018Convolutional Social Pooling for Vehicle Trajectory Predictioncited by 221
- 2019The inD Dataset: A Drone Dataset of Naturalistic Road User Trajectories at German Intersectionscited by 137
- 2018An LSTM Network for Highway Trajectory Predictioncited by 81
- 2020PiP: Planning-informed Trajectory Prediction for Autonomous Drivingcited by 80
- 2018Multi-Modal Trajectory Prediction of Surrounding Vehicles with Maneuver based LSTMscited by 77
- 2017Probabilistic Vehicle Trajectory Prediction over Occupancy Grid Map via Recurrent Neural Networkcited by 56
- 2020Multi-Head Attention based Probabilistic Vehicle Trajectory Predictioncited by 12
3 more
Built on by
Citing papers per year: 2023: 3; 2024: 2; 2025: 1.
6 papers.
- 2024RAG-based Explainable Prediction of Road Users Behaviors for Automated Driving using Knowledge Graphs and Large Language Modelscited by 20
- 2023A POV-based Highway Vehicle Trajectory Dataset and Prediction Architecturecited by 4
- 2023Spatiotemporal Capsule Neural Network for Vehicle Trajectory Predictioncited by 3
- 2023VegaEdge: Edge AI Confluence Anomaly Detection for Real-Time Highway IoT-Applicationscited by 1
- 2024Temporal Enhanced Floating Car Observerscited by 1
- 2025A Multimodal Architecture for Endpoint Position Prediction in Team-based Multiplayer Gamescited by 1
- 2025A Multimodal Architecture for Endpoint Position Prediction in Team-based Multiplayer Games28 Jul 2025
- 2024RAG-based Explainable Prediction of Road Users Behaviors for Automated Driving using Knowledge Graphs and Large Language Models1 May 2024
- 2024Temporal Enhanced Floating Car Observers6 Mar 2024
- 2023VegaEdge: Edge AI Confluence Anomaly Detection for Real-Time Highway IoT-Applications14 Nov 2023
- 2023A POV-based Highway Vehicle Trajectory Dataset and Prediction Architecture10 Mar 2023
- 2023Spatiotemporal Capsule Neural Network for Vehicle Trajectory Prediction6 Mar 2023