Predicting Vehicles Trajectories in Urban Scenarios with Transformer Networks and Augmented Information
Not on the map. Why?
Abstract (arXiv)
Understanding the behavior of road users is of vital importance for the development of trajectory prediction systems. In this context, the latest advances have focused on recurrent structures, establishing the social interaction between the agents involved in the scene. More recently, simpler structures have also been introduced for predicting pedestrian trajectories, based on Transformer Networks, and using positional information. They allow the individual modelling of each agent's trajectory separately without any complex interaction terms. Our model exploits these simple structures by adding augmented data (position and heading), and adapting their use to the problem of vehicle trajectory prediction in urban scenarios in prediction horizons up to 5 seconds. In addition, a cross-performance analysis is performed between different types of scenarios, including highways, intersections and roundabouts, using recent datasets (inD, rounD, highD and INTERACTION). Our model achieves state-of-the-art results and proves to be flexible and adaptable to different types of urban contexts.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 21 of its 29 references that are in the map. First posted on arXiv 1 Jun 2021.
Builds on
21 of 29 references.
References · 21
- 2017Attention Is All You Needcited by 59,932
- 2018Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognitioncited by 1,199
- 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 687
- 2020Social-STGCNN: A Social Spatio-Temporal Graph Convolutional Neural Network for Human Trajectory Predictioncited by 324
- 2018SoPhie: An Attentive GAN for Predicting Paths Compliant to Social and Physical Constraintscited by 296
- 2018The highD Dataset: A Drone Dataset of Naturalistic Vehicle Trajectories on German Highways for Validation of Highly Automated Driving Systemscited by 276
- 2019INTERACTION Dataset: An INTERnational, Adversarial and Cooperative moTION Dataset in Interactive Driving Scenarios with Semantic Mapscited by 231
- 2019Social-BiGAT: Multimodal Trajectory Forecasting using Bicycle-GAN and Graph Attention Networkscited by 228
- 2018Convolutional Social Pooling for Vehicle Trajectory Predictioncited by 221
- 2020Spatio-Temporal Graph Transformer Networks for Pedestrian Trajectory Predictioncited by 218
- 2020Transformer Networks for Trajectory Forecastingcited by 180
- 2019The inD Dataset: A Drone Dataset of Naturalistic Road User Trajectories at German Intersectionscited by 137
9 more
- 2019Multi-Agent Tensor Fusion for Contextual Trajectory Predictioncited by 131
- 2019SR-LSTM: State Refinement for LSTM towards Pedestrian Trajectory Predictioncited by 111
- 2019Graph Neural Networks for Modelling Traffic Participant Interactioncited by 42
- 2018Scene-LSTM: A Model for Human Trajectory Predictioncited by 24
- 2017A Data-driven Model for Interaction-aware Pedestrian Motion Prediction in Object Cluttered Environmentscited by 23
- 2020AMENet: Attentive Maps Encoder Network for Trajectory Predictioncited by 17
- 2020Exploring Dynamic Context for Multi-path Trajectory Predictioncited by 14
- 2021Video action recognition for lane-change classification and prediction of surrounding vehiclescited by 14
- 2020Vehicle Trajectory Prediction in Crowded Highway Scenarios Using Bird Eye View Representations and CNNscited by 4
Built on by
Citing papers per year: 2022: 3; 2023: 2; 2024: 3; 2025: 1.
9 papers.
- 2022On Transforming Reinforcement Learning by Transformer: The Development Trajectorycited by 35
- 2023The Integration of Prediction and Planning in Deep Learning Automated Driving Systems: A Reviewcited by 29
- 2023Machine Learning for Autonomous Vehicle's Trajectory Prediction: A comprehensive survey, Challenges, and Future Research Directionscited by 23
- 2022Addressing Optimism Bias in Sequence Modeling for Reinforcement Learningcited by 22
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directionscited by 14
- 2022ParkPredict+: Multimodal Intent and Motion Prediction for Vehicles in Parking Lots with CNN and Transformercited by 13
- 2024KI-GAN: Knowledge-Informed Generative Adversarial Networks for Enhanced Multi-Vehicle Trajectory Forecasting at Signalized Intersectionscited by 4
- 2024Toward Unified Practices in Trajectory Prediction Research on Bird's-Eye-View Datasetscited by 2
- 2024Encoding Agent Trajectories as Representations with Sequence Transformerscited by 0
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directions5 Mar 2025
- 2024Encoding Agent Trajectories as Representations with Sequence Transformers11 Oct 2024
- 2024Toward Unified Practices in Trajectory Prediction Research on Bird's-Eye-View Datasets1 May 2024
- 2024KI-GAN: Knowledge-Informed Generative Adversarial Networks for Enhanced Multi-Vehicle Trajectory Forecasting at Signalized Intersections17 Apr 2024
- 2023The Integration of Prediction and Planning in Deep Learning Automated Driving Systems: A Review10 Aug 2023
- 2023Machine Learning for Autonomous Vehicle's Trajectory Prediction: A comprehensive survey, Challenges, and Future Research Directions12 Jul 2023
- 2022On Transforming Reinforcement Learning by Transformer: The Development Trajectory29 Dec 2022
- 2022Addressing Optimism Bias in Sequence Modeling for Reinforcement Learning21 Jul 2022
- 2022ParkPredict+: Multimodal Intent and Motion Prediction for Vehicles in Parking Lots with CNN and Transformer17 Apr 2022