CRAT-Pred: Vehicle Trajectory Prediction with Crystal Graph Convolutional Neural Networks and Multi-Head Self-Attention
Not on the map. Why?
Abstract (arXiv)
Predicting the motion of surrounding vehicles is essential for autonomous vehicles, as it governs their own motion plan. Current state-of-the-art vehicle prediction models heavily rely on map information. In reality, however, this information is not always available. We therefore propose CRAT-Pred, a multi-modal and non-rasterization-based trajectory prediction model, specifically designed to effectively model social interactions between vehicles, without relying on map information. CRAT-Pred applies a graph convolution method originating from the field of material science to vehicle prediction, allowing to efficiently leverage edge features, and combines it with multi-head self-attention. Compared to other map-free approaches, the model achieves state-of-the-art performance with a significantly lower number of model parameters. In addition to that, we quantitatively show that the self-attention mechanism is able to learn social interactions between vehicles, with the weights representing a measurable interaction score. The source code is publicly available.
Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Builds on 23 of its 30 references that are in the map. First posted on arXiv 9 Feb 2022.
Builds on
23 of 30 references.
References · 23
- 2017Attention Is All You Needcited by 59,932
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2017Neural Message Passing for Quantum Chemistrycited by 3,460
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
- 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 728
- 2020VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representationcited by 528
- 2019MultiPath: Multiple Probabilistic Anchor Trajectory Hypotheses for Behavior Predictioncited by 417
- 2020Learning Lane Graph Representations for Motion Forecastingcited by 380
- 2018Convolutional Social Pooling for Vehicle Trajectory Predictioncited by 221
- 2021Multimodal Motion Prediction with Stacked Transformerscited by 207
- 2019Multiple Futures Predictioncited by 178
11 more
- 2019Rules of the Road: Predicting Driving Behavior with a Convolutional Model of Semantic Interactionscited by 117
- 2020Implicit Latent Variable Model for Scene-Consistent Motion Forecastingcited by 116
- 2021LaneRCNN: Distributed Representations for Graph-Centric Motion Forecastingcited by 112
- 2018TrafficPredict: Trajectory Prediction for Heterogeneous Traffic-Agentscited by 111
- 2021TPCN: Temporal Point Cloud Networks for Motion Forecastingcited by 94
- 2018Uncertainty-aware Short-term Motion Prediction of Traffic Actors for Autonomous Drivingcited by 90
- 2019Multi-Head Attention for Multi-Modal Joint Vehicle Motion Forecastingcited by 87
- 2020What-If Motion Prediction for Autonomous Drivingcited by 80
- 2019What the Constant Velocity Model Can Teach Us About Pedestrian Motion Predictioncited by 78
- 2021LaPred: Lane-Aware Prediction of Multi-Modal Future Trajectories of Dynamic Agentscited by 64
- 2020Social-WaGDAT: Interaction-aware Trajectory Prediction via Wasserstein Graph Double-Attention Networkcited by 14
Built on by
Citing papers per year: 2022: 2; 2023: 10; 2024: 5; 2025: 2; 2026: 2.
21 papers.
Sort:
By area:
- 2023The Integration of Prediction and Planning in Deep Learning Automated Driving Systems: A Reviewcited by 29
- 2023SCENE: Reasoning about Traffic Scenes using Heterogeneous Graph Neural Networkscited by 18
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directionscited by 14
- 2022Spatial-Temporal-Aware Safe Multi-Agent Reinforcement Learning of Connected Autonomous Vehicles in Challenging Scenarioscited by 12
- 2024GenAI-powered Multi-Agent Paradigm for Smart Urban Mobility: Opportunities and Challenges for Integrating Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) with Intelligent Transportation Systemscited by 9
- 2023Trajectory Prediction with Observations of Variable-Length for Motion Planning in Highway Merging scenarioscited by 6
- 2023Exploring Navigation Maps for Learning-Based Motion Predictioncited by 5
- 2023KI-PMF: Knowledge Integrated Plausible Motion Forecastingcited by 5
- 2023RESET: Revisiting Trajectory Sets for Conditional Behavior Predictioncited by 4
- 2022MEAT: Maneuver Extraction from Agent Trajectoriescited by 3
- 2023Enhancing Mapless Trajectory Prediction through Knowledge Distillationcited by 3
- 2023Efficient Baselines for Motion Prediction in Autonomous Drivingcited by 3
9 more
- 2024FollowGen: A Scaled Noise Conditional Diffusion Model for Car-Following Trajectory Predictioncited by 3
- 2023A Fast and Map-Free Model for Trajectory Prediction in Trafficscited by 2
- 2024Fast and Efficient Transformer-based Method for Bird's Eye View Instance Predictioncited by 2
- 2023LMR: Lane Distance-Based Metric for Trajectory Predictioncited by 1
- 2024Deep Attention Driven Reinforcement Learning (DAD-RL) for Autonomous Decision-Making in Dynamic Environmentcited by 1
- 2024Map-Free Trajectory Prediction with Map Distillation and Hierarchical Encodingcited by 1
- 2026BEVPredFormer: Spatio-temporal Attention for BEV Instance Prediction in Autonomous Drivingcited by 1
- 2025BEVTraj: Map-Free End-to-End Trajectory Prediction in Bird's-Eye View with Deformable Attention and Sparse Goal Proposalscited by 0
- 2026Integrating Specialized and Generic Agent Motion Prediction with Dynamic Occupancy Grid Mapscited by 0
- 2026BEVPredFormer: Spatio-temporal Attention for BEV Instance Prediction in Autonomous Driving3 Apr 2026
- 2026Integrating Specialized and Generic Agent Motion Prediction with Dynamic Occupancy Grid Maps8 Feb 2026
- 2025BEVTraj: Map-Free End-to-End Trajectory Prediction in Bird's-Eye View with Deformable Attention and Sparse Goal Proposals12 Sep 2025
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directions5 Mar 2025
- 2024FollowGen: A Scaled Noise Conditional Diffusion Model for Car-Following Trajectory Prediction23 Nov 2024
- 2024Map-Free Trajectory Prediction with Map Distillation and Hierarchical Encoding17 Nov 2024
- 2024Fast and Efficient Transformer-based Method for Bird's Eye View Instance Prediction11 Nov 2024
- 2024GenAI-powered Multi-Agent Paradigm for Smart Urban Mobility: Opportunities and Challenges for Integrating Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) with Intelligent Transportation Systems31 Aug 2024
- 2024Deep Attention Driven Reinforcement Learning (DAD-RL) for Autonomous Decision-Making in Dynamic Environment12 Jul 2024
- 2023KI-PMF: Knowledge Integrated Plausible Motion Forecasting18 Oct 2023
- 2023Efficient Baselines for Motion Prediction in Autonomous Driving6 Sep 2023
- 2023The Integration of Prediction and Planning in Deep Learning Automated Driving Systems: A Review10 Aug 2023
9 more
- 2023A Fast and Map-Free Model for Trajectory Prediction in Traffics19 Jul 2023
- 2023Enhancing Mapless Trajectory Prediction through Knowledge Distillation25 Jun 2023
- 2023Trajectory Prediction with Observations of Variable-Length for Motion Planning in Highway Merging scenarios8 Jun 2023
- 2023LMR: Lane Distance-Based Metric for Trajectory Prediction12 Apr 2023
- 2023RESET: Revisiting Trajectory Sets for Conditional Behavior Prediction12 Apr 2023
- 2023Exploring Navigation Maps for Learning-Based Motion Prediction13 Feb 2023
- 2023SCENE: Reasoning about Traffic Scenes using Heterogeneous Graph Neural Networks9 Jan 2023
- 2022Spatial-Temporal-Aware Safe Multi-Agent Reinforcement Learning of Connected Autonomous Vehicles in Challenging Scenarios5 Oct 2022
- 2022MEAT: Maneuver Extraction from Agent Trajectories10 Jun 2022
- 2023The Integration of Prediction and Planning in Deep Learning Automated Driving Systems: A Reviewcited by 29
- 2023SCENE: Reasoning about Traffic Scenes using Heterogeneous Graph Neural Networkscited by 18
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directionscited by 14
- 2023Trajectory Prediction with Observations of Variable-Length for Motion Planning in Highway Merging scenarioscited by 6
- 2023Exploring Navigation Maps for Learning-Based Motion Predictioncited by 5
- 2023KI-PMF: Knowledge Integrated Plausible Motion Forecastingcited by 5
- 2023RESET: Revisiting Trajectory Sets for Conditional Behavior Predictioncited by 4
- 2022MEAT: Maneuver Extraction from Agent Trajectoriescited by 3
- 2023Enhancing Mapless Trajectory Prediction through Knowledge Distillationcited by 3
- 2023A Fast and Map-Free Model for Trajectory Prediction in Trafficscited by 2
- 2024Fast and Efficient Transformer-based Method for Bird's Eye View Instance Predictioncited by 2
- 2023LMR: Lane Distance-Based Metric for Trajectory Predictioncited by 1
12 most cited of 17 All 17 (JSON)
- 2026BEVPredFormer: Spatio-temporal Attention for BEV Instance Prediction in Autonomous Driving3 Apr 2026
- 2026Integrating Specialized and Generic Agent Motion Prediction with Dynamic Occupancy Grid Maps8 Feb 2026
- 2025BEVTraj: Map-Free End-to-End Trajectory Prediction in Bird's-Eye View with Deformable Attention and Sparse Goal Proposals12 Sep 2025
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directions5 Mar 2025
- 2024Map-Free Trajectory Prediction with Map Distillation and Hierarchical Encoding17 Nov 2024
- 2024Fast and Efficient Transformer-based Method for Bird's Eye View Instance Prediction11 Nov 2024
- 2024Deep Attention Driven Reinforcement Learning (DAD-RL) for Autonomous Decision-Making in Dynamic Environment12 Jul 2024
- 2023KI-PMF: Knowledge Integrated Plausible Motion Forecasting18 Oct 2023
- 2023The Integration of Prediction and Planning in Deep Learning Automated Driving Systems: A Review10 Aug 2023
- 2023A Fast and Map-Free Model for Trajectory Prediction in Traffics19 Jul 2023
- 2023Enhancing Mapless Trajectory Prediction through Knowledge Distillation25 Jun 2023
- 2023Trajectory Prediction with Observations of Variable-Length for Motion Planning in Highway Merging scenarios8 Jun 2023
12 newest of 17 All 17 (JSON)