Multi-Head Attention for Multi-Modal Joint Vehicle Motion Forecasting
Not on the map. Why?
Abstract (arXiv)
This paper presents a novel vehicle motion forecasting method based on multi-head attention. It produces joint forecasts for all vehicles on a road scene as sequences of multi-modal probability density functions of their positions. Its architecture uses multi-head attention to account for complete interactions between all vehicles, and long short-term memory layers for encoding and forecasting. It relies solely on vehicle position tracks, does not need maneuver definitions, and does not represent the scene with a spatial grid. This allows it to be more versatile than similar model while combining any forecasting capabilities, namely joint forecast with interactions, uncertainty estimation, and multi-modality. The resulting prediction likelihood outperforms state-of-the-art models on the same dataset.
Key facts. Cited by 87 papers in the map (data through 13 Oct 2026). First posted on arXiv 8 Oct 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 15; 2022: 26; 2023: 21; 2024: 15; 2025: 6; 2026: 4.
87 papers.
Sort:
By area:
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 704
- 2022Wayformer: Motion Forecasting via Simple & Efficient Attention Networkscited by 280
- 2022Motion Transformer with Global Intention Localization and Local Movement Refinementcited by 269
- 2021Multimodal Motion Prediction with Stacked Transformerscited by 208
- 2021GOHOME: Graph-Oriented Heatmap Output for future Motion Estimationcited by 146
- 2023MTR++: Multi-Agent Motion Prediction with Symmetric Scene Modeling and Guided Intention Queryingcited by 140
- 2021HOME: Heatmap Output for future Motion Estimationcited by 122
- 2021LaneRCNN: Distributed Representations for Graph-Centric Motion Forecastingcited by 113
- 2021THOMAS: Trajectory Heatmap Output with learned Multi-Agent Samplingcited by 101
- 2021TPCN: Temporal Point Cloud Networks for Motion Forecastingcited by 94
- 2021Learning to Predict Vehicle Trajectories with Model-based Planningcited by 63
- 2022Occupancy Flow Fields for Motion Forecasting in Autonomous Drivingcited by 62
38 more
- 2022GANet: Goal Area Network for Motion Forecastingcited by 49
- 2023Leveraging Future Relationship Reasoning for Vehicle Trajectory Predictioncited by 48
- 2022Hierarchical Model-Based Imitation Learning for Planning in Autonomous Drivingcited by 43
- 2022JFP: Joint Future Prediction with Interactive Multi-Agent Modeling for Autonomous Drivingcited by 40
- 2023ADAPT: Efficient Multi-Agent Trajectory Prediction with Adaptationcited by 40
- 2022SSL-Lanes: Self-Supervised Learning for Motion Forecasting in Autonomous Drivingcited by 32
- 2023The Integration of Prediction and Planning in Deep Learning Automated Driving Systems: A Reviewcited by 29
- 2023Data-driven Traffic Simulation: A Comprehensive Reviewcited by 29
- 2023Dynamic Scenario Representation Learning for Motion Forecasting with Heterogeneous Graph Convolutional Recurrent Networkscited by 28
- 2023WOMD-LiDAR: Raw Sensor Dataset Benchmark for Motion Forecastingcited by 28
- 2022Deep Interactive Motion Prediction and Planning: Playing Games with Motion Prediction Modelscited by 27
- 2023SEPT: Towards Efficient Scene Representation Learning for Motion Predictioncited by 27
- 2022Bootstrap Motion Forecasting With Self-Consistent Constraintscited by 23
- 2023Machine Learning for Autonomous Vehicle's Trajectory Prediction: A comprehensive survey, Challenges, and Future Research Directionscited by 23
- 2022End-to-End Trajectory Distribution Prediction Based on Occupancy Grid Mapscited by 22
- 2022CRAT-Pred: Vehicle Trajectory Prediction with Crystal Graph Convolutional Neural Networks and Multi-Head Self-Attentioncited by 21
- 2021Heterogeneous-Agent Trajectory Forecasting Incorporating Class Uncertaintycited by 19
- 2025Scaling Laws of Motion Forecasting and Planning -- Technical Reportcited by 19
- 2022Control-Aware Prediction Objectives for Autonomous Drivingcited by 18
- 2021Collaborative Uncertainty in Multi-Agent Trajectory Forecastingcited by 17
- 2022Embedding Synthetic Off-Policy Experience for Autonomous Driving via Zero-Shot Curriculacited by 17
- 2023EDA: Evolving and Distinct Anchors for Multimodal Motion Predictioncited by 17
- 2021DeepTrack: Lightweight Deep Learning for Vehicle Path Prediction in Highwayscited by 16
- 2023A Diffusion-Model of Joint Interactive Navigationcited by 16
- 2022StopNet: Scalable Trajectory and Occupancy Prediction for Urban Autonomous Drivingcited by 14
- 2023Scene Informer: Anchor-based Occlusion Inference and Trajectory Prediction in Partially Observable Environmentscited by 14
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directionscited by 14
- 2021Trajectory Prediction with Linguistic Representationscited by 13
- 2022Concept Graph Neural Networks for Surgical Video Understandingcited by 13
- 2022Uncertainty estimation for Cross-dataset performance in Trajectory predictioncited by 13
- 2023IPCC-TP: Utilizing Incremental Pearson Correlation Coefficient for Joint Multi-Agent Trajectory Predictioncited by 13
- 2024AMP: Autoregressive Motion Prediction Revisited with Next Token Prediction for Autonomous Drivingcited by 13
- 2021Decoder Fusion RNN: Context and Interaction Aware Decoders for Trajectory Predictioncited by 12
- 2022RAP: Risk-Aware Prediction for Robust Planningcited by 12
- 2024MFTraj: Map-Free, Behavior-Driven Trajectory Prediction for Autonomous Drivingcited by 12
- 2024SemanticFormer: Holistic and Semantic Traffic Scene Representation for Trajectory Prediction using Knowledge Graphscited by 11
- 2022TAE: A Semi-supervised Controllable Behavior-aware Trajectory Generator and Predictorcited by 10
- 2022Narrowing the Coordinate-frame Gap in Behavior Prediction Models: Distillation for Efficient and Accurate Scene-centric Motion Forecastingcited by 10
50 most cited of 87 All 87 (JSON)
- 2026Chatting about Conditional Trajectory Prediction20 Apr 2026
- 2026Learning Humanoid Navigation from Human Data1 Apr 2026
- 2026Recover to Predict: Progressive Retrospective Learning for Variable-Length Trajectory Prediction11 Mar 2026
- 2026Streaming Real-Time Trajectory Prediction Using Endpoint-Aware Modeling2 Mar 2026
- 2025Autoregressive Flow Matching for Motion Prediction27 Dec 2025
- 2025VFSI: Validity First Spatial Intelligence for Constraint-Guided Traffic Diffusion28 Sep 2025
- 2025Scaling Laws of Motion Forecasting and Planning -- Technical Report9 Jun 2025
- 2025Dynamic Intent Queries for Motion Transformer-based Trajectory Prediction22 Apr 2025
- 2025Future-Aware Interaction Network For Motion Forecasting9 Mar 2025
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directions5 Mar 2025
- 2024ModeSeq: Taming Sparse Multimodal Motion Prediction with Sequential Mode Modeling17 Nov 2024
- 2024Fast and Efficient Transformer-based Method for Bird's Eye View Instance Prediction11 Nov 2024
38 more
- 2024Efficient Motion Prediction: A Lightweight & Accurate Trajectory Prediction Model With Fast Training and Inference Speed24 Sep 2024
- 2024SceneMotion: From Agent-Centric Embeddings to Scene-Wide Forecasts2 Aug 2024
- 2024Conformal Trajectory Prediction with Multi-View Data Integration in Cooperative Driving1 Aug 2024
- 2024FutureNet-LOF: Joint Trajectory Prediction and Lane Occupancy Field Prediction with Future Context Encoding20 Jun 2024
- 2024A Structure-Aware Lane Graph Transformer Model for Vehicle Trajectory Prediction30 May 2024
- 2024MFTraj: Map-Free, Behavior-Driven Trajectory Prediction for Autonomous Driving2 May 2024
- 2024Toward Unified Practices in Trajectory Prediction Research on Bird's-Eye-View Datasets1 May 2024
- 2024SemanticFormer: Holistic and Semantic Traffic Scene Representation for Trajectory Prediction using Knowledge Graphs30 Apr 2024
- 2024MAP-Former: Multi-Agent-Pair Gaussian Joint Prediction30 Apr 2024
- 2024Scaling Motion Forecasting Models with Ensemble Distillation5 Apr 2024
- 2024EgoNav: Egocentric Scene-aware Human Trajectory Prediction27 Mar 2024
- 2024Hierarchical Light Transformer Ensembles for Multimodal Trajectory Forecasting26 Mar 2024
- 2024AMP: Autoregressive Motion Prediction Revisited with Next Token Prediction for Autonomous Driving20 Mar 2024
- 2023EDA: Evolving and Distinct Anchors for Multimodal Motion Prediction15 Dec 2023
- 2023Data-driven Traffic Simulation: A Comprehensive Review24 Oct 2023
- 2023CRITERIA: a New Benchmarking Paradigm for Evaluating Trajectory Prediction Models for Autonomous Driving11 Oct 2023
- 2023SEPT: Towards Efficient Scene Representation Learning for Motion Prediction26 Sep 2023
- 2023Scene Informer: Anchor-based Occlusion Inference and Trajectory Prediction in Partially Observable Environments25 Sep 2023
- 2023A Diffusion-Model of Joint Interactive Navigation21 Sep 2023
- 2023Efficient Baselines for Motion Prediction in Autonomous Driving6 Sep 2023
- 2023The Integration of Prediction and Planning in Deep Learning Automated Driving Systems: A Review10 Aug 2023
- 2023ADAPT: Efficient Multi-Agent Trajectory Prediction with Adaptation26 Jul 2023
- 2023Machine Learning for Autonomous Vehicle's Trajectory Prediction: A comprehensive survey, Challenges, and Future Research Directions12 Jul 2023
- 2023MTR++: Multi-Agent Motion Prediction with Symmetric Scene Modeling and Guided Intention Querying30 Jun 2023
- 2023BiFF: Bi-level Future Fusion with Polyline-based Coordinate for Interactive Trajectory Prediction25 Jun 2023
- 2023TOFG: A Unified and Fine-Grained Environment Representation in Autonomous Driving31 May 2023
- 2023Leveraging Future Relationship Reasoning for Vehicle Trajectory Prediction24 May 2023
- 2023A Multidimensional Graph Fourier Transformation Neural Network for Vehicle Trajectory Prediction12 May 2023
- 2023WOMD-LiDAR: Raw Sensor Dataset Benchmark for Motion Forecasting7 Apr 2023
- 2023Multimodal Manoeuvre and Trajectory Prediction for Automated Driving on Highways Using Transformer Networks28 Mar 2023
- 2023Dynamic Scenario Representation Learning for Motion Forecasting with Heterogeneous Graph Convolutional Recurrent Networks8 Mar 2023
- 2023IPCC-TP: Utilizing Incremental Pearson Correlation Coefficient for Joint Multi-Agent Trajectory Prediction1 Mar 2023
- 2023Holistic Graph-based Motion Prediction31 Jan 2023
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecasting2 Jan 2023
- 2022JFP: Joint Future Prediction with Interactive Multi-Agent Modeling for Autonomous Driving16 Dec 2022
- 2022Embedding Synthetic Off-Policy Experience for Autonomous Driving via Zero-Shot Curricula2 Dec 2022
- 2022Conditional Goal-oriented Trajectory Prediction for Interacting Vehicles with Vectorized Representation19 Oct 2022
- 2022Hierarchical Model-Based Imitation Learning for Planning in Autonomous Driving18 Oct 2022
50 newest of 87 All 87 (JSON)
- 2022Hierarchical Model-Based Imitation Learning for Planning in Autonomous Drivingcited by 43
- 2022JFP: Joint Future Prediction with Interactive Multi-Agent Modeling for Autonomous Drivingcited by 40
- 2023Machine Learning for Autonomous Vehicle's Trajectory Prediction: A comprehensive survey, Challenges, and Future Research Directionscited by 23
- 2022Control-Aware Prediction Objectives for Autonomous Drivingcited by 18
- 2022Embedding Synthetic Off-Policy Experience for Autonomous Driving via Zero-Shot Curriculacited by 17
- 2022DiPA: Probabilistic Multi-Modal Interactive Prediction for Autonomous Drivingcited by 5
- 2023Efficient Baselines for Motion Prediction in Autonomous Drivingcited by 3
- 2024Conformal Trajectory Prediction with Multi-View Data Integration in Cooperative Drivingcited by 3
- 2024Conformal Trajectory Prediction with Multi-View Data Integration in Cooperative Driving1 Aug 2024
- 2023Efficient Baselines for Motion Prediction in Autonomous Driving6 Sep 2023
- 2023Machine Learning for Autonomous Vehicle's Trajectory Prediction: A comprehensive survey, Challenges, and Future Research Directions12 Jul 2023
- 2022JFP: Joint Future Prediction with Interactive Multi-Agent Modeling for Autonomous Driving16 Dec 2022
- 2022Embedding Synthetic Off-Policy Experience for Autonomous Driving via Zero-Shot Curricula2 Dec 2022
- 2022Hierarchical Model-Based Imitation Learning for Planning in Autonomous Driving18 Oct 2022
- 2022DiPA: Probabilistic Multi-Modal Interactive Prediction for Autonomous Driving12 Oct 2022
- 2022Control-Aware Prediction Objectives for Autonomous Driving28 Apr 2022
- 2025Autoregressive Flow Matching for Motion Prediction27 Dec 2025
- 2025VFSI: Validity First Spatial Intelligence for Constraint-Guided Traffic Diffusion28 Sep 2025
- 2024EgoNav: Egocentric Scene-aware Human Trajectory Prediction27 Mar 2024
- 2023A Diffusion-Model of Joint Interactive Navigation21 Sep 2023
- 2025Future-Aware Interaction Network For Motion Forecastingcited by 4
- 2025Future-Aware Interaction Network For Motion Forecasting9 Mar 2025
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 704
- 2021Multimodal Motion Prediction with Stacked Transformerscited by 208
- 2021GOHOME: Graph-Oriented Heatmap Output for future Motion Estimationcited by 146
- 2023MTR++: Multi-Agent Motion Prediction with Symmetric Scene Modeling and Guided Intention Queryingcited by 140
- 2021HOME: Heatmap Output for future Motion Estimationcited by 122
- 2021LaneRCNN: Distributed Representations for Graph-Centric Motion Forecastingcited by 113
- 2021THOMAS: Trajectory Heatmap Output with learned Multi-Agent Samplingcited by 101
- 2021TPCN: Temporal Point Cloud Networks for Motion Forecastingcited by 94
- 2021Learning to Predict Vehicle Trajectories with Model-based Planningcited by 63
- 2022Occupancy Flow Fields for Motion Forecasting in Autonomous Drivingcited by 62
- 2022GANet: Goal Area Network for Motion Forecastingcited by 49
- 2023Leveraging Future Relationship Reasoning for Vehicle Trajectory Predictioncited by 48
12 most cited of 72 All 72 (JSON)
- 2026Chatting about Conditional Trajectory Prediction20 Apr 2026
- 2026Learning Humanoid Navigation from Human Data1 Apr 2026
- 2026Recover to Predict: Progressive Retrospective Learning for Variable-Length Trajectory Prediction11 Mar 2026
- 2026Streaming Real-Time Trajectory Prediction Using Endpoint-Aware Modeling2 Mar 2026
- 2025Scaling Laws of Motion Forecasting and Planning -- Technical Report9 Jun 2025
- 2025Dynamic Intent Queries for Motion Transformer-based Trajectory Prediction22 Apr 2025
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directions5 Mar 2025
- 2024ModeSeq: Taming Sparse Multimodal Motion Prediction with Sequential Mode Modeling17 Nov 2024
- 2024Fast and Efficient Transformer-based Method for Bird's Eye View Instance Prediction11 Nov 2024
- 2024Efficient Motion Prediction: A Lightweight & Accurate Trajectory Prediction Model With Fast Training and Inference Speed24 Sep 2024
- 2024SceneMotion: From Agent-Centric Embeddings to Scene-Wide Forecasts2 Aug 2024
- 2024FutureNet-LOF: Joint Trajectory Prediction and Lane Occupancy Field Prediction with Future Context Encoding20 Jun 2024
12 newest of 72 All 72 (JSON)