Trajectory Prediction with Graph-based Dual-scale Context Fusion
Not on the map. Why?
Abstract (arXiv)
Motion prediction for traffic participants is essential for a safe and robust automated driving system, especially in cluttered urban environments. However, it is highly challenging due to the complex road topology as well as the uncertain intentions of the other agents. In this paper, we present a graph-based trajectory prediction network named the Dual Scale Predictor (DSP), which encodes both the static and dynamical driving context in a hierarchical manner. Different from methods based on a rasterized map or sparse lane graph, we consider the driving context as a graph with two layers, focusing on both geometrical and topological features. Graph neural networks (GNNs) are applied to extract features with different levels of granularity, and features are subsequently aggregated with attention-based inter-layer networks, realizing better local-global feature fusion. Following the recent goal-driven trajectory prediction pipeline, goal candidates with high likelihood for the target agent are extracted, and predicted trajectories are generated conditioned on these goals. Thanks to the proposed dual-scale context fusion network, our DSP is able to generate accurate and human-like multi-modal trajectories. We evaluate the proposed method on the large-scale Argoverse motion forecasting benchmark, and it achieves promising results, outperforming the recent state-of-the-art methods.
Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). Builds on 38 of its 44 references that are in the map. First posted on arXiv 2 Nov 2021.
Builds on
38 of 44 references.
References · 38
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2016Layer Normalizationcited by 5,579
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
- 2015Multi-Scale Context Aggregation by Dilated Convolutionscited by 1,128
- 2018CornerNet: Detecting Objects as Paired Keypointscited by 763
26 more
- 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 728
- 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 687
- 2014Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFscited by 552
- 2021Large Scale Interactive Motion Forecasting for Autonomous Driving : The Waymo Open Motion Datasetcited by 532
- 2020VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representationcited by 528
- 2019MultiPath: Multiple Probabilistic Anchor Trajectory Hypotheses for Behavior Predictioncited by 417
- 2020Learning Lane Graph Representations for Motion Forecastingcited by 380
- 2020TNT: Target-driveN Trajectory Predictioncited by 345
- 2017DESIRE: Distant Future Prediction in Dynamic Scenes with Interacting Agentscited by 310
- 2021DenseTNT: End-to-end Trajectory Prediction from Dense Goal Setscited by 292
- 2018Multimodal Trajectory Predictions for Autonomous Driving using Deep Convolutional Networkscited by 289
- 2019CoverNet: Multimodal Behavior Prediction using Trajectory Setscited by 259
- 2020It Is Not the Journey but the Destination: Endpoint Conditioned Trajectory Predictioncited by 235
- 2019Human Motion Trajectory Prediction: A Surveycited by 231
- 2018Convolutional Social Pooling for Vehicle Trajectory Predictioncited by 221
- 2021Multimodal Motion Prediction with Stacked Transformerscited by 207
- 2017Social Attention: Modeling Attention in Human Crowdscited by 185
- 2021GOHOME: Graph-Oriented Heatmap Output for future Motion Estimationcited by 146
- 2019Multi-Agent Tensor Fusion for Contextual Trajectory Predictioncited by 131
- 2021HOME: Heatmap Output for future Motion Estimationcited by 122
- 2021LaneRCNN: Distributed Representations for Graph-Centric Motion Forecastingcited by 112
- 2021Learning to Predict Vehicle Trajectories with Model-based Planningcited by 63
- 2019Deep Learning-based Vehicle Behaviour Prediction For Autonomous Driving Applications: A Reviewcited by 31
- 2020Map-Adaptive Goal-Based Trajectory Predictioncited by 29
- 2020Probabilistic Multi-modal Trajectory Prediction with Lane Attention for Autonomous Vehiclescited by 28
- 2021EPSILON: An Efficient Planning System for Automated Vehicles in Highly Interactive Environmentscited by 22
Built on by
Citing papers per year: 2022: 2; 2023: 7; 2024: 3; 2025: 6; 2026: 1.
19 papers.
Sort:
By area:
- 2023Traj-MAE: Masked Autoencoders for Trajectory Predictioncited by 42
- 2023MacFormer: Map-Agent Coupled Transformer for Real-time and Robust Trajectory Predictioncited by 32
- 2024SIMPL: A Simple and Efficient Multi-agent Motion Prediction Baseline for Autonomous Drivingcited by 27
- 2023What Truly Matters in Trajectory Prediction for Autonomous Driving?cited by 17
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directionscited by 14
- 2024Motion Forecasting in Continuous Drivingcited by 11
- 2023BiFF: Bi-level Future Fusion with Polyline-based Coordinate for Interactive Trajectory Predictioncited by 8
- 2025GoIRL: Graph-Oriented Inverse Reinforcement Learning for Multimodal Trajectory Predictioncited by 7
- 2025Foresight in Motion: Reinforcing Trajectory Prediction with Reward Heuristicscited by 6
- 2023Geometric Deep Learning for Autonomous Driving: Unlocking the Power of Graph Neural Networks With CommonRoad-Geometriccited by 4
- 2025Future-Aware Interaction Network For Motion Forecastingcited by 4
- 2022Trajectory Forecasting on Temporal Graphscited by 3
7 more
- 2023FFINet: Future Feedback Interaction Network for Motion Forecastingcited by 3
- 2024ProIn: Learning to Predict Trajectory Based on Progressive Interactions for Autonomous Drivingcited by 3
- 2023A Fast and Map-Free Model for Trajectory Prediction in Trafficscited by 2
- 2022Improving Motion Forecasting for Autonomous Driving with the Cycle Consistency Losscited by 1
- 2025LANet: A Lane Boundaries-Aware Approach For Robust Trajectory Predictioncited by 1
- 2025ILNet: Trajectory Prediction with Inverse Learning Attention for Enhancing Intention Capturecited by 0
- 2026TaPD: Temporal-adaptive Progressive Distillation for Observation-Adaptive Trajectory Forecasting in Autonomous Drivingcited by 0
- 2026TaPD: Temporal-adaptive Progressive Distillation for Observation-Adaptive Trajectory Forecasting in Autonomous Driving6 Mar 2026
- 2025Foresight in Motion: Reinforcing Trajectory Prediction with Reward Heuristics16 Jul 2025
- 2025ILNet: Trajectory Prediction with Inverse Learning Attention for Enhancing Intention Capture9 Jul 2025
- 2025LANet: A Lane Boundaries-Aware Approach For Robust Trajectory Prediction2 Jul 2025
- 2025GoIRL: Graph-Oriented Inverse Reinforcement Learning for Multimodal Trajectory Prediction26 Jun 2025
- 2025Future-Aware Interaction Network For Motion Forecasting9 Mar 2025
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directions5 Mar 2025
- 2024Motion Forecasting in Continuous Driving8 Oct 2024
- 2024ProIn: Learning to Predict Trajectory Based on Progressive Interactions for Autonomous Driving25 Mar 2024
- 2024SIMPL: A Simple and Efficient Multi-agent Motion Prediction Baseline for Autonomous Driving4 Feb 2024
- 2023FFINet: Future Feedback Interaction Network for Motion Forecasting8 Nov 2023
- 2023MacFormer: Map-Agent Coupled Transformer for Real-time and Robust Trajectory Prediction20 Aug 2023
7 more
- 2023A Fast and Map-Free Model for Trajectory Prediction in Traffics19 Jul 2023
- 2023What Truly Matters in Trajectory Prediction for Autonomous Driving?27 Jun 2023
- 2023BiFF: Bi-level Future Fusion with Polyline-based Coordinate for Interactive Trajectory Prediction25 Jun 2023
- 2023Traj-MAE: Masked Autoencoders for Trajectory Prediction12 Mar 2023
- 2023Geometric Deep Learning for Autonomous Driving: Unlocking the Power of Graph Neural Networks With CommonRoad-Geometric2 Feb 2023
- 2022Improving Motion Forecasting for Autonomous Driving with the Cycle Consistency Loss31 Oct 2022
- 2022Trajectory Forecasting on Temporal Graphs1 Jul 2022
- 2025Future-Aware Interaction Network For Motion Forecastingcited by 4
- 2025Future-Aware Interaction Network For Motion Forecasting9 Mar 2025
- 2023Traj-MAE: Masked Autoencoders for Trajectory Predictioncited by 42
- 2023MacFormer: Map-Agent Coupled Transformer for Real-time and Robust Trajectory Predictioncited by 32
- 2024SIMPL: A Simple and Efficient Multi-agent Motion Prediction Baseline for Autonomous Drivingcited by 27
- 2023What Truly Matters in Trajectory Prediction for Autonomous Driving?cited by 17
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directionscited by 14
- 2024Motion Forecasting in Continuous Drivingcited by 11
- 2023BiFF: Bi-level Future Fusion with Polyline-based Coordinate for Interactive Trajectory Predictioncited by 8
- 2025Foresight in Motion: Reinforcing Trajectory Prediction with Reward Heuristicscited by 6
- 2023Geometric Deep Learning for Autonomous Driving: Unlocking the Power of Graph Neural Networks With CommonRoad-Geometriccited by 4
- 2022Trajectory Forecasting on Temporal Graphscited by 3
- 2023FFINet: Future Feedback Interaction Network for Motion Forecastingcited by 3
- 2024ProIn: Learning to Predict Trajectory Based on Progressive Interactions for Autonomous Drivingcited by 3
12 most cited of 17 All 17 (JSON)
- 2026TaPD: Temporal-adaptive Progressive Distillation for Observation-Adaptive Trajectory Forecasting in Autonomous Driving6 Mar 2026
- 2025Foresight in Motion: Reinforcing Trajectory Prediction with Reward Heuristics16 Jul 2025
- 2025ILNet: Trajectory Prediction with Inverse Learning Attention for Enhancing Intention Capture9 Jul 2025
- 2025LANet: A Lane Boundaries-Aware Approach For Robust Trajectory Prediction2 Jul 2025
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directions5 Mar 2025
- 2024Motion Forecasting in Continuous Driving8 Oct 2024
- 2024ProIn: Learning to Predict Trajectory Based on Progressive Interactions for Autonomous Driving25 Mar 2024
- 2024SIMPL: A Simple and Efficient Multi-agent Motion Prediction Baseline for Autonomous Driving4 Feb 2024
- 2023FFINet: Future Feedback Interaction Network for Motion Forecasting8 Nov 2023
- 2023MacFormer: Map-Agent Coupled Transformer for Real-time and Robust Trajectory Prediction20 Aug 2023
- 2023A Fast and Map-Free Model for Trajectory Prediction in Traffics19 Jul 2023
- 2023What Truly Matters in Trajectory Prediction for Autonomous Driving?27 Jun 2023
12 newest of 17 All 17 (JSON)