SSL-Interactions: Pretext Tasks for Interactive Trajectory Prediction
Not on the map. Why?
Abstract (arXiv)
This paper addresses motion forecasting in multi-agent environments, pivotal for ensuring safety of autonomous vehicles. Traditional as well as recent data-driven marginal trajectory prediction methods struggle to properly learn non-linear agent-to-agent interactions. We present SSL-Interactions that proposes pretext tasks to enhance interaction modeling for trajectory prediction. We introduce four interaction-aware pretext tasks to encapsulate various aspects of agent interactions: range gap prediction, closest distance prediction, direction of movement prediction, and type of interaction prediction. We further propose an approach to curate interaction-heavy scenarios from datasets. This curated data has two advantages: it provides a stronger learning signal to the interaction model, and facilitates generation of pseudo-labels for interaction-centric pretext tasks. We also propose three new metrics specifically designed to evaluate predictions in interactive scenes. Our empirical evaluations indicate SSL-Interactions outperforms state-of-the-art motion forecasting methods quantitatively with up to 8% improvement, and qualitatively, for interaction-heavy scenarios.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 17 of its 23 references that are in the map. First posted on arXiv 15 Jan 2024.
Builds on
17 of 23 references.
References · 17
- 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 728
- 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 687
- 2021Large Scale Interactive Motion Forecasting for Autonomous Driving : The Waymo Open Motion Datasetcited by 532
- 2020Learning Lane Graph Representations for Motion Forecastingcited by 380
- 2017A simple neural network module for relational reasoningcited by 345
- 2020Social-STGCNN: A Social Spatio-Temporal Graph Convolutional Neural Network for Human Trajectory Predictioncited by 324
- 2019Social-BiGAT: Multimodal Trajectory Forecasting using Bicycle-GAN and Graph Attention Networkscited by 228
- 2019Multiple Futures Predictioncited by 178
- 2020Implicit Latent Variable Model for Scene-Consistent Motion Forecastingcited by 116
- 2018Auxiliary Tasks in Multi-task Learningcited by 106
- 2019Spatially-Aware Graph Neural Networks for Relational Behavior Forecasting from Sensor Datacited by 104
- 2022M2I: From Factored Marginal Trajectory Prediction to Interactive Predictioncited by 81
5 more
- 2021Tell me why! Explanations support learning relational and causal structurecited by 36
- 2022Interaction Modeling with Multiplex Attentioncited by 14
- 2021Trajectory Prediction with Linguistic Representationscited by 13
- 2019Learning World Graphs to Accelerate Hierarchical Reinforcement Learningcited by 12
- 2022Domain Knowledge Driven Pseudo Labels for Interpretable Goal-Conditioned Interactive Trajectory Predictioncited by 9
Built on by
Citing papers per year: 2026: 1.
1 paper.