Social-Implicit: Rethinking Trajectory Prediction Evaluation and The Effectiveness of Implicit Maximum Likelihood Estimation
Not on the map. Why?
Abstract (arXiv)
Best-of-N (BoN) Average Displacement Error (ADE)/ Final Displacement Error (FDE) is the most used metric for evaluating trajectory prediction models. Yet, the BoN does not quantify the whole generated samples, resulting in an incomplete view of the model's prediction quality and performance. We propose a new metric, Average Mahalanobis Distance (AMD) to tackle this issue. AMD is a metric that quantifies how close the whole generated samples are to the ground truth. We also introduce the Average Maximum Eigenvalue (AMV) metric that quantifies the overall spread of the predictions. Our metrics are validated empirically by showing that the ADE/FDE is not sensitive to distribution shifts, giving a biased sense of accuracy, unlike the AMD/AMV metrics. We introduce the usage of Implicit Maximum Likelihood Estimation (IMLE) as a replacement for traditional generative models to train our model, Social-Implicit. IMLE training mechanism aligns with AMD/AMV objective of predicting trajectories that are close to the ground truth with a tight spread. Social-Implicit is a memory efficient deep model with only 5.8K parameters that runs in real time of about 580Hz and achieves competitive results. Interactive demo of the problem can be seen at https://www.abduallahmohamed.com/social-implicit-amdamv-adefde-demo . Code is available at https://github.com/abduallahmohamed/Social-Implicit .
Key facts. Cited by 40 papers in the map (data through 14 Oct 2026). Builds on 24 of its 45 references that are in the map. First posted on arXiv 6 Mar 2022.
Builds on
24 of 45 references.
References · 24
- 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 690
- 2019MultiPath: Multiple Probabilistic Anchor Trajectory Hypotheses for Behavior Predictioncited by 420
- 2020Learning Lane Graph Representations for Motion Forecastingcited by 382
- 2021AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent Forecastingcited by 331
- 2020Social-STGCNN: A Social Spatio-Temporal Graph Convolutional Neural Network for Human Trajectory Predictioncited by 325
- 2017DESIRE: Distant Future Prediction in Dynamic Scenes with Interacting Agentscited by 310
- 2018SoPhie: An Attentive GAN for Predicting Paths Compliant to Social and Physical Constraintscited by 298
- 2018Multimodal Trajectory Predictions for Autonomous Driving using Deep Convolutional Networkscited by 289
- 2019Human Motion Trajectory Prediction: A Surveycited by 232
- 2019Social-BiGAT: Multimodal Trajectory Forecasting using Bicycle-GAN and Graph Attention Networkscited by 229
- 2018Convolutional Social Pooling for Vehicle Trajectory Predictioncited by 221
- 2019PRECOG: PREdiction Conditioned On Goals in Visual Multi-Agent Settingscited by 179
12 more
- 2019Multiple Futures Predictioncited by 178
- 2020From Goals, Waypoints & Paths To Long Term Human Trajectory Forecastingcited by 167
- 2020MotionNet: Joint Perception and Motion Prediction for Autonomous Driving Based on Bird's Eye View Mapscited by 100
- 2019Social Ways: Learning Multi-Modal Distributions of Pedestrian Trajectories with GANscited by 79
- 2019GRIP++: Enhanced Graph-based Interaction-aware Trajectory Prediction for Autonomous Drivingcited by 73
- 2020Social NCE: Contrastive Learning of Socially-aware Motion Representationscited by 58
- 2018Implicit Maximum Likelihood Estimationcited by 52
- 2021On Exposing the Challenging Long Tail in Future Prediction of Traffic Actorscited by 48
- 2019DiversityGAN: Diversity-Aware Vehicle Motion Prediction via Latent Semantic Samplingcited by 40
- 2020DAG-Net: Double Attentive Graph Neural Network for Trajectory Forecastingcited by 30
- 2019Deep Neural Network Ensembles against Deception: Ensemble Diversity, Accuracy and Robustnesscited by 18
- 2016Robust Deep-Learning-Based Road-Prediction for Augmented Reality Navigation Systemscited by 1
Built on by
Citing papers per year: 2023: 12; 2024: 11; 2025: 12; 2026: 5.
40 papers.
Sort:
By area:
- 2023EigenTrajectory: Low-Rank Descriptors for Multi-Modal Trajectory Forecastingcited by 41
- 2023Fast Inference and Update of Probabilistic Density Estimation on Trajectory Predictioncited by 27
- 2024LG-Traj: LLM Guided Pedestrian Trajectory Predictioncited by 25
- 2025Unified Spatial-Temporal Edge-Enhanced Graph Networks for Pedestrian Trajectory Predictioncited by 13
- 2023Guiding Online Reinforcement Learning with Action-Free Offline Pretrainingcited by 11
- 2023Evaluating Pedestrian Trajectory Prediction Methods with Respect to Autonomous Drivingcited by 11
- 2023Social Motion Prediction with Cognitive Hierarchiescited by 9
- 2025BP-SGCN: Behavioral Pseudo-Label Informed Sparse Graph Convolution Network for Pedestrian and Heterogeneous Trajectory Predictioncited by 9
- 2023Vision-based Multi-future Trajectory Prediction: A Surveycited by 8
- 2023Best Practices for 2-Body Pose Forecastingcited by 8
- 2025Pedestrian Trajectory Prediction Based on Social Interactions Learning With Random Weightscited by 8
- 2024Risk-Aware Vehicle Trajectory Prediction Under Safety-Critical Scenarioscited by 7
28 more
- 2023Staged Contact-Aware Global Human Motion Forecastingcited by 6
- 2024MGF: Mixed Gaussian Flow for Diverse Trajectory Predictioncited by 6
- 2024Uncovering the human motion pattern: Pattern Memory-based Diffusion Model for Trajectory Predictioncited by 4
- 2024Understanding complex crowd dynamics with generative neural simulatorscited by 4
- 2023Discovering Intrinsic Spatial-Temporal Logic Rules to Explain Human Actionscited by 3
- 2023Sparse Pedestrian Character Learning for Trajectory Predictioncited by 3
- 2024Testing autonomous vehicles and AI: perspectives and challenges from cybersecurity, transparency, robustness and fairnesscited by 3
- 2024Context-aware Multi-task Learning for Pedestrian Intent and Trajectory Predictioncited by 3
- 2024Snapshot: Towards Application-centered Models for Pedestrian Trajectory Prediction in Urban Traffic Environmentscited by 3
- 2025Recent Advances in Multi-Agent Human Trajectory Prediction: A Comprehensive Reviewcited by 2
- 2025Uncertainty-aware Probabilistic 3D Human Motion Forecasting via Invertible Networkscited by 2
- 2025Floating-Body Hydrodynamic Neural Networkscited by 2
- 2023Spatial-Temporal Conditional Random Field for Human Trajectory Predictioncited by 1
- 2024Hyper-STTN: Hypergraph Augmented Spatial-Temporal Transformer Network for Trajectory Predictioncited by 1
- 2024iMotion-LLM: Instruction-Conditioned Trajectory Generationcited by 1
- 2024Pedestrian motion prediction evaluation for urban autonomous drivingcited by 1
- 2025An Analysis of Kalman Filter based Object Tracking Methods for Fast-Moving Tiny Objectscited by 1
- 2025Reverberation: Learning the Latencies Before Forecasting Trajectoriescited by 1
- 2026EgoTraj: Real-World Egocentric Human Trajectory Dataset for Multimodal Predictioncited by 1
- 2023FollowMe: Vehicle Behaviour Prediction in Autonomous Vehicle Settingscited by 0
- 2025A Spatio-temporal Graph Network Allowing Incomplete Trajectory Input for Pedestrian Trajectory Predictioncited by 0
- 2025An Efficient LiDAR-Camera Fusion Network for Multi-Class 3D Dynamic Object Detection and Trajectory Predictioncited by 0
- 2025Model Predictive Control for Crowd Navigation via Learning-Based Trajectory Predictioncited by 0
- 2025GContextFormer: A global context-aware hybrid multi-head attention approach with scaled additive aggregation for multimodal trajectory predictioncited by 0
- 2026Sparse Compositional Flow Matching by geometric assembly from motion primitivescited by 0
- 2026AIS-Based Vessel Trajectory Prediction Using Memory-Augmented Neural Networkscited by 0
- 2026Gaussian-Mixture Latent Flow for Stochastic 3D Human Motion Predictioncited by 0
- 2026MamMA: A Mamba-Based Pedestrian Trajectory Prediction Algorithm Considering Occupancy Map and Pedestrian Awareness Statescited by 0
- 2026MamMA: A Mamba-Based Pedestrian Trajectory Prediction Algorithm Considering Occupancy Map and Pedestrian Awareness States7 Sep 2026
- 2026Gaussian-Mixture Latent Flow for Stochastic 3D Human Motion Prediction21 Aug 2026
- 2026AIS-Based Vessel Trajectory Prediction Using Memory-Augmented Neural Networks4 Jun 2026
- 2026Sparse Compositional Flow Matching by geometric assembly from motion primitives22 May 2026
- 2026EgoTraj: Real-World Egocentric Human Trajectory Dataset for Multimodal Prediction18 May 2026
- 2025GContextFormer: A global context-aware hybrid multi-head attention approach with scaled additive aggregation for multimodal trajectory prediction24 Nov 2025
- 2025Reverberation: Learning the Latencies Before Forecasting Trajectories14 Nov 2025
- 2025An Analysis of Kalman Filter based Object Tracking Methods for Fast-Moving Tiny Objects22 Sep 2025
- 2025Floating-Body Hydrodynamic Neural Networks17 Sep 2025
- 2025Model Predictive Control for Crowd Navigation via Learning-Based Trajectory Prediction9 Aug 2025
- 2025Uncertainty-aware Probabilistic 3D Human Motion Forecasting via Invertible Networks19 Jul 2025
- 2025Recent Advances in Multi-Agent Human Trajectory Prediction: A Comprehensive Review13 Jun 2025
28 more
- 2025An Efficient LiDAR-Camera Fusion Network for Multi-Class 3D Dynamic Object Detection and Trajectory Prediction18 Apr 2025
- 2025BP-SGCN: Behavioral Pseudo-Label Informed Sparse Graph Convolution Network for Pedestrian and Heterogeneous Trajectory Prediction20 Feb 2025
- 2025Unified Spatial-Temporal Edge-Enhanced Graph Networks for Pedestrian Trajectory Prediction4 Feb 2025
- 2025A Spatio-temporal Graph Network Allowing Incomplete Trajectory Input for Pedestrian Trajectory Prediction22 Jan 2025
- 2025Pedestrian Trajectory Prediction Based on Social Interactions Learning With Random Weights13 Jan 2025
- 2024Understanding complex crowd dynamics with generative neural simulators2 Dec 2024
- 2024Pedestrian motion prediction evaluation for urban autonomous driving22 Oct 2024
- 2024Snapshot: Towards Application-centered Models for Pedestrian Trajectory Prediction in Urban Traffic Environments3 Sep 2024
- 2024Context-aware Multi-task Learning for Pedestrian Intent and Trajectory Prediction24 Jul 2024
- 2024Risk-Aware Vehicle Trajectory Prediction Under Safety-Critical Scenarios18 Jul 2024
- 2024iMotion-LLM: Instruction-Conditioned Trajectory Generation10 Jun 2024
- 2024LG-Traj: LLM Guided Pedestrian Trajectory Prediction12 Mar 2024
- 2024Testing autonomous vehicles and AI: perspectives and challenges from cybersecurity, transparency, robustness and fairness21 Feb 2024
- 2024MGF: Mixed Gaussian Flow for Diverse Trajectory Prediction19 Feb 2024
- 2024Hyper-STTN: Hypergraph Augmented Spatial-Temporal Transformer Network for Trajectory Prediction12 Jan 2024
- 2024Uncovering the human motion pattern: Pattern Memory-based Diffusion Model for Trajectory Prediction5 Jan 2024
- 2023Spatial-Temporal Conditional Random Field for Human Trajectory Prediction30 Nov 2023
- 2023Sparse Pedestrian Character Learning for Trajectory Prediction27 Nov 2023
- 2023Social Motion Prediction with Cognitive Hierarchies8 Nov 2023
- 2023Staged Contact-Aware Global Human Motion Forecasting16 Sep 2023
- 2023Fast Inference and Update of Probabilistic Density Estimation on Trajectory Prediction17 Aug 2023
- 2023Evaluating Pedestrian Trajectory Prediction Methods with Respect to Autonomous Driving9 Aug 2023
- 2023EigenTrajectory: Low-Rank Descriptors for Multi-Modal Trajectory Forecasting18 Jul 2023
- 2023Discovering Intrinsic Spatial-Temporal Logic Rules to Explain Human Actions21 Jun 2023
- 2023FollowMe: Vehicle Behaviour Prediction in Autonomous Vehicle Settings12 Apr 2023
- 2023Best Practices for 2-Body Pose Forecasting12 Apr 2023
- 2023Vision-based Multi-future Trajectory Prediction: A Survey21 Feb 2023
- 2023Guiding Online Reinforcement Learning with Action-Free Offline Pretraining30 Jan 2023
- 2023EigenTrajectory: Low-Rank Descriptors for Multi-Modal Trajectory Forecastingcited by 41
- 2023Fast Inference and Update of Probabilistic Density Estimation on Trajectory Predictioncited by 27
- 2024LG-Traj: LLM Guided Pedestrian Trajectory Predictioncited by 25
- 2025Unified Spatial-Temporal Edge-Enhanced Graph Networks for Pedestrian Trajectory Predictioncited by 13
- 2023Evaluating Pedestrian Trajectory Prediction Methods with Respect to Autonomous Drivingcited by 11
- 2025BP-SGCN: Behavioral Pseudo-Label Informed Sparse Graph Convolution Network for Pedestrian and Heterogeneous Trajectory Predictioncited by 9
- 2023Vision-based Multi-future Trajectory Prediction: A Surveycited by 8
- 2023Best Practices for 2-Body Pose Forecastingcited by 8
- 2025Pedestrian Trajectory Prediction Based on Social Interactions Learning With Random Weightscited by 8
- 2024Risk-Aware Vehicle Trajectory Prediction Under Safety-Critical Scenarioscited by 7
- 2023Staged Contact-Aware Global Human Motion Forecastingcited by 6
- 2024MGF: Mixed Gaussian Flow for Diverse Trajectory Predictioncited by 6
12 most cited of 36 All 36 (JSON)
- 2026MamMA: A Mamba-Based Pedestrian Trajectory Prediction Algorithm Considering Occupancy Map and Pedestrian Awareness States7 Sep 2026
- 2026Gaussian-Mixture Latent Flow for Stochastic 3D Human Motion Prediction21 Aug 2026
- 2026AIS-Based Vessel Trajectory Prediction Using Memory-Augmented Neural Networks4 Jun 2026
- 2026EgoTraj: Real-World Egocentric Human Trajectory Dataset for Multimodal Prediction18 May 2026
- 2025GContextFormer: A global context-aware hybrid multi-head attention approach with scaled additive aggregation for multimodal trajectory prediction24 Nov 2025
- 2025Reverberation: Learning the Latencies Before Forecasting Trajectories14 Nov 2025
- 2025An Analysis of Kalman Filter based Object Tracking Methods for Fast-Moving Tiny Objects22 Sep 2025
- 2025Floating-Body Hydrodynamic Neural Networks17 Sep 2025
- 2025Model Predictive Control for Crowd Navigation via Learning-Based Trajectory Prediction9 Aug 2025
- 2025Uncertainty-aware Probabilistic 3D Human Motion Forecasting via Invertible Networks19 Jul 2025
- 2025Recent Advances in Multi-Agent Human Trajectory Prediction: A Comprehensive Review13 Jun 2025
- 2025An Efficient LiDAR-Camera Fusion Network for Multi-Class 3D Dynamic Object Detection and Trajectory Prediction18 Apr 2025
12 newest of 36 All 36 (JSON)