Anomaly Detection in Multi-Agent Trajectories for Automated Driving
Not on the map. Why?
Abstract (arXiv)
Human drivers can recognise fast abnormal driving situations to avoid accidents. Similar to humans, automated vehicles are supposed to perform anomaly detection. In this work, we propose the spatio-temporal graph auto-encoder for learning normal driving behaviours. Our innovation is the ability to jointly learn multiple trajectories of a dynamic number of agents. To perform anomaly detection, we first estimate a density function of the learned trajectory feature representation and then detect anomalies in low-density regions. Due to the lack of multi-agent trajectory datasets for anomaly detection in automated driving, we introduce our dataset using a driving simulator for normal and abnormal manoeuvres. Our evaluations show that our approach learns the relation between different agents and delivers promising results compared to the related works. The code, simulation and the dataset are publicly available on https://github.com/againerju/maad_highway.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 27 of its 51 references that are in the map. First posted on arXiv 15 Oct 2021.
Builds on
27 of 51 references.
References · 27
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
- 2016OpenAI Gymcited by 1,684
- 2018Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognitioncited by 1,199
- 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 687
- 2016Temporal Convolutional Networks for Action Segmentation and Detectioncited by 504
- 2017Future Frame Prediction for Anomaly Detection -- A New Baselinecited by 391
- 2020Social-STGCNN: A Social Spatio-Temporal Graph Convolutional Neural Network for Human Trajectory Predictioncited by 324
- 2017DESIRE: Distant Future Prediction in Dynamic Scenes with Interacting Agentscited by 310
- 2018SoPhie: An Attentive GAN for Predicting Paths Compliant to Social and Physical Constraintscited by 296
- 2017A Multimodal Anomaly Detector for Robot-Assisted Feeding Using an LSTM-based Variational Autoencodercited by 209
15 more
- 2019Addressing Failure Prediction by Learning Model Confidencecited by 183
- 2019Multiple Futures Predictioncited by 178
- 2020Old is Gold: Redefining the Adversarially Learned One-Class Classifier Training Paradigmcited by 115
- 2019Learning Regularity in Skeleton Trajectories for Anomaly Detection in Videoscited by 103
- 2019What the Constant Velocity Model Can Teach Us About Pedestrian Motion Predictioncited by 78
- 2020Few-shot Scene-adaptive Anomaly Detectioncited by 62
- 2018The EuroCity Persons Dataset: A Novel Benchmark for Object Detectioncited by 56
- 2018Sequence-to-Sequence Prediction of Vehicle Trajectory via LSTM Encoder-Decoder Architecturecited by 55
- 2020Traffic Control Gesture Recognition for Autonomous Vehiclescited by 24
- 2021Deep Latent Competition: Learning to Race Using Visual Control Policies in Latent Spacecited by 20
- 2018Robustness to Out-of-Distribution Inputs via Task-Aware Generative Uncertaintycited by 14
- 2019Perceptual Attention-based Predictive Controlcited by 11
- 2020Multi-Modal Anomaly Detection for Unstructured and Uncertain Environmentscited by 11
- 2019DeepLocalization: Landmark-based Self-Localization with Deep Neural Networkscited by 9
- 2021Dual-Modality Vehicle Anomaly Detection via Bilateral Trajectory Tracingcited by 4
Built on by
Citing papers per year: 2022: 3; 2023: 3; 2024: 5; 2025: 2; 2026: 2.
15 papers.
Sort:
By area:
- 2024A Survey on Diffusion Models for Time Series and Spatio-Temporal Datacited by 66
- 2022Task-Relevant Failure Detection for Trajectory Predictors in Autonomous Vehiclescited by 11
- 2026Trajectory Guard -- A Lightweight, Sequence-Aware Model for Real-Time Anomaly Detection in Agentic AIcited by 10
- 2023Learning Representation for Anomaly Detection of Vehicle Trajectoriescited by 6
- 2024Multi-Agent Trajectory Prediction with Difficulty-Guided Feature Enhancement Networkcited by 6
- 2025AGENTS-LLM: Augmentative GENeration of Challenging Traffic Scenarios with an Agentic LLM Frameworkcited by 5
- 2022Conquering Ghosts: Relation Learning for Information Reliability Representation and End-to-End Robust Navigationcited by 3
- 2023Detecting Socially Abnormal Highway Driving Behaviors via Recurrent Graph Attention Networkscited by 3
- 2024Building Real-time Awareness of Out-of-distribution in Trajectory Prediction for Autonomous Vehiclescited by 3
- 2025Multi-Agent Reinforcement Learning in Intelligent Transportation Systems: A Comprehensive Surveycited by 2
- 2024Hybrid Video Anomaly Detection for Anomalous Scenarios in Autonomous Drivingcited by 1
- 2024ROAD-Waymo: A Large-Scale Action Awareness Dataset for Autonomous Drivingcited by 1
- 2026Forecasting the Past: Gradient-Based Distribution Shift Detection in Trajectory Prediction14 Apr 2026
- 2026Trajectory Guard -- A Lightweight, Sequence-Aware Model for Real-Time Anomaly Detection in Agentic AI2 Jan 2026
- 2025Multi-Agent Reinforcement Learning in Intelligent Transportation Systems: A Comprehensive Survey27 Aug 2025
- 2025AGENTS-LLM: Augmentative GENeration of Challenging Traffic Scenarios with an Agentic LLM Framework18 Jul 2025
- 2024ROAD-Waymo: A Large-Scale Action Awareness Dataset for Autonomous Driving3 Nov 2024
- 2024Building Real-time Awareness of Out-of-distribution in Trajectory Prediction for Autonomous Vehicles25 Sep 2024
- 2024Multi-Agent Trajectory Prediction with Difficulty-Guided Feature Enhancement Network26 Jul 2024
- 2024Hybrid Video Anomaly Detection for Anomalous Scenarios in Autonomous Driving10 Jun 2024
- 2024A Survey on Diffusion Models for Time Series and Spatio-Temporal Data29 Apr 2024
- 2023Detecting Socially Abnormal Highway Driving Behaviors via Recurrent Graph Attention Networks23 Apr 2023
- 2023Infrastructure-based End-to-End Learning and Prevention of Driver Failure21 Mar 2023
- 2023Learning Representation for Anomaly Detection of Vehicle Trajectories9 Mar 2023
3 more
- 2022Task-Relevant Failure Detection for Trajectory Predictors in Autonomous Vehicles25 Jul 2022
- 2022Asynchronous, Option-Based Multi-Agent Policy Gradient: A Conditional Reasoning Approach29 Mar 2022
- 2022Conquering Ghosts: Relation Learning for Information Reliability Representation and End-to-End Robust Navigation14 Mar 2022
- 2023Learning Representation for Anomaly Detection of Vehicle Trajectoriescited by 6
- 2024Multi-Agent Trajectory Prediction with Difficulty-Guided Feature Enhancement Networkcited by 6
- 2022Conquering Ghosts: Relation Learning for Information Reliability Representation and End-to-End Robust Navigationcited by 3
- 2023Detecting Socially Abnormal Highway Driving Behaviors via Recurrent Graph Attention Networkscited by 3
- 2024Building Real-time Awareness of Out-of-distribution in Trajectory Prediction for Autonomous Vehiclescited by 3
- 2025Multi-Agent Reinforcement Learning in Intelligent Transportation Systems: A Comprehensive Surveycited by 2
- 2024Hybrid Video Anomaly Detection for Anomalous Scenarios in Autonomous Drivingcited by 1
- 2024ROAD-Waymo: A Large-Scale Action Awareness Dataset for Autonomous Drivingcited by 1
- 2022Asynchronous, Option-Based Multi-Agent Policy Gradient: A Conditional Reasoning Approachcited by 0
- 2023Infrastructure-based End-to-End Learning and Prevention of Driver Failurecited by 0
- 2026Forecasting the Past: Gradient-Based Distribution Shift Detection in Trajectory Predictioncited by 0
- 2026Forecasting the Past: Gradient-Based Distribution Shift Detection in Trajectory Prediction14 Apr 2026
- 2025Multi-Agent Reinforcement Learning in Intelligent Transportation Systems: A Comprehensive Survey27 Aug 2025
- 2024ROAD-Waymo: A Large-Scale Action Awareness Dataset for Autonomous Driving3 Nov 2024
- 2024Building Real-time Awareness of Out-of-distribution in Trajectory Prediction for Autonomous Vehicles25 Sep 2024
- 2024Multi-Agent Trajectory Prediction with Difficulty-Guided Feature Enhancement Network26 Jul 2024
- 2024Hybrid Video Anomaly Detection for Anomalous Scenarios in Autonomous Driving10 Jun 2024
- 2023Detecting Socially Abnormal Highway Driving Behaviors via Recurrent Graph Attention Networks23 Apr 2023
- 2023Infrastructure-based End-to-End Learning and Prevention of Driver Failure21 Mar 2023
- 2023Learning Representation for Anomaly Detection of Vehicle Trajectories9 Mar 2023
- 2022Asynchronous, Option-Based Multi-Agent Policy Gradient: A Conditional Reasoning Approach29 Mar 2022
- 2022Conquering Ghosts: Relation Learning for Information Reliability Representation and End-to-End Robust Navigation14 Mar 2022