Are socially-aware trajectory prediction models really socially-aware?
Not on the map. Why?
Abstract (arXiv)
Our field has recently witnessed an arms race of neural network-based trajectory predictors. While these predictors are at the core of many applications such as autonomous navigation or pedestrian flow simulations, their adversarial robustness has not been carefully studied. In this paper, we introduce a socially-attended attack to assess the social understanding of prediction models in terms of collision avoidance. An attack is a small yet carefully-crafted perturbations to fail predictors. Technically, we define collision as a failure mode of the output, and propose hard- and soft-attention mechanisms to guide our attack. Thanks to our attack, we shed light on the limitations of the current models in terms of their social understanding. We demonstrate the strengths of our method on the recent trajectory prediction models. Finally, we show that our attack can be employed to increase the social understanding of state-of-the-art models. The code is available online: https://s-attack.github.io/
Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). Builds on 29 of its 49 references that are in the map. First posted on arXiv 24 Aug 2021.
Builds on
29 of 49 references.
References · 29
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2013Intriguing properties of neural networkscited by 5,114
- 2015DeepFool: a simple and accurate method to fool deep neural networkscited by 1,315
- 2018Robustness May Be at Odds with Accuracycited by 873
- 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 687
- 2017One pixel attack for fooling deep neural networkscited by 579
- 2020Social-STGCNN: A Social Spatio-Temporal Graph Convolutional Neural Network for Human Trajectory Predictioncited by 324
- 2018SoPhie: An Attentive GAN for Predicting Paths Compliant to Social and Physical Constraintscited by 296
- 2021End-to-end Interpretable Neural Motion Plannercited by 240
- 2020It Is Not the Journey but the Destination: Endpoint Conditioned Trajectory Predictioncited by 235
- 2019Social-BiGAT: Multimodal Trajectory Forecasting using Bicycle-GAN and Graph Attention Networkscited by 228
17 more
- 2020Spatio-Temporal Graph Transformer Networks for Pedestrian Trajectory Predictioncited by 218
- 2017Social Attention: Modeling Attention in Human Crowdscited by 185
- 2020Human Trajectory Forecasting in Crowds: A Deep Learning Perspectivecited by 128
- 2016Decentralized Non-communicating Multiagent Collision Avoidance with Deep Reinforcement Learningcited by 104
- 2019Social Ways: Learning Multi-Modal Distributions of Pedestrian Trajectories with GANscited by 78
- 2019Adversarial Attacks on Deep Neural Networks for Time Series Classificationcited by 53
- 2019Adversarial Attacks on Time Seriescited by 40
- 2019Imperceptible Adversarial Attacks on Tabular Datacited by 35
- 2019Adversarial Attack on Skeleton-based Human Action Recognitioncited by 32
- 2017Context-Aware Trajectory Predictioncited by 31
- 2020Hold me tight! Influence of discriminative features on deep network boundariescited by 31
- 2021Injecting Knowledge in Data-driven Vehicle Trajectory Predictorscited by 18
- 2018An Evaluation of Trajectory Prediction Approaches and Notes on the TrajNet Benchmarkcited by 16
- 2020Pedestrian Intention Prediction: A Multi-task Perspectivecited by 16
- 2020Social-WaGDAT: Interaction-aware Trajectory Prediction via Wasserstein Graph Double-Attention Networkcited by 14
- 2019SafeCritic: Collision-Aware Trajectory Predictioncited by 3
- 2020MonStereo: When Monocular and Stereo Meet at the Tail of 3D Human Localizationcited by 1
Built on by
Citing papers per year: 2021: 3; 2022: 7; 2023: 11; 2024: 5; 2025: 4; 2026: 2.
32 papers.
Sort:
By area:
- 2022On Adversarial Robustness of Trajectory Prediction for Autonomous Vehiclescited by 89
- 2024UniTraj: A Unified Framework for Scalable Vehicle Trajectory Predictioncited by 51
- 2023Traj-MAE: Masked Autoencoders for Trajectory Predictioncited by 42
- 2021Vehicle trajectory prediction works, but not everywherecited by 39
- 2022A generic diffusion-based approach for 3D human pose prediction in the wildcited by 33
- 2023Social-Transmotion: Promptable Human Trajectory Predictioncited by 33
- 2024V2XPnP: Vehicle-to-Everything Spatio-Temporal Fusion for Multi-Agent Perception and Predictioncited by 31
- 2022Deep Interactive Motion Prediction and Planning: Playing Games with Motion Prediction Modelscited by 27
- 2022CausalAgents: A Robustness Benchmark for Motion Forecasting using Causal Relationshipscited by 18
- 2023Joint Metrics Matter: A Better Standard for Trajectory Forecastingcited by 17
- 2022Safety-compliant Generative Adversarial Networks for Human Trajectory Forecastingcited by 12
- 2022Motion Style Transfer: Modular Low-Rank Adaptation for Deep Motion Forecastingcited by 12
20 more
- 2022Pedestrian 3D Bounding Box Predictioncited by 11
- 2023Toward Reliable Human Pose Forecasting with Uncertaintycited by 11
- 2024Certified Human Trajectory Predictioncited by 6
- 2025Social-Pose: Enhancing Trajectory Prediction with Human Body Posecited by 5
- 2023JRDB-Traj: A Dataset and Benchmark for Trajectory Forecasting in Crowdscited by 4
- 2023Sim-to-Real Causal Transfer: A Metric Learning Approach to Causally-Aware Interaction Representationscited by 4
- 2024Testing autonomous vehicles and AI: perspectives and challenges from cybersecurity, transparency, robustness and fairnesscited by 3
- 2025Realistic Adversarial Attacks for Robustness Evaluation of Trajectory Prediction Models via Future State Perturbationcited by 3
- 2021SVG-Net: An SVG-based Trajectory Prediction Modelcited by 2
- 2021A Shared Representation for Photorealistic Driving Simulatorscited by 2
- 2025INTENT: Trajectory Prediction Framework with Intention-Guided Contrastive Clusteringcited by 2
- 2023Consistent Valid Physically-Realizable Adversarial Attack against Crowd-flow Prediction Modelscited by 1
- 2023Robustness Benchmark of Road User Trajectory Prediction Models for Automated Drivingcited by 1
- 2023Improving Trajectory Prediction in Dynamic Multi-Agent Environment by Dropping Waypointscited by 1
- 2023Enhancing Trajectory Prediction through Self-Supervised Waypoint Noise Predictioncited by 1
- 2024iMotion-LLM: Instruction-Conditioned Trajectory Generationcited by 1
- 2025HHI-Assist: A Dataset and Benchmark of Human-Human Interaction in Physical Assistance Scenariocited by 1
- 2023Semantic and Articulated Pedestrian Sensing Onboard a Moving Vehiclecited by 0
- 2026Super Agents and Confounders: Influence of surrounding agents on vehicle trajectory predictioncited by 0
- 2026TSCA-Net: Temporal-Spatial Clique Attention for Interpretable Multimodal Pedestrian Trajectory Predictioncited by 0
- 2026TSCA-Net: Temporal-Spatial Clique Attention for Interpretable Multimodal Pedestrian Trajectory Prediction11 Jul 2026
- 2026Super Agents and Confounders: Influence of surrounding agents on vehicle trajectory prediction3 Apr 2026
- 2025HHI-Assist: A Dataset and Benchmark of Human-Human Interaction in Physical Assistance Scenario12 Sep 2025
- 2025Social-Pose: Enhancing Trajectory Prediction with Human Body Pose30 Jul 2025
- 2025Realistic Adversarial Attacks for Robustness Evaluation of Trajectory Prediction Models via Future State Perturbation9 May 2025
- 2025INTENT: Trajectory Prediction Framework with Intention-Guided Contrastive Clustering6 Mar 2025
- 2024V2XPnP: Vehicle-to-Everything Spatio-Temporal Fusion for Multi-Agent Perception and Prediction2 Dec 2024
- 2024iMotion-LLM: Instruction-Conditioned Trajectory Generation10 Jun 2024
- 2024UniTraj: A Unified Framework for Scalable Vehicle Trajectory Prediction22 Mar 2024
- 2024Certified Human Trajectory Prediction20 Mar 2024
- 2024Testing autonomous vehicles and AI: perspectives and challenges from cybersecurity, transparency, robustness and fairness21 Feb 2024
- 2023Social-Transmotion: Promptable Human Trajectory Prediction26 Dec 2023
20 more
- 2023Sim-to-Real Causal Transfer: A Metric Learning Approach to Causally-Aware Interaction Representations7 Dec 2023
- 2023Enhancing Trajectory Prediction through Self-Supervised Waypoint Noise Prediction26 Nov 2023
- 2023JRDB-Traj: A Dataset and Benchmark for Trajectory Forecasting in Crowds5 Nov 2023
- 2023Improving Trajectory Prediction in Dynamic Multi-Agent Environment by Dropping Waypoints29 Sep 2023
- 2023Semantic and Articulated Pedestrian Sensing Onboard a Moving Vehicle12 Sep 2023
- 2023Joint Metrics Matter: A Better Standard for Trajectory Forecasting10 May 2023
- 2023Toward Reliable Human Pose Forecasting with Uncertainty13 Apr 2023
- 2023Robustness Benchmark of Road User Trajectory Prediction Models for Automated Driving4 Apr 2023
- 2023Traj-MAE: Masked Autoencoders for Trajectory Prediction12 Mar 2023
- 2023Consistent Valid Physically-Realizable Adversarial Attack against Crowd-flow Prediction Models5 Mar 2023
- 2022Motion Style Transfer: Modular Low-Rank Adaptation for Deep Motion Forecasting6 Nov 2022
- 2022A generic diffusion-based approach for 3D human pose prediction in the wild11 Oct 2022
- 2022Safety-compliant Generative Adversarial Networks for Human Trajectory Forecasting25 Sep 2022
- 2022CausalAgents: A Robustness Benchmark for Motion Forecasting using Causal Relationships7 Jul 2022
- 2022Pedestrian 3D Bounding Box Prediction28 Jun 2022
- 2022Deep Interactive Motion Prediction and Planning: Playing Games with Motion Prediction Models5 Apr 2022
- 2022On Adversarial Robustness of Trajectory Prediction for Autonomous Vehicles13 Jan 2022
- 2021A Shared Representation for Photorealistic Driving Simulators9 Dec 2021
- 2021Vehicle trajectory prediction works, but not everywhere7 Dec 2021
- 2021SVG-Net: An SVG-based Trajectory Prediction Model7 Oct 2021
- 2022On Adversarial Robustness of Trajectory Prediction for Autonomous Vehiclescited by 89
- 2024UniTraj: A Unified Framework for Scalable Vehicle Trajectory Predictioncited by 51
- 2023Traj-MAE: Masked Autoencoders for Trajectory Predictioncited by 42
- 2021Vehicle trajectory prediction works, but not everywherecited by 39
- 2023Social-Transmotion: Promptable Human Trajectory Predictioncited by 33
- 2024V2XPnP: Vehicle-to-Everything Spatio-Temporal Fusion for Multi-Agent Perception and Predictioncited by 31
- 2022Deep Interactive Motion Prediction and Planning: Playing Games with Motion Prediction Modelscited by 27
- 2022CausalAgents: A Robustness Benchmark for Motion Forecasting using Causal Relationshipscited by 18
- 2023Joint Metrics Matter: A Better Standard for Trajectory Forecastingcited by 17
- 2022Safety-compliant Generative Adversarial Networks for Human Trajectory Forecastingcited by 12
- 2022Motion Style Transfer: Modular Low-Rank Adaptation for Deep Motion Forecastingcited by 12
- 2022Pedestrian 3D Bounding Box Predictioncited by 11
12 most cited of 31 All 31 (JSON)
- 2026TSCA-Net: Temporal-Spatial Clique Attention for Interpretable Multimodal Pedestrian Trajectory Prediction11 Jul 2026
- 2026Super Agents and Confounders: Influence of surrounding agents on vehicle trajectory prediction3 Apr 2026
- 2025HHI-Assist: A Dataset and Benchmark of Human-Human Interaction in Physical Assistance Scenario12 Sep 2025
- 2025Social-Pose: Enhancing Trajectory Prediction with Human Body Pose30 Jul 2025
- 2025Realistic Adversarial Attacks for Robustness Evaluation of Trajectory Prediction Models via Future State Perturbation9 May 2025
- 2025INTENT: Trajectory Prediction Framework with Intention-Guided Contrastive Clustering6 Mar 2025
- 2024V2XPnP: Vehicle-to-Everything Spatio-Temporal Fusion for Multi-Agent Perception and Prediction2 Dec 2024
- 2024iMotion-LLM: Instruction-Conditioned Trajectory Generation10 Jun 2024
- 2024UniTraj: A Unified Framework for Scalable Vehicle Trajectory Prediction22 Mar 2024
- 2024Certified Human Trajectory Prediction20 Mar 2024
- 2024Testing autonomous vehicles and AI: perspectives and challenges from cybersecurity, transparency, robustness and fairness21 Feb 2024
- 2023Social-Transmotion: Promptable Human Trajectory Prediction26 Dec 2023
12 newest of 31 All 31 (JSON)