VISTA: A Vision and Intent-Aware Social Attention Framework for Multi-Agent Trajectory Prediction
Not on the map. Why?
Abstract (arXiv)
Multi-agent trajectory prediction is crucial for autonomous systems operating in dense, interactive environments. Existing methods often fail to jointly capture agents' long-term goals and their fine-grained social interactions, which leads to unrealistic multi-agent futures. We propose VISTA, a recursive goal-conditioned transformer for multi-agent trajectory forecasting. VISTA combines (i) a cross-attention fusion module that integrates long-horizon intent with past motion, (ii) a social-token attention mechanism for flexible interaction modeling across agents, and (iii) pairwise attention maps that make social influence patterns interpretable at inference time. Our model turns single-agent goal-conditioned prediction into a coherent multi-agent forecasting framework. Beyond standard displacement metrics, we evaluate trajectory collision rates as a measure of joint realism. On the high-density MADRAS benchmark and on SDD, VISTA achieves state-of-the-art accuracy and substantially fewer collisions. On MADRAS, it reduces the average collision rate of strong baselines from 2.14 to 0.03 percent, and on SDD it attains zero collisions while improving ADE, FDE, and minFDE. These results show that VISTA generates socially compliant, goal-aware, and interpretable trajectories, making it promising for safety-critical autonomous systems.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 25 of its 45 references that are in the map. First posted on arXiv 13 Nov 2025.
Builds on
25 of 45 references.
References · 25
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 690
- 2021AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent Forecastingcited by 331
- 2020Social-STGCNN: A Social Spatio-Temporal Graph Convolutional Neural Network for Human Trajectory Predictioncited by 325
- 2022Motion Transformer with Global Intention Localization and Local Movement Refinementcited by 270
- 2020It Is Not the Journey but the Destination: Endpoint Conditioned Trajectory Predictioncited by 236
- 2019Social-BiGAT: Multimodal Trajectory Forecasting using Bicycle-GAN and Graph Attention Networkscited by 229
- 2017Social Attention: Modeling Attention in Human Crowdscited by 186
- 2022Stochastic Trajectory Prediction via Motion Indeterminacy Diffusioncited by 185
- 2020From Goals, Waypoints & Paths To Long Term Human Trajectory Forecastingcited by 167
- 2023Leapfrog Diffusion Model for Stochastic Trajectory Predictioncited by 132
13 more
- 2022GroupNet: Multiscale Hypergraph Neural Networks for Trajectory Prediction with Relational Reasoningcited by 128
- 2022Remember Intentions: Retrospective-Memory-based Trajectory Predictioncited by 86
- 2022Non-Probability Sampling Network for Stochastic Human Trajectory Predictioncited by 46
- 2022Learning Pedestrian Group Representations for Multi-modal Trajectory Predictioncited by 44
- 2024SmartRefine: A Scenario-Adaptive Refinement Framework for Efficient Motion Predictioncited by 34
- 2022Goal-driven Self-Attentive Recurrent Networks for Trajectory Predictioncited by 29
- 2022Dynamic-Group-Aware Networks for Multi-Agent Trajectory Prediction with Relational Reasoningcited by 28
- 2022GATraj: A Graph- and Attention-based Multi-Agent Trajectory Prediction Modelcited by 26
- 2020Goal-driven Long-Term Trajectory Predictioncited by 24
- 2023Towards Motion Forecasting with Real-World Perception Inputs: Are End-to-End Approaches Competitive?cited by 22
- 2024MART: MultiscAle Relational Transformer Networks for Multi-agent Trajectory Predictioncited by 21
- 2023Distilling Knowledge for Short-to-Long Term Trajectory Predictioncited by 5
- 2025Recent Advances in Multi-Agent Human Trajectory Prediction: A Comprehensive Reviewcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.