mlsanityData to 7 Oct 2026

SMEMO: Social Memory for Trajectory Forecasting

arXiv 2203.12446 ↗First posted 23 Mar 2022cs.CVcited by 26

Not on the map. Why?

Abstract (arXiv)

Effective modeling of human interactions is of utmost importance when forecasting behaviors such as future trajectories. Each individual, with its motion, influences surrounding agents since everyone obeys to social non-written rules such as collision avoidance or group following. In this paper we model such interactions, which constantly evolve through time, by looking at the problem from an algorithmic point of view, i.e. as a data manipulation task. We present a neural network based on an end-to-end trainable working memory, which acts as an external storage where information about each agent can be continuously written, updated and recalled. We show that our method is capable of learning explainable cause-effect relationships between motions of different agents, obtaining state-of-the-art results on multiple trajectory forecasting datasets.

Key facts. Cited by 26 papers in the map (data through 7 Oct 2026). Builds on 50 of its 80 references that are in the map. First posted on arXiv 23 Mar 2022.

Builds on

50 of 80 references.

References · 50

  1. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  2. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  3. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
  4. 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,313
  5. 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 728
  6. 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 687
  7. 2014Neural Turing Machinescited by 630
  8. 2014Memory Networkscited by 354
  9. 2020TNT: Target-driveN Trajectory Predictioncited by 345
  10. 2021AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent Forecastingcited by 327
  11. 2020Social-STGCNN: A Social Spatio-Temporal Graph Convolutional Neural Network for Human Trajectory Predictioncited by 324
  12. 2017DESIRE: Distant Future Prediction in Dynamic Scenes with Interacting Agentscited by 310
38 more
  1. 2018SoPhie: An Attentive GAN for Predicting Paths Compliant to Social and Physical Constraintscited by 296
  2. 2020It Is Not the Journey but the Destination: Endpoint Conditioned Trajectory Predictioncited by 235
  3. 2019Social-BiGAT: Multimodal Trajectory Forecasting using Bicycle-GAN and Graph Attention Networkscited by 228
  4. 2018Convolutional Social Pooling for Vehicle Trajectory Predictioncited by 221
  5. 2020Spatio-Temporal Graph Transformer Networks for Pedestrian Trajectory Predictioncited by 218
  6. 2020Transformer Networks for Trajectory Forecastingcited by 180
  7. 2019Multiple Futures Predictioncited by 178
  8. 2020From Goals, Waypoints & Paths To Long Term Human Trajectory Forecastingcited by 166
  9. 2020Memory-augmented Dense Predictive Coding for Video Representation Learningcited by 137
  10. 2019Multi-Agent Tensor Fusion for Contextual Trajectory Predictioncited by 131
  11. 2020Human Trajectory Forecasting in Crowds: A Deep Learning Perspectivecited by 128
  12. 2015Ask Me Anything: Dynamic Memory Networks for Natural Language Processingcited by 116
  13. 2019Peeking into the Future: Predicting Future Person Activities and Locations in Videoscited by 112
  14. 2018TrafficPredict: Trajectory Prediction for Heterogeneous Traffic-Agentscited by 111
  15. 2019SR-LSTM: State Refinement for LSTM towards Pedestrian Trajectory Predictioncited by 111
  16. 2020MAST: A Memory-Augmented Self-supervised Trackercited by 109
  17. 2021SGCN:Sparse Graph Convolution Network for Pedestrian Trajectory Predictioncited by 97
  18. 2022Remember Intentions: Retrospective-Memory-based Trajectory Predictioncited by 86
  19. 2018Multi-Modal Trajectory Prediction of Surrounding Vehicles with Maneuver based LSTMscited by 77
  20. 2019Conditional Generative Neural System for Probabilistic Trajectory Predictioncited by 76
  21. 2020Trajectory Forecasts in Unknown Environments Conditioned on Grid-Based Planscited by 72
  22. 2020MANTRA: Memory Augmented Networks for Multiple Trajectory Predictioncited by 69
  23. 2021Trajectory Prediction with Latent Belief Energy-Based Modelcited by 60
  24. 2018Learning Dynamic Memory Networks for Object Trackingcited by 58
  25. 2020Trajectron++: Dynamically-Feasible Trajectory Forecasting With Heterogeneous Datacited by 58
  26. 2020Social NCE: Contrastive Learning of Socially-aware Motion Representationscited by 58
  27. 2020Goal-GAN: Multimodal Trajectory Prediction Based on Goal Position Estimationcited by 57
  28. 2021Three Steps to Multimodal Trajectory Prediction: Modality Clustering, Classification and Synthesiscited by 46
  29. 2021Interpretable Social Anchors for Human Trajectory Forecasting in Crowdscited by 44
  30. 2019Conditional Flow Variational Autoencoders for Structured Sequence Predictioncited by 36
  31. 2017Visual Question Answering with Memory-Augmented Networkscited by 25
  32. 2019Scene Compliant Trajectory Forecast with Agent-Centric Spatio-Temporal Gridscited by 24
  33. 2019Social and Scene-Aware Trajectory Prediction in Crowded Spacescited by 19
  34. 2019INFER: INtermediate representations for FuturE pRedictioncited by 12
  35. 2017Tree Memory Networks for Modelling Long-term Temporal Dependenciescited by 7
  36. 2019Conditional Vehicle Trajectories Prediction in CARLA Urban Environmentcited by 6
  37. 2020Garment Recommendation with Memory Augmented Neural Networkscited by 6
  38. 2020Multiple Future Prediction Leveraging Synthetic Trajectoriescited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 1; 2023: 2; 2024: 7; 2025: 9; 2026: 7.

26 papers.

Sort:

By area:

  1. 2023EigenTrajectory: Low-Rank Descriptors for Multi-Modal Trajectory Forecastingcited by 41
  2. 2024SingularTrajectory: Universal Trajectory Predictor Using Diffusion Modelcited by 35
  3. 2024Can Language Beat Numerical Regression? Language-Based Multimodal Trajectory Predictioncited by 31
  4. 2024LG-Traj: LLM Guided Pedestrian Trajectory Predictioncited by 24
  5. 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directionscited by 14
  6. 2025Unified Spatial-Temporal Edge-Enhanced Graph Networks for Pedestrian Trajectory Predictioncited by 13
  7. 2025BP-SGCN: Behavioral Pseudo-Label Informed Sparse Graph Convolution Network for Pedestrian and Heterogeneous Trajectory Predictioncited by 9
  8. 2025Continuous Locomotive Crowd Behavior Generationcited by 7
  9. 2024Multi-Agent Inverse Reinforcement Learning in Real World Unstructured Pedestrian Crowdscited by 6
  10. 2024Resonance: Learning to Predict Social-Aware Pedestrian Trajectories as Co-Vibrationscited by 5
  11. 2022Fashion Recommendation Based on Style and Social Eventscited by 3
  12. 2024G2LTraj: A Global-to-Local Generation Approach for Trajectory Predictioncited by 3
14 more
  1. 2025Recent Advances in Multi-Agent Human Trajectory Prediction: A Comprehensive Reviewcited by 2
  2. 2025Intention-Aware Diffusion Model for Pedestrian Trajectory Predictioncited by 2
  3. 2023FLODCAST: Flow and Depth Forecasting via Multimodal Recurrent Architecturescited by 1
  4. 2024PMM-Net: Single-stage Multi-agent Trajectory Prediction with Patching-based Embedding and Explicit Modal Modulationcited by 1
  5. 2025Offline Reinforcement Learning using Human-Aligned Reward Labeling for Autonomous Emergency Braking in Occluded Pedestrian Crossingcited by 1
  6. 2025Reverberation: Learning the Latencies Before Forecasting Trajectoriescited by 1
  7. 2025Diagnosing Capability Preservation and Task Sensitivity in Memory Augmented Document Classifierscited by 0
  8. 2026SAIL: Scene-aware Adaptive Iterative Learning for Long-Tail Trajectory Prediction in Autonomous Vehiclescited by 0
  9. 2026Encore: Conditioning Trajectory Forecasting via Biased Ego Rehearsalscited by 0
  10. 2026SWIFT: A Small-World Interaction Framework for Flow-Aware Trajectory Prediction in Autonomous Drivingcited by 0
  11. 2026TSCA-Net: Temporal-Spatial Clique Attention for Interpretable Multimodal Pedestrian Trajectory Predictioncited by 0
  12. 2026A Unified Framework for Trajectory Prediction with Explicit Planning and Reaction Decompositioncited by 0
  13. 2026GEAR: From Dynamic Encoding to Dynamic Activation in Social Trajectory Predictioncited by 0
  14. 2026HAP: A Hand-Driven Active Perception Framework for Egocentric Head Motion Predictioncited by 0