Convolutional Social Pooling for Vehicle Trajectory Prediction
Not on the map. Why?
Abstract (arXiv)
Forecasting the motion of surrounding vehicles is a critical ability for an autonomous vehicle deployed in complex traffic. Motion of all vehicles in a scene is governed by the traffic context, i.e., the motion and relative spatial configuration of neighboring vehicles. In this paper we propose an LSTM encoder-decoder model that uses convolutional social pooling as an improvement to social pooling layers for robustly learning interdependencies in vehicle motion. Additionally, our model outputs a multi-modal predictive distribution over future trajectories based on maneuver classes. We evaluate our model using the publicly available NGSIM US-101 and I-80 datasets. Our results show improvement over the state of the art in terms of RMS values of prediction error and negative log-likelihoods of true future trajectories under the model's predictive distribution. We also present a qualitative analysis of the model's predicted distributions for various traffic scenarios.
Key facts. Cited by 221 papers in the map (data through 7 Oct 2026). First posted on arXiv 15 May 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 46; 2022: 31; 2023: 55; 2024: 41; 2025: 28; 2026: 20.
221 papers.
Sort:
By area:
- 2021Multimodal Motion Prediction with Stacked Transformerscited by 207
- 2021Latent Variable Sequential Set Transformers For Joint Multi-Agent Motion Predictioncited by 131
- 2022GroupNet: Multiscale Hypergraph Neural Networks for Trajectory Prediction with Relational Reasoningcited by 128
- 2021LaneRCNN: Distributed Representations for Graph-Centric Motion Forecastingcited by 112
- 2021THOMAS: Trajectory Heatmap Output with learned Multi-Agent Samplingcited by 101
- 2023The Waymo Open Sim Agents Challengecited by 86
- 2021LaPred: Lane-Aware Prediction of Multi-Modal Future Trajectories of Dynamic Agentscited by 64
- 2021Learning to Predict Vehicle Trajectories with Model-based Planningcited by 63
- 2022ScePT: Scene-consistent, Policy-based Trajectory Predictions for Planningcited by 63
- 2021Trajectory Prediction with Latent Belief Energy-Based Modelcited by 60
- 2023LAformer: Trajectory Prediction for Autonomous Driving with Lane-Aware Scene Constraintscited by 50
- 2023Leveraging Future Relationship Reasoning for Vehicle Trajectory Predictioncited by 47
38 more
- 2021View Vertically: A Hierarchical Network for Trajectory Prediction via Fourier Spectrumscited by 44
- 2022Social-Implicit: Rethinking Trajectory Prediction Evaluation and The Effectiveness of Implicit Maximum Likelihood Estimationcited by 40
- 2021RAIN: Reinforced Hybrid Attention Inference Network for Motion Forecastingcited by 36
- 2021Graph-Based Spatial-Temporal Convolutional Network for Vehicle Trajectory Prediction in Autonomous Drivingcited by 36
- 2021Spatio-Temporal Graph Dual-Attention Network for Multi-Agent Prediction and Trackingcited by 35
- 2023Uncertainty-aware State Space Transformer for Egocentric 3D Hand Trajectory Forecastingcited by 33
- 2024V2XPnP: Vehicle-to-Everything Spatio-Temporal Fusion for Multi-Agent Perception and Predictioncited by 31
- 2022Dynamic-Group-Aware Networks for Multi-Agent Trajectory Prediction with Relational Reasoningcited by 28
- 2023BAT: Behavior-Aware Human-Like Trajectory Prediction for Autonomous Drivingcited by 28
- 2023Fast Inference and Update of Probabilistic Density Estimation on Trajectory Predictioncited by 27
- 2023SocialCircle: Learning the Angle-based Social Interaction Representation for Pedestrian Trajectory Predictioncited by 27
- 2022SMEMO: Social Memory for Trajectory Forecastingcited by 26
- 2024Towards Explainable, Safe Autonomous Driving with Language Embeddings for Novelty Identification and Active Learning: Framework and Experimental Analysis with Real-World Data Setscited by 25
- 2021CausalCity: Complex Simulations with Agency for Causal Discovery and Reasoningcited by 23
- 2022R-Pred: Two-Stage Motion Prediction Via Tube-Query Attention-Based Trajectory Refinementcited by 23
- 2023Machine Learning for Autonomous Vehicle's Trajectory Prediction: A comprehensive survey, Challenges, and Future Research Directionscited by 23
- 2022S2TNet: Spatio-Temporal Transformer Networks for Trajectory Prediction in Autonomous Drivingcited by 22
- 2024AgentsCoMerge: Large Language Model Empowered Collaborative Decision Making for Ramp Mergingcited by 22
- 2021Congestion-aware Multi-agent Trajectory Prediction for Collision Avoidancecited by 21
- 2022CRAT-Pred: Vehicle Trajectory Prediction with Crystal Graph Convolutional Neural Networks and Multi-Head Self-Attentioncited by 21
- 2023EquiDiff: A Conditional Equivariant Diffusion Model For Trajectory Predictioncited by 21
- 2024Multi-Transmotion: Pre-trained Model for Human Motion Predictioncited by 21
- 2021Variational Autoencoder-Based Vehicle Trajectory Prediction with an Interpretable Latent Spacecited by 20
- 2024Multi-Agent Dynamic Relational Reasoning for Social Robot Navigationcited by 20
- 2024A Cognitive-Based Trajectory Prediction Approach for Autonomous Drivingcited by 20
- 2021MSN: Multi-Style Network for Trajectory Predictioncited by 19
- 2021Trajectory Prediction with Graph-based Dual-scale Context Fusioncited by 19
- 2023MTP-GO: Graph-Based Probabilistic Multi-Agent Trajectory Prediction with Neural ODEscited by 19
- 2021Injecting Knowledge in Data-driven Vehicle Trajectory Predictorscited by 18
- 2021MVFuseNet: Improving End-to-End Object Detection and Motion Forecasting through Multi-View Fusion of LiDAR Datacited by 18
- 2021SCOUT: Socially-COnsistent and UndersTandable Graph Attention Network for Trajectory Prediction of Vehicles and VRUscited by 16
- 2021Euro-PVI: Pedestrian Vehicle Interactions in Dense Urban Centerscited by 16
- 2021DeepTrack: Lightweight Deep Learning for Vehicle Path Prediction in Highwayscited by 16
- 2022Action-based Contrastive Learning for Trajectory Predictioncited by 15
- 2021Video action recognition for lane-change classification and prediction of surrounding vehiclescited by 14
- 2022Interaction Modeling with Multiplex Attentioncited by 14
- 2023Holistic Network Virtualization and Pervasive Network Intelligence for 6Gcited by 14
- 2023Another Vertical View: A Hierarchical Network for Heterogeneous Trajectory Prediction via Spectrumscited by 14
50 most cited of 221 All 221 (JSON)
- 2026Active Client Selection in Federated Trajectory Prediction with Uncertainty-Awareness and Heterogeneous Complexity27 Aug 2026
- 2026Failing Gracefully: Mitigating Impact of Inevitable Robot Failures5 Aug 2026
- 2026LoRFT: Benchmarking Long-Range Vehicle Trajectory Reconstruction from Fixed Highway Cameras22 Jul 2026
- 2026SWIFT: A Small-World Interaction Framework for Flow-Aware Trajectory Prediction in Autonomous Driving3 Jul 2026
- 2026A Dynamic Scene Interaction Reasoning Framework for Scene-level Lane-Change Intention and Trajectory Prediction of Multiple Interacting Vehicles2 Jul 2026
- 2026Unveiling Transferability in Trajectory Prediction via Latent Scene Embeddings29 Jun 2026
- 2026Rethinking Training & Inference for Forecasting: Linking Winner-Take-All back to GMMs24 Jun 2026
- 2026A Generative Model for Closed-Loop Microsimulation of Signalized Intersections22 Jun 2026
- 2026CARVE-Q: Quantum-Proposed, Classically Certified Interactive Driving Repair3 Jun 2026
- 2026CARVE: Certified Affordable Repair of Vetoed Maneuvers via Envelopes for Interactive Driving31 May 2026
- 2026From Cues to Horizons: Dynamic Risk Horizon Profiling for Trajectory Prediction30 May 2026
- 2026Mode-as-Sequence: Translating Multimodal Motion Prediction into Unified Sequential Mode Modeling21 May 2026
38 more
- 2026Diverse Yet Consistent: Context-Guided Diffusion with Energy-Based Joint Refinement for Multi-Agent Motion Prediction21 May 2026
- 2026Chatting about Conditional Trajectory Prediction20 Apr 2026
- 2026EdgeVTP: Exploration of Latency-efficient Trajectory Prediction for Edge-based Embedded Vision Applications18 Apr 2026
- 2026MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction11 Apr 2026
- 2026SAIL: Scene-aware Adaptive Iterative Learning for Long-Tail Trajectory Prediction in Autonomous Vehicles6 Apr 2026
- 2026A Prediction-as-Perception Framework for 3D Object Detection13 Mar 2026
- 2026Uncertainty-Aware Diffusion Model for Multimodal Highway Trajectory Prediction via DDIM Sampling24 Feb 2026
- 2026How vehicles change lanes after encountering crashes: Empirical analysis and modeling13 Jan 2026
- 2025SemAgent: Semantic-Driven Agentic AI Empowered Trajectory Prediction in Vehicular Networks30 Nov 2025
- 2025SOTFormer: A Minimal Transformer for Unified Object Tracking and Trajectory Prediction14 Nov 2025
- 2025Reverberation: Learning the Latencies Before Forecasting Trajectories14 Nov 2025
- 2025X-TRACK: Physics-Aware xLSTM for Realistic Vehicle Trajectory Prediction31 Oct 2025
- 2025Dynamic Model Selection for Trajectory Prediction via Pairwise Ranking and Meta-Features31 Oct 2025
- 2025Addressing Corner Cases in Autonomous Driving: A World Model-based Approach with Mixture of Experts and LLMs23 Oct 2025
- 2025Diffusion Models for Reinforcement Learning: Foundations, Taxonomy, and Development14 Oct 2025
- 2025VFSI: Validity First Spatial Intelligence for Constraint-Guided Traffic Diffusion28 Sep 2025
- 2025SocialTraj: Two-Stage Socially-Aware Trajectory Prediction for Autonomous Driving via Conditional Diffusion Model22 Sep 2025
- 2025KoopCast: Trajectory Forecasting via Koopman Operators19 Sep 2025
- 2025HeLoFusion: An Efficient and Scalable Encoder for Modeling Heterogeneous and Multi-Scale Interactions in Trajectory Prediction15 Sep 2025
- 2025End-to-End Visual Autonomous Parking via Control-Aided Attention14 Sep 2025
- 2025Large Foundation Models for Trajectory Prediction in Autonomous Driving: A Comprehensive Survey11 Sep 2025
- 2025STRAP: Spatial-Temporal Risk-Attentive Vehicle Trajectory Prediction for Autonomous Driving11 Jul 2025
- 2025Generalizable Trajectory Prediction via Inverse Reinforcement Learning with Mamba-Graph Architecture14 Jun 2025
- 2025Trajectory Prediction Meets Large Language Models: A Survey3 Jun 2025
- 2025Towards Human-Like Trajectory Prediction for Autonomous Driving: A Behavior-Centric Approach27 May 2025
- 2025Beyond Patterns: Harnessing Causal Logic for Autonomous Driving Trajectory Prediction11 May 2025
- 2025AI2-Active Safety: AI-enabled Interaction-aware Active Safety Analysis with Vehicle Dynamics1 May 2025
- 2025RiskNet: Interaction-Aware Risk Forecasting for Autonomous Driving in Long-Tail Scenarios22 Apr 2025
- 2025DyTTP: Trajectory Prediction with Normalization-Free Transformers7 Apr 2025
- 2025LDGNet: A Lightweight Difference Guiding Network for Remote Sensing Change Detection7 Apr 2025
- 2025GAMDTP: Dynamic Trajectory Prediction with Graph Attention Mamba Network7 Apr 2025
- 2025SafeCast: Risk-Responsive Motion Forecasting for Autonomous Vehicles28 Mar 2025
- 2025Minds on the Move: Decoding Trajectory Prediction in Autonomous Driving with Cognitive Insights27 Feb 2025
- 2025Co-MTP: A Cooperative Trajectory Prediction Framework with Multi-Temporal Fusion for Autonomous Driving23 Feb 2025
- 2025Motion Forecasting for Autonomous Vehicles: A Survey10 Feb 2025
- 2025Spatial Temporal Attention based Target Vehicle Trajectory Prediction for Internet of Vehicles1 Jan 2025
- 2024Exploring Transformer-Augmented LSTM for Temporal and Spatial Feature Learning in Trajectory Prediction18 Dec 2024
- 2024C2F-TP: A Coarse-to-Fine Denoising Framework for Uncertainty-Aware Trajectory Prediction17 Dec 2024
50 newest of 221 All 221 (JSON)
- 2023Machine Learning for Autonomous Vehicle's Trajectory Prediction: A comprehensive survey, Challenges, and Future Research Directionscited by 23
- 2022DiPA: Probabilistic Multi-Modal Interactive Prediction for Autonomous Drivingcited by 5
- 2021Autonomous Navigation through intersections with Graph ConvolutionalNetworks and Conditional Imitation Learning for Self-driving Carscited by 3
- 2022GIN: Graph-based Interaction-aware Constraint Policy Optimization for Autonomous Drivingcited by 3
- 2023Navigating Uncertainty: The Role of Short-Term Trajectory Prediction in Autonomous Vehicle Safetycited by 3
- 2023Efficient Baselines for Motion Prediction in Autonomous Drivingcited by 3
- 2024Augmenting Safety-Critical Driving Scenarios while Preserving Similarity to Expert Trajectoriescited by 3
- 2025Large Foundation Models for Trajectory Prediction in Autonomous Driving: A Comprehensive Surveycited by 3
- 2023Does Unpredictability Influence Driving Behavior?cited by 0
- 2024Maneuver Decision-Making with Trajectory Streams Prediction for Autonomous Vehiclescited by 0
- 2026CARVE: Certified Affordable Repair of Vetoed Maneuvers via Envelopes for Interactive Drivingcited by 0
- 2026CARVE: Certified Affordable Repair of Vetoed Maneuvers via Envelopes for Interactive Driving31 May 2026
- 2025Large Foundation Models for Trajectory Prediction in Autonomous Driving: A Comprehensive Survey11 Sep 2025
- 2024Maneuver Decision-Making with Trajectory Streams Prediction for Autonomous Vehicles16 Sep 2024
- 2024Augmenting Safety-Critical Driving Scenarios while Preserving Similarity to Expert Trajectories20 Apr 2024
- 2023Efficient Baselines for Motion Prediction in Autonomous Driving6 Sep 2023
- 2023Does Unpredictability Influence Driving Behavior?28 Jul 2023
- 2023Machine Learning for Autonomous Vehicle's Trajectory Prediction: A comprehensive survey, Challenges, and Future Research Directions12 Jul 2023
- 2023Navigating Uncertainty: The Role of Short-Term Trajectory Prediction in Autonomous Vehicle Safety11 Jul 2023
- 2022DiPA: Probabilistic Multi-Modal Interactive Prediction for Autonomous Driving12 Oct 2022
- 2022GIN: Graph-based Interaction-aware Constraint Policy Optimization for Autonomous Driving3 Jun 2022
- 2021Autonomous Navigation through intersections with Graph ConvolutionalNetworks and Conditional Imitation Learning for Self-driving Cars1 Feb 2021
- 2023EquiDiff: A Conditional Equivariant Diffusion Model For Trajectory Predictioncited by 21
- 2024Reliable Trajectory Prediction and Uncertainty Quantification with Conditioned Diffusion Modelscited by 13
- 2025Diffusion Models for Reinforcement Learning: Foundations, Taxonomy, and Developmentcited by 2
- 2025VFSI: Validity First Spatial Intelligence for Constraint-Guided Traffic Diffusioncited by 1
- 2025SocialTraj: Two-Stage Socially-Aware Trajectory Prediction for Autonomous Driving via Conditional Diffusion Modelcited by 0
- 2026Uncertainty-Aware Diffusion Model for Multimodal Highway Trajectory Prediction via DDIM Samplingcited by 0
- 2026Diverse Yet Consistent: Context-Guided Diffusion with Energy-Based Joint Refinement for Multi-Agent Motion Predictioncited by 0
- 2026Diverse Yet Consistent: Context-Guided Diffusion with Energy-Based Joint Refinement for Multi-Agent Motion Prediction21 May 2026
- 2026Uncertainty-Aware Diffusion Model for Multimodal Highway Trajectory Prediction via DDIM Sampling24 Feb 2026
- 2025Diffusion Models for Reinforcement Learning: Foundations, Taxonomy, and Development14 Oct 2025
- 2025VFSI: Validity First Spatial Intelligence for Constraint-Guided Traffic Diffusion28 Sep 2025
- 2025SocialTraj: Two-Stage Socially-Aware Trajectory Prediction for Autonomous Driving via Conditional Diffusion Model22 Sep 2025
- 2024Reliable Trajectory Prediction and Uncertainty Quantification with Conditioned Diffusion Models23 May 2024
- 2023EquiDiff: A Conditional Equivariant Diffusion Model For Trajectory Prediction12 Aug 2023
- 2023Social Motion Prediction with Cognitive Hierarchiescited by 8
- 2023Social Motion Prediction with Cognitive Hierarchies8 Nov 2023
- 2021Multimodal Motion Prediction with Stacked Transformerscited by 207
- 2021Latent Variable Sequential Set Transformers For Joint Multi-Agent Motion Predictioncited by 131
- 2022GroupNet: Multiscale Hypergraph Neural Networks for Trajectory Prediction with Relational Reasoningcited by 128
- 2021LaneRCNN: Distributed Representations for Graph-Centric Motion Forecastingcited by 112
- 2021THOMAS: Trajectory Heatmap Output with learned Multi-Agent Samplingcited by 101
- 2023The Waymo Open Sim Agents Challengecited by 86
- 2021LaPred: Lane-Aware Prediction of Multi-Modal Future Trajectories of Dynamic Agentscited by 64
- 2021Learning to Predict Vehicle Trajectories with Model-based Planningcited by 63
- 2022ScePT: Scene-consistent, Policy-based Trajectory Predictions for Planningcited by 63
- 2021Trajectory Prediction with Latent Belief Energy-Based Modelcited by 60
- 2023LAformer: Trajectory Prediction for Autonomous Driving with Lane-Aware Scene Constraintscited by 50
- 2023Leveraging Future Relationship Reasoning for Vehicle Trajectory Predictioncited by 47
12 most cited of 198 All 198 (JSON)
- 2026Active Client Selection in Federated Trajectory Prediction with Uncertainty-Awareness and Heterogeneous Complexity27 Aug 2026
- 2026Failing Gracefully: Mitigating Impact of Inevitable Robot Failures5 Aug 2026
- 2026LoRFT: Benchmarking Long-Range Vehicle Trajectory Reconstruction from Fixed Highway Cameras22 Jul 2026
- 2026SWIFT: A Small-World Interaction Framework for Flow-Aware Trajectory Prediction in Autonomous Driving3 Jul 2026
- 2026A Dynamic Scene Interaction Reasoning Framework for Scene-level Lane-Change Intention and Trajectory Prediction of Multiple Interacting Vehicles2 Jul 2026
- 2026Unveiling Transferability in Trajectory Prediction via Latent Scene Embeddings29 Jun 2026
- 2026Rethinking Training & Inference for Forecasting: Linking Winner-Take-All back to GMMs24 Jun 2026
- 2026A Generative Model for Closed-Loop Microsimulation of Signalized Intersections22 Jun 2026
- 2026CARVE-Q: Quantum-Proposed, Classically Certified Interactive Driving Repair3 Jun 2026
- 2026From Cues to Horizons: Dynamic Risk Horizon Profiling for Trajectory Prediction30 May 2026
- 2026Mode-as-Sequence: Translating Multimodal Motion Prediction into Unified Sequential Mode Modeling21 May 2026
- 2026Chatting about Conditional Trajectory Prediction20 Apr 2026
12 newest of 198 All 198 (JSON)