TrafficPredict: Trajectory Prediction for Heterogeneous Traffic-Agents
Not on the map. Why?
Abstract (arXiv)
To safely and efficiently navigate in complex urban traffic, autonomous vehicles must make responsible predictions in relation to surrounding traffic-agents (vehicles, bicycles, pedestrians, etc.). A challenging and critical task is to explore the movement patterns of different traffic-agents and predict their future trajectories accurately to help the autonomous vehicle make reasonable navigation decision. To solve this problem, we propose a long short-term memory-based (LSTM-based) realtime traffic prediction algorithm, TrafficPredict. Our approach uses an instance layer to learn instances' movements and interactions and has a category layer to learn the similarities of instances belonging to the same type to refine the prediction. In order to evaluate its performance, we collected trajectory datasets in a large city consisting of varying conditions and traffic densities. The dataset includes many challenging scenarios where vehicles, bicycles, and pedestrians move among one another. We evaluate the performance of TrafficPredict on our new dataset and highlight its higher accuracy for trajectory prediction by comparing with prior prediction methods.
Key facts. Cited by 111 papers in the map (data through 14 Oct 2026). First posted on arXiv 6 Nov 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 1; 2021: 23; 2022: 31; 2023: 22; 2024: 16; 2025: 13; 2026: 5.
111 papers.
Sort:
By area:
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 707
- 2021One Million Scenes for Autonomous Driving: ONCE Datasetcited by 218
- 20223D Object Detection for Autonomous Driving: A Comprehensive Surveycited by 132
- 2023V2X-Seq: A Large-Scale Sequential Dataset for Vehicle-Infrastructure Cooperative Perception and Forecastingcited by 114
- 20213D Object Detection for Autonomous Driving: A Surveycited by 106
- 2021SGCN:Sparse Graph Convolution Network for Pedestrian Trajectory Predictioncited by 97
- 2022On Adversarial Robustness of Trajectory Prediction for Autonomous Vehiclescited by 90
- 2022Rope3D: TheRoadside Perception Dataset for Autonomous Driving and Monocular 3D Object Detection Taskcited by 81
- 2022Multi-modal Sensor Fusion for Auto Driving Perception: A Surveycited by 76
- 2021Cylindrical and Asymmetrical 3D Convolution Networks for LiDAR-based Perceptioncited by 57
- 2021On Exposing the Challenging Long Tail in Future Prediction of Traffic Actorscited by 48
- 2021Three Steps to Multimodal Trajectory Prediction: Modality Clustering, Classification and Synthesiscited by 46
38 more
- 2024RenderWorld: World Model with Self-Supervised 3D Labelcited by 46
- 2021Spatio-Temporal Graph Dual-Attention Network for Multi-Agent Prediction and Trackingcited by 35
- 2022STCrowd: A Multimodal Dataset for Pedestrian Perception in Crowded Scenescited by 35
- 2024Physical 3D Adversarial Attacks against Monocular Depth Estimation in Autonomous Drivingcited by 32
- 2022Rethinking Learning Approaches for Long-Term Action Anticipationcited by 29
- 2022SMEMO: Social Memory for Trajectory Forecastingcited by 26
- 2021Roto-translated Local Coordinate Frames For Interacting Dynamical Systemscited by 24
- 2022SELMA: SEmantic Large-scale Multimodal Acquisitions in Variable Weather, Daytime and Viewpointscited by 22
- 2022S2TNet: Spatio-Temporal Transformer Networks for Trajectory Prediction in Autonomous Drivingcited by 22
- 2022CRAT-Pred: Vehicle Trajectory Prediction with Crystal Graph Convolutional Neural Networks and Multi-Head Self-Attentioncited by 21
- 2022Transferable and Adaptable Driving Behavior Predictioncited by 20
- 2021Heterogeneous-Agent Trajectory Forecasting Incorporating Class Uncertaintycited by 19
- 2022CSCNet: Contextual Semantic Consistency Network for Trajectory Prediction in Crowded Spacescited by 18
- 2023SCENE: Reasoning about Traffic Scenes using Heterogeneous Graph Neural Networkscited by 18
- 2023Pedestrian Trajectory Prediction in Pedestrian-Vehicle Mixed Environments: A Systematic Reviewcited by 18
- 2021Unlimited Neighborhood Interaction for Heterogeneous Trajectory Predictioncited by 17
- 2021Causal-based Time Series Domain Generalization for Vehicle Intention Predictioncited by 17
- 2023Human-centric Scene Understanding for 3D Large-scale Scenarioscited by 17
- 2021SCOUT: Socially-COnsistent and UndersTandable Graph Attention Network for Trajectory Prediction of Vehicles and VRUscited by 16
- 2021Euro-PVI: Pedestrian Vehicle Interactions in Dense Urban Centerscited by 16
- 2022Social Interpretable Tree for Pedestrian Trajectory Predictioncited by 16
- 2022ParkPredict+: Multimodal Intent and Motion Prediction for Vehicles in Parking Lots with CNN and Transformercited by 14
- 2023Another Vertical View: A Hierarchical Network for Heterogeneous Trajectory Prediction via Spectrumscited by 14
- 2023Open-TransMind: A New Baseline and Benchmark for 1st Foundation Model Challenge of Intelligent Transportationcited by 14
- 2025A Survey of Graph Transformers: Architectures, Theories and Applicationscited by 14
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directionscited by 14
- 2022CVAE-H: Conditionalizing Variational Autoencoders via Hypernetworks and Trajectory Forecasting for Autonomous Drivingcited by 13
- 2022MotionAug: Augmentation with Physical Correction for Human Motion Predictioncited by 13
- 2021SIDE: Center-based Stereo 3D Detector with Structure-aware Instance Depth Estimationcited by 12
- 2021METEOR:A Dense, Heterogeneous, and Unstructured Traffic Dataset With Rare Behaviorscited by 12
- 2022HFT: Lifting Perspective Representations via Hybrid Feature Transformationcited by 11
- 2022Heterogeneous Trajectory Forecasting via Risk and Scene Graph Learningcited by 11
- 2022D2-TPred: Discontinuous Dependency for Trajectory Prediction under Traffic Lightscited by 10
- 2023EPG-MGCN: Ego-Planning Guided Multi-Graph Convolutional Network for Heterogeneous Agent Trajectory Predictioncited by 10
- 2025BP-SGCN: Behavioral Pseudo-Label Informed Sparse Graph Convolution Network for Pedestrian and Heterogeneous Trajectory Predictioncited by 9
- 2020Imitation Learning of Hierarchical Driving Model: from Continuous Intention to Continuous Trajectorycited by 8
- 2021Physically Feasible Vehicle Trajectory Predictioncited by 8
- 2022Trajectory Forecasting from Detection with Uncertainty-Aware Motion Encodingcited by 8
50 most cited of 111 All 111 (JSON)
- 2026Unveiling Transferability in Trajectory Prediction via Latent Scene Embeddings29 Jun 2026
- 2026A Pedestrian-Vehicle Interaction Benchmark and Annotation Framework for Unstructured Scenes via Uncalibrated Cameras25 May 2026
- 2026ESIA: An Energy-Based Spatiotemporal Interaction-Aware Framework for Pedestrian Intention Prediction26 Apr 2026
- 2026RankFormer: A Propose-then-Select Transformer for Multi-Agent Multimodal Trajectory Prediction8 Apr 2026
- 2026Uncertainty-Aware Trajectory Prediction: A Unified Framework Harnessing Positional and Semantic Uncertainties31 Mar 2026
- 2025nuScenes Revisited: Progress and Challenges in Autonomous Driving2 Dec 2025
- 2025Monocular 3D Lane Detection via Structure Uncertainty-Aware Network with Curve-Point Queries17 Nov 2025
- 2025Trajectory prediction for heterogeneous agents: A performance analysis on small and imbalanced datasets4 Oct 2025
- 2025LTMSformer: A Local Trend-Aware Attention and Motion State Encoding Transformer for Multi-Agent Trajectory Prediction7 Jul 2025
- 2025Towards Human-Like Trajectory Prediction for Autonomous Driving: A Behavior-Centric Approach27 May 2025
- 2025ParkDiffusion: Heterogeneous Multi-Agent Multi-Modal Trajectory Prediction for Automated Parking using Diffusion Models1 May 2025
- 2025SafeCast: Risk-Responsive Motion Forecasting for Autonomous Vehicles28 Mar 2025
38 more
- 2025Post-interactive Multimodal Trajectory Prediction for Autonomous Driving12 Mar 2025
- 2025INTENT: Trajectory Prediction Framework with Intention-Guided Contrastive Clustering6 Mar 2025
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directions5 Mar 2025
- 2025EMT: A Visual Multi-Task Benchmark Dataset for Autonomous Driving26 Feb 2025
- 2025A Survey of Graph Transformers: Architectures, Theories and Applications23 Feb 2025
- 2025BP-SGCN: Behavioral Pseudo-Label Informed Sparse Graph Convolution Network for Pedestrian and Heterogeneous Trajectory Prediction20 Feb 2025
- 2024Generating Traffic Scenarios via In-Context Learning to Learn Better Motion Planner24 Dec 2024
- 2024Domain Generalization in Autonomous Driving: Evaluating YOLOv8s, RT-DETR, and YOLO-NAS with the ROAD-Almaty Dataset16 Dec 2024
- 2024Resonance: Learning to Predict Social-Aware Pedestrian Trajectories as Co-Vibrations3 Dec 2024
- 2024Heterogeneous Interaction Modeling With Reduced Accumulated Error for Multi-Agent Trajectory Prediction28 Oct 2024
- 2024Building Real-time Awareness of Out-of-distribution in Trajectory Prediction for Autonomous Vehicles25 Sep 2024
- 2024RenderWorld: World Model with Self-Supervised 3D Label17 Sep 2024
- 2024Reputation-Driven Asynchronous Federated Learning for Enhanced Trajectory Prediction with Blockchain28 Jul 2024
- 2024Risk-Aware Vehicle Trajectory Prediction Under Safety-Critical Scenarios18 Jul 2024
- 2024DeepSense-V2V: A Vehicle-to-Vehicle Multi-Modal Sensing, Localization, and Communications Dataset25 Jun 2024
- 2024Multi-agent Traffic Prediction via Denoised Endpoint Distribution11 May 2024
- 2024ESP: Extro-Spective Prediction for Long-term Behavior Reasoning in Emergency Scenarios7 May 2024
- 2024SA-Attack: Speed-adaptive stealthy adversarial attack on trajectory prediction19 Apr 2024
- 2024TAFormer: A Unified Target-Aware Transformer for Video and Motion Joint Prediction in Aerial Scenes27 Mar 2024
- 2024Physical 3D Adversarial Attacks against Monocular Depth Estimation in Autonomous Driving26 Mar 2024
- 2024Are you a robot? Detecting Autonomous Vehicles from Behavior Analysis14 Mar 2024
- 2024HUNTER: Unsupervised Human-centric 3D Detection via Transferring Knowledge from Synthetic Instances to Real Scenes5 Mar 2024
- 2023Attention-aware Social Graph Transformer Networks for Stochastic Trajectory Prediction26 Dec 2023
- 2023nuScenes Knowledge Graph -- A comprehensive semantic representation of traffic scenes for trajectory prediction15 Dec 2023
- 2023Graph-based Prediction and Planning Policy Network (GP3Net) for scalable self-driving in dynamic environments using Deep Reinforcement Learning10 Dec 2023
- 2023Spatial-Temporal Conditional Random Field for Human Trajectory Prediction30 Nov 2023
- 2023STF: Spatial Temporal Fusion for Trajectory Prediction29 Nov 2023
- 2023Semantic and Articulated Pedestrian Sensing Onboard a Moving Vehicle12 Sep 2023
- 2023Towards Safe Autonomy in Hybrid Traffic: Detecting Unpredictable Abnormal Behaviors of Human Drivers via Information Sharing23 Aug 2023
- 2023Pedestrian Trajectory Prediction in Pedestrian-Vehicle Mixed Environments: A Systematic Review11 Aug 2023
- 2023Homography Estimation in Complex Topological Scenes2 Aug 2023
- 2023Human-centric Scene Understanding for 3D Large-scale Scenarios26 Jul 2023
- 2023VS-TransGRU: A Novel Transformer-GRU-based Framework Enhanced by Visual-Semantic Fusion for Egocentric Action Anticipation8 Jul 2023
- 2023SAPI: Surroundings-Aware Vehicle Trajectory Prediction at Intersections2 Jun 2023
- 2023V2X-Seq: A Large-Scale Sequential Dataset for Vehicle-Infrastructure Cooperative Perception and Forecasting10 May 2023
- 2023ContrastMotion: Self-supervised Scene Motion Learning for Large-Scale LiDAR Point Clouds25 Apr 2023
- 2023Open-TransMind: A New Baseline and Benchmark for 1st Foundation Model Challenge of Intelligent Transportation12 Apr 2023
- 2023Another Vertical View: A Hierarchical Network for Heterogeneous Trajectory Prediction via Spectrums11 Apr 2023
50 newest of 111 All 111 (JSON)
- 2024RenderWorld: World Model with Self-Supervised 3D Labelcited by 46
- 2024RenderWorld: World Model with Self-Supervised 3D Label17 Sep 2024
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 707
- 2021One Million Scenes for Autonomous Driving: ONCE Datasetcited by 218
- 20223D Object Detection for Autonomous Driving: A Comprehensive Surveycited by 132
- 2023V2X-Seq: A Large-Scale Sequential Dataset for Vehicle-Infrastructure Cooperative Perception and Forecastingcited by 114
- 20213D Object Detection for Autonomous Driving: A Surveycited by 106
- 2021SGCN:Sparse Graph Convolution Network for Pedestrian Trajectory Predictioncited by 97
- 2022On Adversarial Robustness of Trajectory Prediction for Autonomous Vehiclescited by 90
- 2022Rope3D: TheRoadside Perception Dataset for Autonomous Driving and Monocular 3D Object Detection Taskcited by 81
- 2022Multi-modal Sensor Fusion for Auto Driving Perception: A Surveycited by 76
- 2021Cylindrical and Asymmetrical 3D Convolution Networks for LiDAR-based Perceptioncited by 57
- 2021On Exposing the Challenging Long Tail in Future Prediction of Traffic Actorscited by 48
- 2021Three Steps to Multimodal Trajectory Prediction: Modality Clustering, Classification and Synthesiscited by 46
12 most cited of 107 All 107 (JSON)
- 2026Unveiling Transferability in Trajectory Prediction via Latent Scene Embeddings29 Jun 2026
- 2026A Pedestrian-Vehicle Interaction Benchmark and Annotation Framework for Unstructured Scenes via Uncalibrated Cameras25 May 2026
- 2026ESIA: An Energy-Based Spatiotemporal Interaction-Aware Framework for Pedestrian Intention Prediction26 Apr 2026
- 2026RankFormer: A Propose-then-Select Transformer for Multi-Agent Multimodal Trajectory Prediction8 Apr 2026
- 2026Uncertainty-Aware Trajectory Prediction: A Unified Framework Harnessing Positional and Semantic Uncertainties31 Mar 2026
- 2025nuScenes Revisited: Progress and Challenges in Autonomous Driving2 Dec 2025
- 2025Monocular 3D Lane Detection via Structure Uncertainty-Aware Network with Curve-Point Queries17 Nov 2025
- 2025Trajectory prediction for heterogeneous agents: A performance analysis on small and imbalanced datasets4 Oct 2025
- 2025LTMSformer: A Local Trend-Aware Attention and Motion State Encoding Transformer for Multi-Agent Trajectory Prediction7 Jul 2025
- 2025Towards Human-Like Trajectory Prediction for Autonomous Driving: A Behavior-Centric Approach27 May 2025
- 2025SafeCast: Risk-Responsive Motion Forecasting for Autonomous Vehicles28 Mar 2025
- 2025Post-interactive Multimodal Trajectory Prediction for Autonomous Driving12 Mar 2025
12 newest of 107 All 107 (JSON)