TraPHic: Trajectory Prediction in Dense and Heterogeneous Traffic Using Weighted Interactions
Not on the map. Why?
Abstract (arXiv)
We present a new algorithm for predicting the near-term trajectories of road-agents in dense traffic videos. Our approach is designed for heterogeneous traffic, where the road-agents may correspond to buses, cars, scooters, bicycles, or pedestrians. We model the interactions between different road-agents using a novel LSTM-CNN hybrid network for trajectory prediction. In particular, we take into account heterogeneous interactions that implicitly accounts for the varying shapes, dynamics, and behaviors of different road agents. In addition, we model horizon-based interactions which are used to implicitly model the driving behavior of each road-agent. We evaluate the performance of our prediction algorithm, TraPHic, on the standard datasets and also introduce a new dense, heterogeneous traffic dataset corresponding to urban Asian videos and agent trajectories. We outperform state-of-the-art methods on dense traffic datasets by 30%.
Key facts. Cited by 82 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Dec 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 22; 2022: 14; 2023: 17; 2024: 10; 2025: 12; 2026: 7.
82 papers.
Sort:
By area:
- 2021Scene Transformer: A unified architecture for predicting multiple agent trajectoriescited by 165
- 2022On Adversarial Robustness of Trajectory Prediction for Autonomous Vehiclescited by 89
- 2022SocialVAE: Human Trajectory Prediction using Timewise Latentscited by 65
- 2021Video Prediction Recalling Long-term Motion Context via Memory Alignment Learningcited by 62
- 2021ROAD: The ROad event Awareness Dataset for Autonomous Drivingcited by 54
- 2023A Dynamic Multi-Scale Voxel Flow Network for Video Predictioncited by 53
- 2021On Exposing the Challenging Long Tail in Future Prediction of Traffic Actorscited by 48
- 2021Human Trajectory Prediction via Counterfactual Analysiscited by 42
- 2022STCrowd: A Multimodal Dataset for Pedestrian Perception in Crowded Scenescited by 35
- 2021CausalCity: Complex Simulations with Agency for Causal Discovery and Reasoningcited by 23
- 2022PedFormer: Pedestrian Behavior Prediction via Cross-Modal Attention Modulation and Gated Multitask Learningcited by 23
- 2023Machine Learning for Autonomous Vehicle's Trajectory Prediction: A comprehensive survey, Challenges, and Future Research Directionscited by 23
38 more
- 2022S2TNet: Spatio-Temporal Transformer Networks for Trajectory Prediction in Autonomous Drivingcited by 22
- 2021Variational Autoencoder-Based Vehicle Trajectory Prediction with an Interpretable Latent Spacecited by 20
- 2024T4P: Test-Time Training of Trajectory Prediction via Masked Autoencoder and Actor-specific Token Memorycited by 20
- 2022LatentFormer: Multi-Agent Transformer-Based Interaction Modeling and Trajectory Predictioncited by 19
- 2023Pedestrian Trajectory Prediction in Pedestrian-Vehicle Mixed Environments: A Systematic Reviewcited by 18
- 2021Unlimited Neighborhood Interaction for Heterogeneous Trajectory Predictioncited by 17
- 2021Propagating State Uncertainty Through Trajectory Forecastingcited by 17
- 2021Egocentric Human Trajectory Forecasting with a Wearable Camera and Multi-Modal Fusioncited by 17
- 2021SCOUT: Socially-COnsistent and UndersTandable Graph Attention Network for Trajectory Prediction of Vehicles and VRUscited by 16
- 2021Euro-PVI: Pedestrian Vehicle Interactions in Dense Urban Centerscited by 16
- 2023Another Vertical View: A Hierarchical Network for Heterogeneous Trajectory Prediction via Spectrumscited by 14
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directionscited by 14
- 2021baller2vec++: A Look-Ahead Multi-Entity Transformer For Modeling Coordinated Agentscited by 12
- 2023A Novel Benchmarking Paradigm and a Scale- and Motion-Aware Model for Egocentric Pedestrian Trajectory Predictioncited by 12
- 2023RiskBench: A Scenario-based Benchmark for Risk Identificationcited by 12
- 2021METEOR:A Dense, Heterogeneous, and Unstructured Traffic Dataset With Rare Behaviorscited by 11
- 2022Heterogeneous Trajectory Forecasting via Risk and Scene Graph Learningcited by 11
- 2022D2-TPred: Discontinuous Dependency for Trajectory Prediction under Traffic Lightscited by 10
- 2023EPG-MGCN: Ego-Planning Guided Multi-Graph Convolutional Network for Heterogeneous Agent Trajectory Predictioncited by 10
- 2021DROID: Driver-centric Risk Object Identificationcited by 9
- 2022Trajectory Forecasting from Detection with Uncertainty-Aware Motion Encodingcited by 8
- 2024Pedestrian Trajectory Prediction with Missing Data: Datasets, Imputation, and Benchmarkingcited by 8
- 2021Social-IWSTCNN: A Social Interaction-Weighted Spatio-Temporal Convolutional Neural Network for Pedestrian Trajectory Prediction in Urban Traffic Scenarioscited by 7
- 2022Learning the Pedestrian-Vehicle Interaction for Pedestrian Trajectory Predictioncited by 7
- 2022Deep Learning based Computer Vision Methods for Complex Traffic Environments Perception: A Reviewcited by 7
- 2021Multi-modal Trajectory Prediction for Autonomous Driving with Semantic Map and Dynamic Graph Attention Networkcited by 6
- 2024Multi-Agent Inverse Reinforcement Learning in Real World Unstructured Pedestrian Crowdscited by 6
- 2024Generating Traffic Scenarios via In-Context Learning to Learn Better Motion Plannercited by 6
- 2023iPLAN: Intent-Aware Planning in Heterogeneous Traffic via Distributed Multi-Agent Reinforcement Learningcited by 5
- 2025ParkDiffusion: Heterogeneous Multi-Agent Multi-Modal Trajectory Prediction for Automated Parking using Diffusion Modelscited by 5
- 2021Indoor Future Person Localization from an Egocentric Wearable Cameracited by 4
- 2022Cross-modal Contrastive Distillation for Instructional Activity Anticipationcited by 4
- 2023Learning Road Scene-level Representations via Semantic Region Predictioncited by 4
- 2023A POV-based Highway Vehicle Trajectory Dataset and Prediction Architecturecited by 4
- 2023How Does Traffic Environment Quantitatively Affect the Autonomous Driving Prediction?cited by 3
- 2023Towards Safe Autonomy in Hybrid Traffic: Detecting Unpredictable Abnormal Behaviors of Human Drivers via Information Sharingcited by 3
- 2024StreamMOTP: Streaming and Unified Framework for Joint 3D Multi-Object Tracking and Trajectory Predictioncited by 3
- 2024Building Real-time Awareness of Out-of-distribution in Trajectory Prediction for Autonomous Vehiclescited by 3
50 most cited of 82 All 82 (JSON)
- 2026Physics-Informed CNN-LSTM for Street-Scale Urban Flood Prediction: Reconciling Aggregate Accuracy and Street-Level Plausibility27 Jul 2026
- 2026Shift & Drift: A Zero-Shot Benchmark for Generalizable and Robust Autonomous Driving Motion Planning8 Jul 2026
- 2026A Pedestrian-Vehicle Interaction Benchmark and Annotation Framework for Unstructured Scenes via Uncalibrated Cameras25 May 2026
- 2026RankFormer: A Propose-then-Select Transformer for Multi-Agent Multimodal Trajectory Prediction8 Apr 2026
- 2026Uncertainty-Aware Vision-based Risk Object Identification via Conformal Risk Tube Prediction25 Mar 2026
- 2026Class-Incremental Motion Forecasting10 Mar 2026
- 2026HetroD: A High-Fidelity Drone Dataset and Benchmark for Autonomous Driving in Heterogeneous Traffic3 Feb 2026
- 2025Prompt-Driven Domain Adaptation for End-to-End Autonomous Driving via In-Context RL16 Nov 2025
- 2025Are LLMs The Way Forward? A Case Study on LLM-Guided Reinforcement Learning for Decentralized Autonomous Driving16 Nov 2025
- 2025Dynamic Model Selection for Trajectory Prediction via Pairwise Ranking and Meta-Features31 Oct 2025
- 2025Trajectory prediction for heterogeneous agents: A performance analysis on small and imbalanced datasets4 Oct 2025
- 2025Collaborative-Distilled Diffusion Models (CDDM) for Accelerated and Lightweight Trajectory Prediction1 Oct 2025
38 more
- 2025End-to-End Visual Autonomous Parking via Control-Aided Attention14 Sep 2025
- 2025LTMSformer: A Local Trend-Aware Attention and Motion State Encoding Transformer for Multi-Agent Trajectory Prediction7 Jul 2025
- 2025ParkDiffusion: Heterogeneous Multi-Agent Multi-Modal Trajectory Prediction for Automated Parking using Diffusion Models1 May 2025
- 2025Post-interactive Multimodal Trajectory Prediction for Autonomous Driving12 Mar 2025
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directions5 Mar 2025
- 2025EMT: A Visual Multi-Task Benchmark Dataset for Autonomous Driving26 Feb 2025
- 2025Characterizing Structured versus Unstructured Environments based on Pedestrians' and Vehicles' Motion Trajectories24 Feb 2025
- 2024Generating Traffic Scenarios via In-Context Learning to Learn Better Motion Planner24 Dec 2024
- 2024Pedestrian Trajectory Prediction with Missing Data: Datasets, Imputation, and Benchmarking31 Oct 2024
- 2024Building Real-time Awareness of Out-of-distribution in Trajectory Prediction for Autonomous Vehicles25 Sep 2024
- 2024Potential Field as Scene Affordance for Behavior Change-Based Visual Risk Object Identification24 Sep 2024
- 2024Reputation-Driven Asynchronous Federated Learning for Enhanced Trajectory Prediction with Blockchain28 Jul 2024
- 2024StreamMOTP: Streaming and Unified Framework for Joint 3D Multi-Object Tracking and Trajectory Prediction28 Jun 2024
- 2024A Multi-Stage Goal-Driven Network for Pedestrian Trajectory Prediction26 Jun 2024
- 2024Multi-Agent Inverse Reinforcement Learning in Real World Unstructured Pedestrian Crowds26 May 2024
- 2024Transfer-LMR: Heavy-Tail Driving Behavior Recognition in Diverse Traffic Scenarios8 May 2024
- 2024T4P: Test-Time Training of Trajectory Prediction via Masked Autoencoder and Actor-specific Token Memory15 Mar 2024
- 2023RiskBench: A Scenario-based Benchmark for Risk Identification4 Dec 2023
- 2023Spatial-Temporal Conditional Random Field for Human Trajectory Prediction30 Nov 2023
- 2023A Novel Benchmarking Paradigm and a Scale- and Motion-Aware Model for Egocentric Pedestrian Trajectory Prediction16 Oct 2023
- 2023Human trajectory prediction using LSTM with Attention mechanism1 Sep 2023
- 2023Towards Safe Autonomy in Hybrid Traffic: Detecting Unpredictable Abnormal Behaviors of Human Drivers via Information Sharing23 Aug 2023
- 2023Interaction-Aware Personalized Vehicle Trajectory Prediction Using Temporal Graph Neural Networks14 Aug 2023
- 2023Pedestrian Trajectory Prediction in Pedestrian-Vehicle Mixed Environments: A Systematic Review11 Aug 2023
- 2023Machine Learning for Autonomous Vehicle's Trajectory Prediction: A comprehensive survey, Challenges, and Future Research Directions12 Jul 2023
- 2023Decentralized Social Navigation with Non-Cooperative Robots via Bi-Level Optimization15 Jun 2023
- 2023iPLAN: Intent-Aware Planning in Heterogeneous Traffic via Distributed Multi-Agent Reinforcement Learning9 Jun 2023
- 2023Another Vertical View: A Hierarchical Network for Heterogeneous Trajectory Prediction via Spectrums11 Apr 2023
- 2023EPG-MGCN: Ego-Planning Guided Multi-Graph Convolutional Network for Heterogeneous Agent Trajectory Prediction29 Mar 2023
- 2023A Dynamic Multi-Scale Voxel Flow Network for Video Prediction17 Mar 2023
- 2023A POV-based Highway Vehicle Trajectory Dataset and Prediction Architecture10 Mar 2023
- 2023SG-LSTM: Social Group LSTM for Robot Navigation Through Dense Crowds8 Mar 2023
- 2023How Does Traffic Environment Quantitatively Affect the Autonomous Driving Prediction?11 Jan 2023
- 2023Learning Road Scene-level Representations via Semantic Region Prediction2 Jan 2023
- 2022Deep Learning based Computer Vision Methods for Complex Traffic Environments Perception: A Review9 Nov 2022
- 2022Heterogeneous Trajectory Forecasting via Risk and Scene Graph Learning2 Nov 2022
- 2022PedFormer: Pedestrian Behavior Prediction via Cross-Modal Attention Modulation and Gated Multitask Learning14 Oct 2022
- 2022D2-TPred: Discontinuous Dependency for Trajectory Prediction under Traffic Lights21 Jul 2022
50 newest of 82 All 82 (JSON)
- 2023Machine Learning for Autonomous Vehicle's Trajectory Prediction: A comprehensive survey, Challenges, and Future Research Directionscited by 23
- 2025Prompt-Driven Domain Adaptation for End-to-End Autonomous Driving via In-Context RLcited by 1
- 2025Are LLMs The Way Forward? A Case Study on LLM-Guided Reinforcement Learning for Decentralized Autonomous Drivingcited by 0
- 2026Shift & Drift: A Zero-Shot Benchmark for Generalizable and Robust Autonomous Driving Motion Planningcited by 0
- 2026Shift & Drift: A Zero-Shot Benchmark for Generalizable and Robust Autonomous Driving Motion Planning8 Jul 2026
- 2025Prompt-Driven Domain Adaptation for End-to-End Autonomous Driving via In-Context RL16 Nov 2025
- 2025Are LLMs The Way Forward? A Case Study on LLM-Guided Reinforcement Learning for Decentralized Autonomous Driving16 Nov 2025
- 2023Machine Learning for Autonomous Vehicle's Trajectory Prediction: A comprehensive survey, Challenges, and Future Research Directions12 Jul 2023
- 2022On Adversarial Robustness of Trajectory Prediction for Autonomous Vehiclescited by 89
- 2022SocialVAE: Human Trajectory Prediction using Timewise Latentscited by 65
- 2021Video Prediction Recalling Long-term Motion Context via Memory Alignment Learningcited by 62
- 2021ROAD: The ROad event Awareness Dataset for Autonomous Drivingcited by 54
- 2023A Dynamic Multi-Scale Voxel Flow Network for Video Predictioncited by 53
- 2021On Exposing the Challenging Long Tail in Future Prediction of Traffic Actorscited by 48
- 2021Human Trajectory Prediction via Counterfactual Analysiscited by 42
- 2022STCrowd: A Multimodal Dataset for Pedestrian Perception in Crowded Scenescited by 35
- 2021CausalCity: Complex Simulations with Agency for Causal Discovery and Reasoningcited by 23
- 2022PedFormer: Pedestrian Behavior Prediction via Cross-Modal Attention Modulation and Gated Multitask Learningcited by 23
- 2022S2TNet: Spatio-Temporal Transformer Networks for Trajectory Prediction in Autonomous Drivingcited by 22
- 2021Variational Autoencoder-Based Vehicle Trajectory Prediction with an Interpretable Latent Spacecited by 20
12 most cited of 74 All 74 (JSON)
- 2026Physics-Informed CNN-LSTM for Street-Scale Urban Flood Prediction: Reconciling Aggregate Accuracy and Street-Level Plausibility27 Jul 2026
- 2026A Pedestrian-Vehicle Interaction Benchmark and Annotation Framework for Unstructured Scenes via Uncalibrated Cameras25 May 2026
- 2026RankFormer: A Propose-then-Select Transformer for Multi-Agent Multimodal Trajectory Prediction8 Apr 2026
- 2026Uncertainty-Aware Vision-based Risk Object Identification via Conformal Risk Tube Prediction25 Mar 2026
- 2026Class-Incremental Motion Forecasting10 Mar 2026
- 2026HetroD: A High-Fidelity Drone Dataset and Benchmark for Autonomous Driving in Heterogeneous Traffic3 Feb 2026
- 2025Dynamic Model Selection for Trajectory Prediction via Pairwise Ranking and Meta-Features31 Oct 2025
- 2025Trajectory prediction for heterogeneous agents: A performance analysis on small and imbalanced datasets4 Oct 2025
- 2025End-to-End Visual Autonomous Parking via Control-Aided Attention14 Sep 2025
- 2025LTMSformer: A Local Trend-Aware Attention and Motion State Encoding Transformer for Multi-Agent Trajectory Prediction7 Jul 2025
- 2025Post-interactive Multimodal Trajectory Prediction for Autonomous Driving12 Mar 2025
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directions5 Mar 2025
12 newest of 74 All 74 (JSON)