BiTraP: Bi-directional Pedestrian Trajectory Prediction with Multi-modal Goal Estimation
Not on the map. Why?
Abstract (arXiv)
Pedestrian trajectory prediction is an essential task in robotic applications such as autonomous driving and robot navigation. State-of-the-art trajectory predictors use a conditional variational autoencoder (CVAE) with recurrent neural networks (RNNs) to encode observed trajectories and decode multi-modal future trajectories. This process can suffer from accumulated errors over long prediction horizons (>=2 seconds). This paper presents BiTraP, a goal-conditioned bi-directional multi-modal trajectory prediction method based on the CVAE. BiTraP estimates the goal (end-point) of trajectories and introduces a novel bi-directional decoder to improve longer-term trajectory prediction accuracy. Extensive experiments show that BiTraP generalizes to both first-person view (FPV) and bird's-eye view (BEV) scenarios and outperforms state-of-the-art results by ~10-50%. We also show that different choices of non-parametric versus parametric target models in the CVAE directly influence the predicted multi-modal trajectory distributions. These results provide guidance on trajectory predictor design for robotic applications such as collision avoidance and navigation systems.
Key facts. Cited by 47 papers in the map (data through 7 Oct 2026). First posted on arXiv 29 Jul 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 7; 2023: 10; 2024: 9; 2025: 11; 2026: 5.
47 papers.
Sort:
By area:
- 2022SocialVAE: Human Trajectory Prediction using Timewise Latentscited by 65
- 2021Stepwise Goal-Driven Networks for Trajectory Predictioncited by 62
- 2021LOKI: Long Term and Key Intentions for Trajectory Predictioncited by 57
- 2023EigenTrajectory: Low-Rank Descriptors for Multi-Modal Trajectory Forecastingcited by 41
- 2024SingularTrajectory: Universal Trajectory Predictor Using Diffusion Modelcited by 35
- 2024Can Language Beat Numerical Regression? Language-Based Multimodal Trajectory Predictioncited by 31
- 2023NOPA: Neurally-guided Online Probabilistic Assistance for Building Socially Intelligent Home Assistantscited by 23
- 2021PSI: A Benchmark for Human Interpretation and Response in Traffic Interactionscited by 17
- 2023Joint Metrics Matter: A Better Standard for Trajectory Forecastingcited by 17
- 2022Action-based Contrastive Learning for Trajectory Predictioncited by 15
- 2021Coupling Intent and Action for Pedestrian Crossing Behavior Predictioncited by 14
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directionscited by 14
35 more
- 2022STGlow: A Flow-based Generative Framework with Dual Graphormer for Pedestrian Trajectory Predictioncited by 13
- 2024Geometric Trajectory Diffusion Modelscited by 13
- 2023Context-Aware Timewise VAEs for Real-Time Vehicle Trajectory Predictioncited by 12
- 2023A Novel Benchmarking Paradigm and a Scale- and Motion-Aware Model for Egocentric Pedestrian Trajectory Predictioncited by 12
- 2024Recurrent Aligned Network for Generalized Pedestrian Trajectory Predictioncited by 8
- 2022BiPOCO: Bi-Directional Trajectory Prediction with Pose Constraints for Pedestrian Anomaly Detectioncited by 7
- 2025Continuous Locomotive Crowd Behavior Generationcited by 7
- 2025SocialMOIF: Multi-Order Intention Fusion for Pedestrian Trajectory Predictioncited by 7
- 2021Asymmetrical Bi-RNN for pedestrian trajectory encodingcited by 6
- 2022On-Board Pedestrian Trajectory Prediction Using Behavioral Featurescited by 5
- 2023DESTINE: Dynamic Goal Queries with Temporal Transductive Alignment for Trajectory Predictioncited by 5
- 2023Context-aware Pedestrian Trajectory Prediction with Multimodal Transformercited by 4
- 2023Sparse Pedestrian Character Learning for Trajectory Predictioncited by 3
- 2024Context-aware Multi-task Learning for Pedestrian Intent and Trajectory Predictioncited by 3
- 2025Mimir: Hierarchical Goal-Driven Diffusion with Uncertainty Propagation for End-to-End Autonomous Drivingcited by 3
- 2022Social-DualCVAE: Multimodal Trajectory Forecasting Based on Social Interactions Pattern Aware and Dual Conditional Variational Auto-Encodercited by 2
- 2025ASTRA: A Scene-aware TRAnsformer-based model for trajectory predictioncited by 2
- 2025SGNetPose+: Stepwise Goal-Driven Networks with Pose Information for Trajectory Prediction in Autonomous Drivingcited by 2
- 2024GoalNet: Goal Areas Oriented Pedestrian Trajectory Predictioncited by 1
- 2024Socially-Informed Reconstruction for Pedestrian Trajectory Forecastingcited by 1
- 2025SceneAware: Scene-Constrained Pedestrian Trajectory Prediction with LLM-Guided Walkabilitycited by 1
- 2025Pedestrian Intention and Trajectory Prediction in Unstructured Traffic Using IDD-PeDcited by 1
- 2026Social-Mamba: Socially-Aware Trajectory Forecasting with State-Space Modelscited by 1
- 2022Leveraging Trajectory Prediction for Pedestrian Video Anomaly Detectioncited by 0
- 2023Towards Autonomous and Safe Last-mile Deliveries with AI-augmented Self-driving Delivery Robotscited by 0
- 2023Semantic and Articulated Pedestrian Sensing Onboard a Moving Vehiclecited by 0
- 2024WTTFNet: A Weather-Time-Trajectory Fusion Network for Pedestrian Trajectory Prediction in Urban Complexcited by 0
- 2024A Multi-Stage Goal-Driven Network for Pedestrian Trajectory Predictioncited by 0
- 2025A Spatio-temporal Graph Network Allowing Incomplete Trajectory Input for Pedestrian Trajectory Predictioncited by 0
- 2025MGTraj: Multi-Granularity Goal-Guided Human Trajectory Prediction with Recursive Refinement Networkcited by 0
- 2025KoopCast: Trajectory Forecasting via Koopman Operatorscited by 0
- 2026TrajMamba: An Ego-Motion-Guided Mamba Model for Pedestrian Trajectory Prediction from an Egocentric Perspectivecited by 0
- 2026Single-Eye View: Monocular Real-time Perception Package for Autonomous Drivingcited by 0
- 2026MUSCLE-NET: Predicted-Multiscale-Aware Network for Pedestrian Trajectory Forecastingcited by 0
- 2026Where Will They Go? Modelling Multimodal Pedestrian Manoeuvres from Ego-centric Videoscited by 0
- 2026Where Will They Go? Modelling Multimodal Pedestrian Manoeuvres from Ego-centric Videos17 Jun 2026
- 2026MUSCLE-NET: Predicted-Multiscale-Aware Network for Pedestrian Trajectory Forecasting30 May 2026
- 2026Social-Mamba: Socially-Aware Trajectory Forecasting with State-Space Models14 May 2026
- 2026Single-Eye View: Monocular Real-time Perception Package for Autonomous Driving22 Mar 2026
- 2026TrajMamba: An Ego-Motion-Guided Mamba Model for Pedestrian Trajectory Prediction from an Egocentric Perspective16 Mar 2026
- 2025Mimir: Hierarchical Goal-Driven Diffusion with Uncertainty Propagation for End-to-End Autonomous Driving8 Dec 2025
- 2025KoopCast: Trajectory Forecasting via Koopman Operators19 Sep 2025
- 2025MGTraj: Multi-Granularity Goal-Guided Human Trajectory Prediction with Recursive Refinement Network11 Sep 2025
- 2025Pedestrian Intention and Trajectory Prediction in Unstructured Traffic Using IDD-PeD27 Jun 2025
- 2025SceneAware: Scene-Constrained Pedestrian Trajectory Prediction with LLM-Guided Walkability17 Jun 2025
- 2025SocialMOIF: Multi-Order Intention Fusion for Pedestrian Trajectory Prediction22 Apr 2025
- 2025Continuous Locomotive Crowd Behavior Generation7 Apr 2025
35 more
- 2025SGNetPose+: Stepwise Goal-Driven Networks with Pose Information for Trajectory Prediction in Autonomous Driving11 Mar 2025
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directions5 Mar 2025
- 2025A Spatio-temporal Graph Network Allowing Incomplete Trajectory Input for Pedestrian Trajectory Prediction22 Jan 2025
- 2025ASTRA: A Scene-aware TRAnsformer-based model for trajectory prediction16 Jan 2025
- 2024Socially-Informed Reconstruction for Pedestrian Trajectory Forecasting5 Dec 2024
- 2024Geometric Trajectory Diffusion Models16 Oct 2024
- 2024Context-aware Multi-task Learning for Pedestrian Intent and Trajectory Prediction24 Jul 2024
- 2024A Multi-Stage Goal-Driven Network for Pedestrian Trajectory Prediction26 Jun 2024
- 2024WTTFNet: A Weather-Time-Trajectory Fusion Network for Pedestrian Trajectory Prediction in Urban Complex29 May 2024
- 2024SingularTrajectory: Universal Trajectory Predictor Using Diffusion Model27 Mar 2024
- 2024Can Language Beat Numerical Regression? Language-Based Multimodal Trajectory Prediction27 Mar 2024
- 2024Recurrent Aligned Network for Generalized Pedestrian Trajectory Prediction9 Mar 2024
- 2024GoalNet: Goal Areas Oriented Pedestrian Trajectory Prediction29 Feb 2024
- 2023Sparse Pedestrian Character Learning for Trajectory Prediction27 Nov 2023
- 2023A Novel Benchmarking Paradigm and a Scale- and Motion-Aware Model for Egocentric Pedestrian Trajectory Prediction16 Oct 2023
- 2023DESTINE: Dynamic Goal Queries with Temporal Transductive Alignment for Trajectory Prediction11 Oct 2023
- 2023Semantic and Articulated Pedestrian Sensing Onboard a Moving Vehicle12 Sep 2023
- 2023EigenTrajectory: Low-Rank Descriptors for Multi-Modal Trajectory Forecasting18 Jul 2023
- 2023Context-aware Pedestrian Trajectory Prediction with Multimodal Transformer7 Jul 2023
- 2023Towards Autonomous and Safe Last-mile Deliveries with AI-augmented Self-driving Delivery Robots28 May 2023
- 2023Joint Metrics Matter: A Better Standard for Trajectory Forecasting10 May 2023
- 2023Context-Aware Timewise VAEs for Real-Time Vehicle Trajectory Prediction21 Feb 2023
- 2023NOPA: Neurally-guided Online Probabilistic Assistance for Building Socially Intelligent Home Assistants12 Jan 2023
- 2022STGlow: A Flow-based Generative Framework with Dual Graphormer for Pedestrian Trajectory Prediction21 Nov 2022
- 2022On-Board Pedestrian Trajectory Prediction Using Behavioral Features21 Oct 2022
- 2022Action-based Contrastive Learning for Trajectory Prediction18 Jul 2022
- 2022BiPOCO: Bi-Directional Trajectory Prediction with Pose Constraints for Pedestrian Anomaly Detection5 Jul 2022
- 2022Leveraging Trajectory Prediction for Pedestrian Video Anomaly Detection5 Jul 2022
- 2022SocialVAE: Human Trajectory Prediction using Timewise Latents15 Mar 2022
- 2022Social-DualCVAE: Multimodal Trajectory Forecasting Based on Social Interactions Pattern Aware and Dual Conditional Variational Auto-Encoder8 Feb 2022
- 2021PSI: A Benchmark for Human Interpretation and Response in Traffic Interactions5 Dec 2021
- 2021LOKI: Long Term and Key Intentions for Trajectory Prediction18 Aug 2021
- 2021Asymmetrical Bi-RNN for pedestrian trajectory encoding1 Jun 2021
- 2021Coupling Intent and Action for Pedestrian Crossing Behavior Prediction10 May 2021
- 2021Stepwise Goal-Driven Networks for Trajectory Prediction25 Mar 2021
- 2024SingularTrajectory: Universal Trajectory Predictor Using Diffusion Modelcited by 35
- 2024Geometric Trajectory Diffusion Modelscited by 13
- 2024Geometric Trajectory Diffusion Models16 Oct 2024
- 2024SingularTrajectory: Universal Trajectory Predictor Using Diffusion Model27 Mar 2024
- 2022SocialVAE: Human Trajectory Prediction using Timewise Latentscited by 65
- 2021Stepwise Goal-Driven Networks for Trajectory Predictioncited by 62
- 2021LOKI: Long Term and Key Intentions for Trajectory Predictioncited by 57
- 2023EigenTrajectory: Low-Rank Descriptors for Multi-Modal Trajectory Forecastingcited by 41
- 2024Can Language Beat Numerical Regression? Language-Based Multimodal Trajectory Predictioncited by 31
- 2023NOPA: Neurally-guided Online Probabilistic Assistance for Building Socially Intelligent Home Assistantscited by 23
- 2021PSI: A Benchmark for Human Interpretation and Response in Traffic Interactionscited by 17
- 2023Joint Metrics Matter: A Better Standard for Trajectory Forecastingcited by 17
- 2022Action-based Contrastive Learning for Trajectory Predictioncited by 15
- 2021Coupling Intent and Action for Pedestrian Crossing Behavior Predictioncited by 14
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directionscited by 14
- 2022STGlow: A Flow-based Generative Framework with Dual Graphormer for Pedestrian Trajectory Predictioncited by 13
12 most cited of 41 All 41 (JSON)
- 2026Where Will They Go? Modelling Multimodal Pedestrian Manoeuvres from Ego-centric Videos17 Jun 2026
- 2026MUSCLE-NET: Predicted-Multiscale-Aware Network for Pedestrian Trajectory Forecasting30 May 2026
- 2025KoopCast: Trajectory Forecasting via Koopman Operators19 Sep 2025
- 2025MGTraj: Multi-Granularity Goal-Guided Human Trajectory Prediction with Recursive Refinement Network11 Sep 2025
- 2025Pedestrian Intention and Trajectory Prediction in Unstructured Traffic Using IDD-PeD27 Jun 2025
- 2025SceneAware: Scene-Constrained Pedestrian Trajectory Prediction with LLM-Guided Walkability17 Jun 2025
- 2025SocialMOIF: Multi-Order Intention Fusion for Pedestrian Trajectory Prediction22 Apr 2025
- 2025Continuous Locomotive Crowd Behavior Generation7 Apr 2025
- 2025SGNetPose+: Stepwise Goal-Driven Networks with Pose Information for Trajectory Prediction in Autonomous Driving11 Mar 2025
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directions5 Mar 2025
- 2025A Spatio-temporal Graph Network Allowing Incomplete Trajectory Input for Pedestrian Trajectory Prediction22 Jan 2025
- 2025ASTRA: A Scene-aware TRAnsformer-based model for trajectory prediction16 Jan 2025
12 newest of 41 All 41 (JSON)