PiP: Planning-informed Trajectory Prediction for Autonomous Driving
Not on the map. Why?
Cited by 25 in End-to-end autonomous driving, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
It is critical to predict the motion of surrounding vehicles for self-driving planning, especially in a socially compliant and flexible way. However, future prediction is challenging due to the interaction and uncertainty in driving behaviors. We propose planning-informed trajectory prediction (PiP) to tackle the prediction problem in the multi-agent setting. Our approach is differentiated from the traditional manner of prediction, which is only based on historical information and decoupled with planning. By informing the prediction process with the planning of ego vehicle, our method achieves the state-of-the-art performance of multi-agent forecasting on highway datasets. Moreover, our approach enables a novel pipeline which couples the prediction and planning, by conditioning PiP on multiple candidate trajectories of the ego vehicle, which is highly beneficial for autonomous driving in interactive scenarios.
Key facts. Cited by 80 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 Mar 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 10; 2023: 21; 2024: 22; 2025: 13; 2026: 6.
80 papers.
Sort:
By area:
- 2022Planning-oriented Autonomous Drivingcited by 1,068
- 2023Parting with Misconceptions about Learning-based Vehicle Motion Planningcited by 238
- 2023MotionDiffuser: Controllable Multi-Agent Motion Prediction using Diffusioncited by 210
- 2023MotionLM: Multi-Agent Motion Forecasting as Language Modelingcited by 154
- 2023GameFormer: Game-theoretic Modeling and Learning of Transformer-based Interactive Prediction and Planning for Autonomous Drivingcited by 141
- 2021LaneRCNN: Distributed Representations for Graph-Centric Motion Forecastingcited by 112
- 2022Differentiable Integrated Motion Prediction and Planning with Learnable Cost Function for Autonomous Drivingcited by 71
- 2023Exploring Recurrent Long-term Temporal Fusion for Multi-view 3D Perceptioncited by 65
- 2021Learning to Predict Vehicle Trajectories with Model-based Planningcited by 63
- 2023LAformer: Trajectory Prediction for Autonomous Driving with Lane-Aware Scene Constraintscited by 50
- 2023Cam4DOcc: Benchmark for Camera-Only 4D Occupancy Forecasting in Autonomous Driving Applicationscited by 50
- 2023DTPP: Differentiable Joint Conditional Prediction and Cost Evaluation for Tree Policy Planning in Autonomous Drivingcited by 46
38 more
- 2025ReSim: Reliable World Simulation for Autonomous Drivingcited by 42
- 2022JFP: Joint Future Prediction with Interactive Multi-Agent Modeling for Autonomous Drivingcited by 40
- 2022Conditional Predictive Behavior Planning with Inverse Reinforcement Learning for Human-like Autonomous Drivingcited by 34
- 2023The Integration of Prediction and Planning in Deep Learning Automated Driving Systems: A Reviewcited by 29
- 2022Deep Interactive Motion Prediction and Planning: Playing Games with Motion Prediction Modelscited by 27
- 2024SMART: Scalable Multi-agent Real-time Motion Generation via Next-token Predictioncited by 25
- 2025SOLVE: Synergy of Language-Vision and End-to-End Networks for Autonomous Drivingcited by 21
- 2021Deep Structured Reactive Planningcited by 18
- 2021End-to-End Interactive Prediction and Planning with Optical Flow Distillation for Autonomous Drivingcited by 17
- 2021Euro-PVI: Pedestrian Vehicle Interactions in Dense Urban Centerscited by 16
- 2024Progressive Pretext Task Learning for Human Trajectory Predictioncited by 16
- 2021Safety-aware Motion Prediction with Unseen Vehicles for Autonomous Drivingcited by 15
- 2025Co-MTP: A Cooperative Trajectory Prediction Framework with Multi-Temporal Fusion for Autonomous Drivingcited by 14
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directionscited by 14
- 2024Prompting Multi-Modal Tokens to Enhance End-to-End Autonomous Driving Imitation Learning with LLMscited by 13
- 2025OccProphet: Pushing Efficiency Frontier of Camera-Only 4D Occupancy Forecasting with Observer-Forecaster-Refiner Frameworkcited by 11
- 2023EPG-MGCN: Ego-Planning Guided Multi-Graph Convolutional Network for Heterogeneous Agent Trajectory Predictioncited by 10
- 2023Graph-Based Interaction-Aware Multimodal 2D Vehicle Trajectory Prediction using Diffusion Graph Convolutional Networkscited by 10
- 2023InteRACT: Transformer Models for Human Intent Prediction Conditioned on Robot Actionscited by 10
- 2025ColaVLA: Leveraging Cognitive Latent Reasoning for Hierarchical Parallel Trajectory Planning in Autonomous Drivingcited by 10
- 2022Pishgu: Universal Path Prediction Network Architecture for Real-time Cyber-physical Edge Systemscited by 9
- 2024EgoNav: Egocentric Scene-aware Human Trajectory Predictioncited by 9
- 2024C2F-TP: A Coarse-to-Fine Denoising Framework for Uncertainty-Aware Trajectory Predictioncited by 9
- 2021TIP: Task-Informed Motion Prediction for Intelligent Vehiclescited by 8
- 2022Trajectory Forecasting from Detection with Uncertainty-Aware Motion Encodingcited by 8
- 2022Interventional Behavior Prediction: Avoiding Overly Confident Anticipation in Interactive Predictioncited by 8
- 2023Occupancy Prediction-Guided Neural Planner for Autonomous Drivingcited by 8
- 2023BiFF: Bi-level Future Fusion with Polyline-based Coordinate for Interactive Trajectory Predictioncited by 8
- 2024MoST: Multi-modality Scene Tokenization for Motion Predictioncited by 8
- 2025Motion Forecasting for Autonomous Vehicles: A Surveycited by 8
- 2021Grounding Linguistic Commands to Navigable Regionscited by 6
- 2022Vehicle Trajectory Prediction on Highways Using Bird Eye View Representations and Deep Learningcited by 6
- 2023Learning Interaction-aware Motion Prediction Model for Decision-making in Autonomous Drivingcited by 6
- 2024Hypergraph-based Motion Generation with Multi-modal Interaction Relational Reasoningcited by 6
- 2024Goal-based Neural Physics Vehicle Trajectory Prediction Modelcited by 6
- 2025AI2-Active Safety: AI-enabled Interaction-aware Active Safety Analysis with Vehicle Dynamicscited by 6
- 2025Foresight in Motion: Reinforcing Trajectory Prediction with Reward Heuristicscited by 6
- 2022DiPA: Probabilistic Multi-Modal Interactive Prediction for Autonomous Drivingcited by 5
50 most cited of 80 All 80 (JSON)
- 2026INTERACT: Interactive Planning for Autonomous Driving via Anchor-Conditioned Prediction and Trust-Region Refinement25 Sep 2026
- 2026From Cues to Horizons: Dynamic Risk Horizon Profiling for Trajectory Prediction30 May 2026
- 2026Diverse Yet Consistent: Context-Guided Diffusion with Energy-Based Joint Refinement for Multi-Agent Motion Prediction21 May 2026
- 2026Chatting about Conditional Trajectory Prediction20 Apr 2026
- 2026DynFlowDrive: Flow-Based Dynamic World Modeling for Autonomous Driving20 Mar 2026
- 2026ParkDiffusion++: Ego Intention Conditioned Joint Multi-Agent Trajectory Prediction for Automated Parking using Diffusion Models24 Feb 2026
- 2025ColaVLA: Leveraging Cognitive Latent Reasoning for Hierarchical Parallel Trajectory Planning in Autonomous Driving28 Dec 2025
- 2025HYPE: Hybrid Planning with Ego Proposal-Conditioned Predictions14 Oct 2025
- 2025SocialTraj: Two-Stage Socially-Aware Trajectory Prediction for Autonomous Driving via Conditional Diffusion Model22 Sep 2025
- 2025Foresight in Motion: Reinforcing Trajectory Prediction with Reward Heuristics16 Jul 2025
- 2025ReSim: Reliable World Simulation for Autonomous Driving11 Jun 2025
- 2025Trajectory Entropy: Modeling Game State Stability from Multimodality Trajectory Prediction6 Jun 2025
38 more
- 2025Simulating the Unseen: Crash Prediction Must Learn from What Did Not Happen27 May 2025
- 2025SOLVE: Synergy of Language-Vision and End-to-End Networks for Autonomous Driving22 May 2025
- 2025AI2-Active Safety: AI-enabled Interaction-aware Active Safety Analysis with Vehicle Dynamics1 May 2025
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directions5 Mar 2025
- 2025Co-MTP: A Cooperative Trajectory Prediction Framework with Multi-Temporal Fusion for Autonomous Driving23 Feb 2025
- 2025OccProphet: Pushing Efficiency Frontier of Camera-Only 4D Occupancy Forecasting with Observer-Forecaster-Refiner Framework21 Feb 2025
- 2025Motion Forecasting for Autonomous Vehicles: A Survey10 Feb 2025
- 2024TrajLearn: Trajectory Prediction Learning using Deep Generative Models30 Dec 2024
- 2024C2F-TP: A Coarse-to-Fine Denoising Framework for Uncertainty-Aware Trajectory Prediction17 Dec 2024
- 2024PlanScope: Learning to Plan Within Decision Scope for Urban Autonomous Driving1 Nov 2024
- 2024Planning-Aware Diffusion Networks for Enhanced Motion Forecasting in Autonomous Driving25 Oct 2024
- 2024Goal-based Neural Physics Vehicle Trajectory Prediction Model23 Sep 2024
- 2024Hypergraph-based Motion Generation with Multi-modal Interaction Relational Reasoning18 Sep 2024
- 2024Module-wise Adaptive Adversarial Training for End-to-end Autonomous Driving11 Sep 2024
- 2024Multi-scale Temporal Fusion Transformer for Incomplete Vehicle Trajectory Prediction2 Sep 2024
- 2024Enhancing End-to-End Autonomous Driving Systems Through Synchronized Human Behavior Data20 Aug 2024
- 2024Progressive Pretext Task Learning for Human Trajectory Prediction16 Jul 2024
- 2024MSTF: Multiscale Transformer for Incomplete Trajectory Prediction8 Jul 2024
- 2024SMART: Scalable Multi-agent Real-time Motion Generation via Next-token Prediction24 May 2024
- 2024Interpretable Interaction Modeling for Trajectory Prediction via Agent Selection and Physical Coefficient21 May 2024
- 2024MaskFuser: Masked Fusion of Joint Multi-Modal Tokenization for End-to-End Autonomous Driving13 May 2024
- 2024Multi-agent Traffic Prediction via Denoised Endpoint Distribution11 May 2024
- 2024MoST: Multi-modality Scene Tokenization for Motion Prediction30 Apr 2024
- 2024GRANP: A Graph Recurrent Attentive Neural Process Model for Vehicle Trajectory Prediction9 Apr 2024
- 2024Prompting Multi-Modal Tokens to Enhance End-to-End Autonomous Driving Imitation Learning with LLMs7 Apr 2024
- 2024EgoNav: Egocentric Scene-aware Human Trajectory Prediction27 Mar 2024
- 2024Pioneering SE(2)-Equivariant Trajectory Planning for Automated Driving17 Mar 2024
- 2024Tractable Joint Prediction and Planning over Discrete Behavior Modes for Urban Driving12 Mar 2024
- 2024Learning Online Belief Prediction for Efficient POMDP Planning in Autonomous Driving27 Jan 2024
- 2023Natural-language-driven Simulation Benchmark and Copilot for Efficient Production of Object Interactions in Virtual Road Scenes7 Dec 2023
- 2023Spatial-Temporal Conditional Random Field for Human Trajectory Prediction30 Nov 2023
- 2023STF: Spatial Temporal Fusion for Trajectory Prediction29 Nov 2023
- 2023Cam4DOcc: Benchmark for Camera-Only 4D Occupancy Forecasting in Autonomous Driving Applications29 Nov 2023
- 2023InteRACT: Transformer Models for Human Intent Prediction Conditioned on Robot Actions21 Nov 2023
- 2023IR-STP: Enhancing Autonomous Driving with Interaction Reasoning in Spatio-Temporal Planning6 Nov 2023
- 2023Graph-based Trajectory Prediction with Cooperative Information24 Oct 2023
- 2023DTPP: Differentiable Joint Conditional Prediction and Cost Evaluation for Tree Policy Planning in Autonomous Driving9 Oct 2023
- 2023MotionLM: Multi-Agent Motion Forecasting as Language Modeling28 Sep 2023
50 newest of 80 All 80 (JSON)
- 2023GameFormer: Game-theoretic Modeling and Learning of Transformer-based Interactive Prediction and Planning for Autonomous Drivingcited by 141
- 2022Differentiable Integrated Motion Prediction and Planning with Learnable Cost Function for Autonomous Drivingcited by 71
- 2023DTPP: Differentiable Joint Conditional Prediction and Cost Evaluation for Tree Policy Planning in Autonomous Drivingcited by 46
- 2022JFP: Joint Future Prediction with Interactive Multi-Agent Modeling for Autonomous Drivingcited by 40
- 2022Conditional Predictive Behavior Planning with Inverse Reinforcement Learning for Human-like Autonomous Drivingcited by 34
- 2021End-to-End Interactive Prediction and Planning with Optical Flow Distillation for Autonomous Drivingcited by 17
- 2024Prompting Multi-Modal Tokens to Enhance End-to-End Autonomous Driving Imitation Learning with LLMscited by 13
- 2023Occupancy Prediction-Guided Neural Planner for Autonomous Drivingcited by 8
- 2023Learning Interaction-aware Motion Prediction Model for Decision-making in Autonomous Drivingcited by 6
- 2022DiPA: Probabilistic Multi-Modal Interactive Prediction for Autonomous Drivingcited by 5
- 2024Learning Online Belief Prediction for Efficient POMDP Planning in Autonomous Drivingcited by 5
- 2024Pioneering SE(2)-Equivariant Trajectory Planning for Automated Drivingcited by 4
12 most cited of 19 All 19 (JSON)
- 2026INTERACT: Interactive Planning for Autonomous Driving via Anchor-Conditioned Prediction and Trust-Region Refinement25 Sep 2026
- 2024PlanScope: Learning to Plan Within Decision Scope for Urban Autonomous Driving1 Nov 2024
- 2024Module-wise Adaptive Adversarial Training for End-to-end Autonomous Driving11 Sep 2024
- 2024Enhancing End-to-End Autonomous Driving Systems Through Synchronized Human Behavior Data20 Aug 2024
- 2024MaskFuser: Masked Fusion of Joint Multi-Modal Tokenization for End-to-End Autonomous Driving13 May 2024
- 2024Prompting Multi-Modal Tokens to Enhance End-to-End Autonomous Driving Imitation Learning with LLMs7 Apr 2024
- 2024Pioneering SE(2)-Equivariant Trajectory Planning for Automated Driving17 Mar 2024
- 2024Tractable Joint Prediction and Planning over Discrete Behavior Modes for Urban Driving12 Mar 2024
- 2024Learning Online Belief Prediction for Efficient POMDP Planning in Autonomous Driving27 Jan 2024
- 2023IR-STP: Enhancing Autonomous Driving with Interaction Reasoning in Spatio-Temporal Planning6 Nov 2023
- 2023DTPP: Differentiable Joint Conditional Prediction and Cost Evaluation for Tree Policy Planning in Autonomous Driving9 Oct 2023
- 2023Occupancy Prediction-Guided Neural Planner for Autonomous Driving5 May 2023
12 newest of 19 All 19 (JSON)
- 2023MotionDiffuser: Controllable Multi-Agent Motion Prediction using Diffusioncited by 210
- 2023Cam4DOcc: Benchmark for Camera-Only 4D Occupancy Forecasting in Autonomous Driving Applicationscited by 50
- 2025ReSim: Reliable World Simulation for Autonomous Drivingcited by 42
- 2025OccProphet: Pushing Efficiency Frontier of Camera-Only 4D Occupancy Forecasting with Observer-Forecaster-Refiner Frameworkcited by 11
- 2026DynFlowDrive: Flow-Based Dynamic World Modeling for Autonomous Drivingcited by 2
- 2026DynFlowDrive: Flow-Based Dynamic World Modeling for Autonomous Driving20 Mar 2026
- 2025ReSim: Reliable World Simulation for Autonomous Driving11 Jun 2025
- 2025OccProphet: Pushing Efficiency Frontier of Camera-Only 4D Occupancy Forecasting with Observer-Forecaster-Refiner Framework21 Feb 2025
- 2023Cam4DOcc: Benchmark for Camera-Only 4D Occupancy Forecasting in Autonomous Driving Applications29 Nov 2023
- 2023MotionDiffuser: Controllable Multi-Agent Motion Prediction using Diffusion5 Jun 2023
- 2024EgoNav: Egocentric Scene-aware Human Trajectory Predictioncited by 9
- 2026ParkDiffusion++: Ego Intention Conditioned Joint Multi-Agent Trajectory Prediction for Automated Parking using Diffusion Modelscited by 3
- 2025SocialTraj: Two-Stage Socially-Aware Trajectory Prediction for Autonomous Driving via Conditional Diffusion Modelcited by 0
- 2026Diverse Yet Consistent: Context-Guided Diffusion with Energy-Based Joint Refinement for Multi-Agent Motion Predictioncited by 0
- 2026Diverse Yet Consistent: Context-Guided Diffusion with Energy-Based Joint Refinement for Multi-Agent Motion Prediction21 May 2026
- 2026ParkDiffusion++: Ego Intention Conditioned Joint Multi-Agent Trajectory Prediction for Automated Parking using Diffusion Models24 Feb 2026
- 2025SocialTraj: Two-Stage Socially-Aware Trajectory Prediction for Autonomous Driving via Conditional Diffusion Model22 Sep 2025
- 2024EgoNav: Egocentric Scene-aware Human Trajectory Prediction27 Mar 2024
- 2023MotionLM: Multi-Agent Motion Forecasting as Language Modelingcited by 154
- 2022Planning-oriented Autonomous Drivingcited by 1,068
- 2023Parting with Misconceptions about Learning-based Vehicle Motion Planningcited by 238
- 2021LaneRCNN: Distributed Representations for Graph-Centric Motion Forecastingcited by 112
- 2023Exploring Recurrent Long-term Temporal Fusion for Multi-view 3D Perceptioncited by 65
- 2021Learning to Predict Vehicle Trajectories with Model-based Planningcited by 63
- 2023LAformer: Trajectory Prediction for Autonomous Driving with Lane-Aware Scene Constraintscited by 50
- 2023The Integration of Prediction and Planning in Deep Learning Automated Driving Systems: A Reviewcited by 29
- 2022Deep Interactive Motion Prediction and Planning: Playing Games with Motion Prediction Modelscited by 27
- 2024SMART: Scalable Multi-agent Real-time Motion Generation via Next-token Predictioncited by 25
- 2021Deep Structured Reactive Planningcited by 18
- 2021Euro-PVI: Pedestrian Vehicle Interactions in Dense Urban Centerscited by 16
- 2024Progressive Pretext Task Learning for Human Trajectory Predictioncited by 16
12 most cited of 49 All 49 (JSON)
- 2026From Cues to Horizons: Dynamic Risk Horizon Profiling for Trajectory Prediction30 May 2026
- 2026Chatting about Conditional Trajectory Prediction20 Apr 2026
- 2025HYPE: Hybrid Planning with Ego Proposal-Conditioned Predictions14 Oct 2025
- 2025Foresight in Motion: Reinforcing Trajectory Prediction with Reward Heuristics16 Jul 2025
- 2025Trajectory Entropy: Modeling Game State Stability from Multimodality Trajectory Prediction6 Jun 2025
- 2025Simulating the Unseen: Crash Prediction Must Learn from What Did Not Happen27 May 2025
- 2025AI2-Active Safety: AI-enabled Interaction-aware Active Safety Analysis with Vehicle Dynamics1 May 2025
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directions5 Mar 2025
- 2025Co-MTP: A Cooperative Trajectory Prediction Framework with Multi-Temporal Fusion for Autonomous Driving23 Feb 2025
- 2025Motion Forecasting for Autonomous Vehicles: A Survey10 Feb 2025
- 2024TrajLearn: Trajectory Prediction Learning using Deep Generative Models30 Dec 2024
- 2024C2F-TP: A Coarse-to-Fine Denoising Framework for Uncertainty-Aware Trajectory Prediction17 Dec 2024
12 newest of 49 All 49 (JSON)