Identifying Driver Interactions via Conditional Behavior Prediction
Not on the map. Why?
Abstract (arXiv)
Interactive driving scenarios, such as lane changes, merges and unprotected turns, are some of the most challenging situations for autonomous driving. Planning in interactive scenarios requires accurately modeling the reactions of other agents to different future actions of the ego agent. We develop end-to-end models for conditional behavior prediction (CBP) that take as an input a query future trajectory for an ego-agent, and predict distributions over future trajectories for other agents conditioned on the query. Leveraging such a model, we develop a general-purpose agent interactivity score derived from probabilistic first principles. The interactivity score allows us to find interesting interactive scenarios for training and evaluating behavior prediction models. We further demonstrate that the proposed score is effective for agent prioritization under computational budget constraints.
Key facts. Cited by 48 papers in the map (data through 14 Oct 2026). First posted on arXiv 20 Apr 2021.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 13; 2023: 15; 2024: 8; 2025: 3; 2026: 4.
48 papers.
Sort:
By area:
- 2022Motion Transformer with Global Intention Localization and Local Movement Refinementcited by 270
- 2021MultiPath++: Efficient Information Fusion and Trajectory Aggregation for Behavior Predictioncited by 246
- 2023MotionDiffuser: Controllable Multi-Agent Motion Prediction using Diffusioncited by 213
- 2021Scene Transformer: A unified architecture for predicting multiple agent trajectoriescited by 165
- 2023MotionLM: Multi-Agent Motion Forecasting as Language Modelingcited by 156
- 2023GameFormer: Game-theoretic Modeling and Learning of Transformer-based Interactive Prediction and Planning for Autonomous Drivingcited by 141
- 2023MTR++: Multi-Agent Motion Prediction with Symmetric Scene Modeling and Guided Intention Queryingcited by 140
- 2022M2I: From Factored Marginal Trajectory Prediction to Interactive Predictioncited by 81
- 2023DTPP: Differentiable Joint Conditional Prediction and Cost Evaluation for Tree Policy Planning in Autonomous Drivingcited by 46
- 2022JFP: Joint Future Prediction with Interactive Multi-Agent Modeling for Autonomous Drivingcited by 40
- 2022Conditional Predictive Behavior Planning with Inverse Reinforcement Learning for Human-like Autonomous Drivingcited by 34
- 2022Safe Real-World Autonomous Driving by Learning to Predict and Plan with a Mixture of Expertscited by 29
36 more
- 2023The Integration of Prediction and Planning in Deep Learning Automated Driving Systems: A Reviewcited by 29
- 2023WOMD-LiDAR: Raw Sensor Dataset Benchmark for Motion Forecastingcited by 28
- 2023trajdata: A Unified Interface to Multiple Human Trajectory Datasetscited by 25
- 2021Injecting Planning-Awareness into Prediction and Detection Evaluationcited by 21
- 2022CausalAgents: A Robustness Benchmark for Motion Forecasting using Causal Relationshipscited by 18
- 2022MTR-A: 1st Place Solution for 2022 Waymo Open Dataset Challenge -- Motion Predictioncited by 17
- 2022StopNet: Scalable Trajectory and Occupancy Prediction for Urban Autonomous Drivingcited by 14
- 2021Rethinking Trajectory Forecasting Evaluationcited by 11
- 2023InteRACT: Transformer Models for Human Intent Prediction Conditioned on Robot Actionscited by 11
- 2023Editing Driver Character: Socially-Controllable Behavior Generation for Interactive Traffic Simulationcited by 10
- 2023Interactive Autonomous Navigation with Internal State Inference and Interactivity Estimationcited by 10
- 2022Domain Knowledge Driven Pseudo Labels for Interpretable Goal-Conditioned Interactive Trajectory Predictioncited by 9
- 2021TIP: Task-Informed Motion Prediction for Intelligent Vehiclescited by 8
- 2022Interventional Behavior Prediction: Avoiding Overly Confident Anticipation in Interactive Predictioncited by 8
- 2024MoST: Multi-modality Scene Tokenization for Motion Predictioncited by 8
- 2023Learning Interaction-aware Motion Prediction Model for Decision-making in Autonomous Drivingcited by 6
- 2024FutureNet-LOF: Joint Trajectory Prediction and Lane Occupancy Field Prediction with Future Context Encodingcited by 6
- 2024Learning Online Belief Prediction for Efficient POMDP Planning in Autonomous Drivingcited by 5
- 2024Stochasticity in Motion: An Information-Theoretic Approach to Trajectory Predictioncited by 5
- 2023RESET: Revisiting Trajectory Sets for Conditional Behavior Predictioncited by 4
- 2024SceneMotion: From Agent-Centric Embeddings to Scene-Wide Forecastscited by 4
- 2024Motion Forecasting via Model-Based Risk Minimizationcited by 4
- 2022Conditional Goal-oriented Trajectory Prediction for Interacting Vehicles with Vectorized Representationcited by 3
- 2023FFINet: Future Feedback Interaction Network for Motion Forecastingcited by 3
- 2025Generative AI for Autonomous Driving: A Reviewcited by 3
- 2026ParkDiffusion++: Ego Intention Conditioned Joint Multi-Agent Trajectory Prediction for Automated Parking using Diffusion Modelscited by 3
- 2024FIMP: Future Interaction Modeling for Multi-Agent Motion Predictioncited by 2
- 2024MAP-Former: Multi-Agent-Pair Gaussian Joint Predictioncited by 2
- 2022ProspectNet: Weighted Conditional Attention for Future Interaction Modeling in Behavior Predictioncited by 1
- 2025RDAR: Reward-Driven Agent Relevance Estimation for Autonomous Drivingcited by 1
- 2022RTGNN: A Novel Approach to Model Stochastic Traffic Dynamicscited by 0
- 2023Graph-based Trajectory Prediction with Cooperative Informationcited by 0
- 2025Conditional Prediction by Simulation for Automated Drivingcited by 0
- 2026Digital-Twin Losses for Lane-Compliant Trajectory Prediction at Urban Intersectionscited by 0
- 2026Unveiling Transferability in Trajectory Prediction via Latent Scene Embeddingscited by 0
- 2026Pivot-Centric Trajectory Prediction: Bridging Long Horizons via Dynamical Guidancecited by 0
- 2026Pivot-Centric Trajectory Prediction: Bridging Long Horizons via Dynamical Guidance4 Aug 2026
- 2026Unveiling Transferability in Trajectory Prediction via Latent Scene Embeddings29 Jun 2026
- 2026Digital-Twin Losses for Lane-Compliant Trajectory Prediction at Urban Intersections4 Mar 2026
- 2026ParkDiffusion++: Ego Intention Conditioned Joint Multi-Agent Trajectory Prediction for Automated Parking using Diffusion Models24 Feb 2026
- 2025RDAR: Reward-Driven Agent Relevance Estimation for Autonomous Driving24 Sep 2025
- 2025Generative AI for Autonomous Driving: A Review21 May 2025
- 2025Conditional Prediction by Simulation for Automated Driving5 Feb 2025
- 2024Stochasticity in Motion: An Information-Theoretic Approach to Trajectory Prediction2 Oct 2024
- 2024Motion Forecasting via Model-Based Risk Minimization16 Sep 2024
- 2024SceneMotion: From Agent-Centric Embeddings to Scene-Wide Forecasts2 Aug 2024
- 2024FutureNet-LOF: Joint Trajectory Prediction and Lane Occupancy Field Prediction with Future Context Encoding20 Jun 2024
- 2024MoST: Multi-modality Scene Tokenization for Motion Prediction30 Apr 2024
36 more
- 2024MAP-Former: Multi-Agent-Pair Gaussian Joint Prediction30 Apr 2024
- 2024FIMP: Future Interaction Modeling for Multi-Agent Motion Prediction29 Jan 2024
- 2024Learning Online Belief Prediction for Efficient POMDP Planning in Autonomous Driving27 Jan 2024
- 2023Interactive Autonomous Navigation with Internal State Inference and Interactivity Estimation27 Nov 2023
- 2023InteRACT: Transformer Models for Human Intent Prediction Conditioned on Robot Actions21 Nov 2023
- 2023FFINet: Future Feedback Interaction Network for Motion Forecasting8 Nov 2023
- 2023Graph-based Trajectory Prediction with Cooperative Information24 Oct 2023
- 2023DTPP: Differentiable Joint Conditional Prediction and Cost Evaluation for Tree Policy Planning in Autonomous Driving9 Oct 2023
- 2023MotionLM: Multi-Agent Motion Forecasting as Language Modeling28 Sep 2023
- 2023The Integration of Prediction and Planning in Deep Learning Automated Driving Systems: A Review10 Aug 2023
- 2023trajdata: A Unified Interface to Multiple Human Trajectory Datasets26 Jul 2023
- 2023MTR++: Multi-Agent Motion Prediction with Symmetric Scene Modeling and Guided Intention Querying30 Jun 2023
- 2023MotionDiffuser: Controllable Multi-Agent Motion Prediction using Diffusion5 Jun 2023
- 2023RESET: Revisiting Trajectory Sets for Conditional Behavior Prediction12 Apr 2023
- 2023WOMD-LiDAR: Raw Sensor Dataset Benchmark for Motion Forecasting7 Apr 2023
- 2023Editing Driver Character: Socially-Controllable Behavior Generation for Interactive Traffic Simulation24 Mar 2023
- 2023GameFormer: Game-theoretic Modeling and Learning of Transformer-based Interactive Prediction and Planning for Autonomous Driving10 Mar 2023
- 2023Learning Interaction-aware Motion Prediction Model for Decision-making in Autonomous Driving8 Feb 2023
- 2022Conditional Predictive Behavior Planning with Inverse Reinforcement Learning for Human-like Autonomous Driving17 Dec 2022
- 2022JFP: Joint Future Prediction with Interactive Multi-Agent Modeling for Autonomous Driving16 Dec 2022
- 2022Safe Real-World Autonomous Driving by Learning to Predict and Plan with a Mixture of Experts3 Nov 2022
- 2022Conditional Goal-oriented Trajectory Prediction for Interacting Vehicles with Vectorized Representation19 Oct 2022
- 2022Motion Transformer with Global Intention Localization and Local Movement Refinement27 Sep 2022
- 2022MTR-A: 1st Place Solution for 2022 Waymo Open Dataset Challenge -- Motion Prediction20 Sep 2022
- 2022ProspectNet: Weighted Conditional Attention for Future Interaction Modeling in Behavior Prediction29 Aug 2022
- 2022CausalAgents: A Robustness Benchmark for Motion Forecasting using Causal Relationships7 Jul 2022
- 2022StopNet: Scalable Trajectory and Occupancy Prediction for Urban Autonomous Driving2 Jun 2022
- 2022Interventional Behavior Prediction: Avoiding Overly Confident Anticipation in Interactive Prediction19 Apr 2022
- 2022Domain Knowledge Driven Pseudo Labels for Interpretable Goal-Conditioned Interactive Trajectory Prediction28 Mar 2022
- 2022M2I: From Factored Marginal Trajectory Prediction to Interactive Prediction24 Feb 2022
- 2022RTGNN: A Novel Approach to Model Stochastic Traffic Dynamics21 Feb 2022
- 2021MultiPath++: Efficient Information Fusion and Trajectory Aggregation for Behavior Prediction29 Nov 2021
- 2021TIP: Task-Informed Motion Prediction for Intelligent Vehicles17 Oct 2021
- 2021Injecting Planning-Awareness into Prediction and Detection Evaluation7 Oct 2021
- 2021Rethinking Trajectory Forecasting Evaluation21 Jul 2021
- 2021Scene Transformer: A unified architecture for predicting multiple agent trajectories15 Jun 2021
- 2023GameFormer: Game-theoretic Modeling and Learning of Transformer-based Interactive Prediction and Planning for Autonomous Drivingcited by 141
- 2023DTPP: Differentiable Joint Conditional Prediction and Cost Evaluation for Tree Policy Planning in Autonomous Drivingcited by 46
- 2022JFP: Joint Future Prediction with Interactive Multi-Agent Modeling for Autonomous Drivingcited by 40
- 2022Conditional Predictive Behavior Planning with Inverse Reinforcement Learning for Human-like Autonomous Drivingcited by 34
- 2022Safe Real-World Autonomous Driving by Learning to Predict and Plan with a Mixture of Expertscited by 29
- 2023Learning Interaction-aware Motion Prediction Model for Decision-making in Autonomous Drivingcited by 6
- 2024Learning Online Belief Prediction for Efficient POMDP Planning in Autonomous Drivingcited by 5
- 2025Conditional Prediction by Simulation for Automated Drivingcited by 0
- 2025Conditional Prediction by Simulation for Automated Driving5 Feb 2025
- 2024Learning Online Belief Prediction for Efficient POMDP Planning in Autonomous Driving27 Jan 2024
- 2023DTPP: Differentiable Joint Conditional Prediction and Cost Evaluation for Tree Policy Planning in Autonomous Driving9 Oct 2023
- 2023GameFormer: Game-theoretic Modeling and Learning of Transformer-based Interactive Prediction and Planning for Autonomous Driving10 Mar 2023
- 2023Learning Interaction-aware Motion Prediction Model for Decision-making in Autonomous Driving8 Feb 2023
- 2022Conditional Predictive Behavior Planning with Inverse Reinforcement Learning for Human-like Autonomous Driving17 Dec 2022
- 2022JFP: Joint Future Prediction with Interactive Multi-Agent Modeling for Autonomous Driving16 Dec 2022
- 2022Safe Real-World Autonomous Driving by Learning to Predict and Plan with a Mixture of Experts3 Nov 2022
- 2023MotionLM: Multi-Agent Motion Forecasting as Language Modelingcited by 156
- 2021MultiPath++: Efficient Information Fusion and Trajectory Aggregation for Behavior Predictioncited by 246
- 2023MTR++: Multi-Agent Motion Prediction with Symmetric Scene Modeling and Guided Intention Queryingcited by 140
- 2022M2I: From Factored Marginal Trajectory Prediction to Interactive Predictioncited by 81
- 2023The Integration of Prediction and Planning in Deep Learning Automated Driving Systems: A Reviewcited by 29
- 2023WOMD-LiDAR: Raw Sensor Dataset Benchmark for Motion Forecastingcited by 28
- 2023trajdata: A Unified Interface to Multiple Human Trajectory Datasetscited by 25
- 2021Injecting Planning-Awareness into Prediction and Detection Evaluationcited by 21
- 2022CausalAgents: A Robustness Benchmark for Motion Forecasting using Causal Relationshipscited by 18
- 2022MTR-A: 1st Place Solution for 2022 Waymo Open Dataset Challenge -- Motion Predictioncited by 17
- 2022StopNet: Scalable Trajectory and Occupancy Prediction for Urban Autonomous Drivingcited by 14
- 2021Rethinking Trajectory Forecasting Evaluationcited by 11
- 2023InteRACT: Transformer Models for Human Intent Prediction Conditioned on Robot Actionscited by 11
12 most cited of 35 All 35 (JSON)
- 2026Pivot-Centric Trajectory Prediction: Bridging Long Horizons via Dynamical Guidance4 Aug 2026
- 2026Unveiling Transferability in Trajectory Prediction via Latent Scene Embeddings29 Jun 2026
- 2026Digital-Twin Losses for Lane-Compliant Trajectory Prediction at Urban Intersections4 Mar 2026
- 2025RDAR: Reward-Driven Agent Relevance Estimation for Autonomous Driving24 Sep 2025
- 2025Generative AI for Autonomous Driving: A Review21 May 2025
- 2024Stochasticity in Motion: An Information-Theoretic Approach to Trajectory Prediction2 Oct 2024
- 2024Motion Forecasting via Model-Based Risk Minimization16 Sep 2024
- 2024SceneMotion: From Agent-Centric Embeddings to Scene-Wide Forecasts2 Aug 2024
- 2024FutureNet-LOF: Joint Trajectory Prediction and Lane Occupancy Field Prediction with Future Context Encoding20 Jun 2024
- 2024MoST: Multi-modality Scene Tokenization for Motion Prediction30 Apr 2024
- 2024MAP-Former: Multi-Agent-Pair Gaussian Joint Prediction30 Apr 2024
- 2024FIMP: Future Interaction Modeling for Multi-Agent Motion Prediction29 Jan 2024
12 newest of 35 All 35 (JSON)