Behavioral Intention Prediction in Driving Scenes: A Survey
Not on the map. Why?
Abstract (arXiv)
In the driving scene, the road agents usually conduct frequent interactions and intention understanding of the surroundings. Ego-agent (each road agent itself) predicts what behavior will be engaged by other road users all the time and expects a shared and consistent understanding for safe movement. Behavioral Intention Prediction (BIP) simulates such a human consideration process and fulfills the early prediction of specific behaviors. Similar to other prediction tasks, such as trajectory prediction, data-driven deep learning methods have taken the primary pipeline in research. The rapid development of BIP inevitably leads to new issues and challenges. To catalyze future research, this work provides a comprehensive review of BIP from the available datasets, key factors and challenges, pedestrian-centric and vehicle-centric BIP approaches, and BIP-aware applications. Based on the investigation, data-driven deep learning approaches have become the primary pipelines. The behavioral intention types are still monotonous in most current datasets and methods (e.g., Crossing (C) and Not Crossing (NC) for pedestrians and Lane Changing (LC) for vehicles) in this field. In addition, for the safe-critical scenarios (e.g., near-crashing situations), current research is limited. Through this investigation, we identify open issues in behavioral intention prediction and suggest possible insights for future research.
Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). Builds on 165 of its 310 references that are in the map. First posted on arXiv 1 Nov 2022.
Builds on
165 of 310 references.
References · 165
- 2017Attention Is All You Needcited by 59,932
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
- 2019Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shiftcited by 1,274
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,213
- 2021Domain Generalization: A Surveycited by 760
- 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 728
- 2021A Survey of Uncertainty in Deep Neural Networkscited by 675
- 2021KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3Dcited by 570
- 2017AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehiclescited by 517
38 more
- 2022Image as a Foreign Language: BEiT Pretraining for All Vision and Vision-Language Taskscited by 510
- 2019Measuring Calibration in Deep Learningcited by 443
- 2019MultiPath: Multiple Probabilistic Anchor Trajectory Hypotheses for Behavior Predictioncited by 417
- 2021Dynamic Neural Networks: A Surveycited by 405
- 2018Deep Learning for Generic Object Detection: A Surveycited by 392
- 2020Learning Lane Graph Representations for Motion Forecastingcited by 380
- 2020TNT: Target-driveN Trajectory Predictioncited by 345
- 2020Social-STGCNN: A Social Spatio-Temporal Graph Convolutional Neural Network for Human Trajectory Predictioncited by 324
- 2019Deep Multi-modal Object Detection and Semantic Segmentation for Autonomous Driving: Datasets, Methods, and Challengescited by 313
- 2017DESIRE: Distant Future Prediction in Dynamic Scenes with Interacting Agentscited by 310
- 2020V2VNet: Vehicle-to-Vehicle Communication for Joint Perception and Predictioncited by 292
- 2021DenseTNT: End-to-end Trajectory Prediction from Dense Goal Setscited by 292
- 2021MetaDrive: Composing Diverse Driving Scenarios for Generalizable Reinforcement Learningcited by 281
- 2018The highD Dataset: A Drone Dataset of Naturalistic Vehicle Trajectories on German Highways for Validation of Highly Automated Driving Systemscited by 276
- 2022Cross-view Transformers for real-time Map-view Semantic Segmentationcited by 264
- 2019CoverNet: Multimodal Behavior Prediction using Trajectory Setscited by 259
- 2021MultiPath++: Efficient Information Fusion and Trajectory Aggregation for Behavior Predictioncited by 246
- 2019Human Motion Trajectory Prediction: A Surveycited by 231
- 2019INTERACTION Dataset: An INTERnational, Adversarial and Cooperative moTION Dataset in Interactive Driving Scenarios with Semantic Mapscited by 231
- 2019Social-BiGAT: Multimodal Trajectory Forecasting using Bicycle-GAN and Graph Attention Networkscited by 228
- 2018Human Action Recognition and Prediction: A Surveycited by 226
- 2020Rectifying Pseudo Label Learning via Uncertainty Estimation for Domain Adaptive Semantic Segmentationcited by 222
- 2020Neural Prototype Trees for Interpretable Fine-grained Image Recognitioncited by 213
- 2021MP3: A Unified Model to Map, Perceive, Predict and Plancited by 211
- 2021TrafficSim: Learning to Simulate Realistic Multi-Agent Behaviorscited by 192
- 2019PRECOG: PREdiction Conditioned On Goals in Visual Multi-Agent Settingscited by 178
- 2020Predicting Semantic Map Representations from Images using Pyramid Occupancy Networkscited by 175
- 2017Playing for Benchmarkscited by 169
- 2020Posterior Network: Uncertainty Estimation without OOD Samples via Density-Based Pseudo-Countscited by 163
- 2021IntentNet: Learning to Predict Intention from Raw Sensor Datacited by 158
- 2022V2X-Sim: Multi-Agent Collaborative Perception Dataset and Benchmark for Autonomous Drivingcited by 157
- 2020University-1652: A Multi-view Multi-source Benchmark for Drone-based Geo-localizationcited by 152
- 2020Perceive, Predict, and Plan: Safe Motion Planning Through Interpretable Semantic Representationscited by 150
- 2022Learning from All Vehiclescited by 135
- 2021AdvSim: Generating Safety-Critical Scenarios for Self-Driving Vehiclescited by 132
- 2019Meta-Sim: Learning to Generate Synthetic Datasetscited by 128
- 2019Rules of the Road: Predicting Driving Behavior with a Convolutional Model of Semantic Interactionscited by 117
- 2022ViP3D: End-to-end Visual Trajectory Prediction via 3D Agent Queriescited by 116
50 most cited of 165 All 165 (JSON)
Built on by
Citing papers per year: 2022: 4; 2023: 4; 2024: 11; 2025: 10; 2026: 1.
30 papers.
Sort:
By area:
- 2022PiPa: Pixel- and Patch-wise Self-supervised Learning for Domain Adaptative Semantic Segmentationcited by 41
- 2023MTP-GO: Graph-Based Probabilistic Multi-Agent Trajectory Prediction with Neural ODEscited by 19
- 2022Cognitive Accident Prediction in Driving Scenes: A Multimodality Benchmarkcited by 16
- 2024Diffusion-Based Environment-Aware Trajectory Predictioncited by 14
- 2022Heterogeneous Trajectory Forecasting via Risk and Scene Graph Learningcited by 11
- 2022Targeted Adversarial Attacks against Neural Network Trajectory Predictorscited by 11
- 2023Evaluating Pedestrian Trajectory Prediction Methods with Respect to Autonomous Drivingcited by 11
- 2024PIP-Net: Pedestrian Intention Prediction in the Wildcited by 11
- 2024Joint Perception and Prediction for Autonomous Driving: A Surveycited by 7
- 2024Vulnerable Road User Detection and Safety Enhancement: A Comprehensive Surveycited by 5
- 2025Deep Learning Approaches for Multimodal Intent Recognition: A Surveycited by 5
- 2025SalM2: An Extremely Lightweight Saliency Mamba Model for Real-Time Cognitive Awareness of Driver Attentioncited by 4
18 more
- 2023An Overview about Emerging Technologies of Autonomous Drivingcited by 2
- 2023SegDA: Maximum Separable Segment Mask with Pseudo Labels for Domain Adaptive Semantic Segmentationcited by 2
- 2024Toward Unified Practices in Trajectory Prediction Research on Bird's-Eye-View Datasetscited by 2
- 2024Enhanced Prediction of Multi-Agent Trajectories via Control Inference and State-Space Dynamicscited by 2
- 2025INTENT: Trajectory Prediction Framework with Intention-Guided Contrastive Clusteringcited by 2
- 2025Pedestrian-Aware Motion Planning for Autonomous Driving in Complex Urban Scenarioscited by 2
- 2025MMHU: A Massive-Scale Multimodal Benchmark for Human Behavior Understandingcited by 2
- 2024Gating Syn-to-Real Knowledge for Pedestrian Crossing Prediction in Safe Drivingcited by 1
- 2024Feature Importance in Pedestrian Intention Prediction: A Context-Aware Reviewcited by 1
- 2025Evaluating Scenario-based Decision-making for Interactive Autonomous Driving Using Rational Criteria: A Surveycited by 1
- 2025Occlusion-Aware Diffusion Model for Pedestrian Intention Predictioncited by 1
- 2024Designing deep neural networks for driver intention recognitioncited by 0
- 2024Vehicle Behavior Prediction by Episodic-Memory Implanted NDTcited by 0
- 2024MapsTP: HD Map Images Based Multimodal Trajectory Prediction for Automated Vehiclescited by 0
- 2025Spatial Temporal Attention based Target Vehicle Trajectory Prediction for Internet of Vehiclescited by 0
- 2025Toward Safety-First Human-Like Decision Making for Autonomous Vehicles in Time-Varying Traffic Flowcited by 0
- 2025PEDRA: Evaluating the Realism of Pedestrian Dynamics in Video Generationcited by 0
- 2026Unveiling Transferability in Trajectory Prediction via Latent Scene Embeddingscited by 0
- 2026Unveiling Transferability in Trajectory Prediction via Latent Scene Embeddings29 Jun 2026
- 2025Occlusion-Aware Diffusion Model for Pedestrian Intention Prediction2 Nov 2025
- 2025PEDRA: Evaluating the Realism of Pedestrian Dynamics in Video Generation23 Oct 2025
- 2025Deep Learning Approaches for Multimodal Intent Recognition: A Survey24 Jul 2025
- 2025MMHU: A Massive-Scale Multimodal Benchmark for Human Behavior Understanding16 Jul 2025
- 2025Toward Safety-First Human-Like Decision Making for Autonomous Vehicles in Time-Varying Traffic Flow17 Jun 2025
- 2025Pedestrian-Aware Motion Planning for Autonomous Driving in Complex Urban Scenarios2 Apr 2025
- 2025INTENT: Trajectory Prediction Framework with Intention-Guided Contrastive Clustering6 Mar 2025
- 2025SalM2: An Extremely Lightweight Saliency Mamba Model for Real-Time Cognitive Awareness of Driver Attention22 Feb 2025
- 2025Evaluating Scenario-based Decision-making for Interactive Autonomous Driving Using Rational Criteria: A Survey3 Jan 2025
- 2025Spatial Temporal Attention based Target Vehicle Trajectory Prediction for Internet of Vehicles1 Jan 2025
- 2024Joint Perception and Prediction for Autonomous Driving: A Survey18 Dec 2024
18 more
- 2024Feature Importance in Pedestrian Intention Prediction: A Context-Aware Review11 Sep 2024
- 2024Gating Syn-to-Real Knowledge for Pedestrian Crossing Prediction in Safe Driving24 Aug 2024
- 2024Enhanced Prediction of Multi-Agent Trajectories via Control Inference and State-Space Dynamics8 Aug 2024
- 2024MapsTP: HD Map Images Based Multimodal Trajectory Prediction for Automated Vehicles8 Jul 2024
- 2024Vulnerable Road User Detection and Safety Enhancement: A Comprehensive Survey29 May 2024
- 2024Toward Unified Practices in Trajectory Prediction Research on Bird's-Eye-View Datasets1 May 2024
- 2024Diffusion-Based Environment-Aware Trajectory Prediction18 Mar 2024
- 2024PIP-Net: Pedestrian Intention Prediction in the Wild20 Feb 2024
- 2024Vehicle Behavior Prediction by Episodic-Memory Implanted NDT13 Feb 2024
- 2024Designing deep neural networks for driver intention recognition7 Feb 2024
- 2023SegDA: Maximum Separable Segment Mask with Pseudo Labels for Domain Adaptive Semantic Segmentation10 Aug 2023
- 2023Evaluating Pedestrian Trajectory Prediction Methods with Respect to Autonomous Driving9 Aug 2023
- 2023An Overview about Emerging Technologies of Autonomous Driving23 Jun 2023
- 2023MTP-GO: Graph-Based Probabilistic Multi-Agent Trajectory Prediction with Neural ODEs1 Feb 2023
- 2022Cognitive Accident Prediction in Driving Scenes: A Multimodality Benchmark19 Dec 2022
- 2022Targeted Adversarial Attacks against Neural Network Trajectory Predictors8 Dec 2022
- 2022PiPa: Pixel- and Patch-wise Self-supervised Learning for Domain Adaptative Semantic Segmentation14 Nov 2022
- 2022Heterogeneous Trajectory Forecasting via Risk and Scene Graph Learning2 Nov 2022
- 2023An Overview about Emerging Technologies of Autonomous Drivingcited by 2
- 2025Pedestrian-Aware Motion Planning for Autonomous Driving in Complex Urban Scenarioscited by 2
- 2025Evaluating Scenario-based Decision-making for Interactive Autonomous Driving Using Rational Criteria: A Surveycited by 1
- 2025Toward Safety-First Human-Like Decision Making for Autonomous Vehicles in Time-Varying Traffic Flowcited by 0
- 2025Toward Safety-First Human-Like Decision Making for Autonomous Vehicles in Time-Varying Traffic Flow17 Jun 2025
- 2025Pedestrian-Aware Motion Planning for Autonomous Driving in Complex Urban Scenarios2 Apr 2025
- 2025Evaluating Scenario-based Decision-making for Interactive Autonomous Driving Using Rational Criteria: A Survey3 Jan 2025
- 2023An Overview about Emerging Technologies of Autonomous Driving23 Jun 2023
- 2022PiPa: Pixel- and Patch-wise Self-supervised Learning for Domain Adaptative Semantic Segmentationcited by 41
- 2023MTP-GO: Graph-Based Probabilistic Multi-Agent Trajectory Prediction with Neural ODEscited by 19
- 2022Cognitive Accident Prediction in Driving Scenes: A Multimodality Benchmarkcited by 16
- 2024Diffusion-Based Environment-Aware Trajectory Predictioncited by 14
- 2022Heterogeneous Trajectory Forecasting via Risk and Scene Graph Learningcited by 11
- 2022Targeted Adversarial Attacks against Neural Network Trajectory Predictorscited by 11
- 2023Evaluating Pedestrian Trajectory Prediction Methods with Respect to Autonomous Drivingcited by 11
- 2024PIP-Net: Pedestrian Intention Prediction in the Wildcited by 11
- 2024Joint Perception and Prediction for Autonomous Driving: A Surveycited by 7
- 2024Vulnerable Road User Detection and Safety Enhancement: A Comprehensive Surveycited by 5
- 2025Deep Learning Approaches for Multimodal Intent Recognition: A Surveycited by 5
- 2023SegDA: Maximum Separable Segment Mask with Pseudo Labels for Domain Adaptive Semantic Segmentationcited by 2
12 most cited of 24 All 24 (JSON)
- 2026Unveiling Transferability in Trajectory Prediction via Latent Scene Embeddings29 Jun 2026
- 2025PEDRA: Evaluating the Realism of Pedestrian Dynamics in Video Generation23 Oct 2025
- 2025Deep Learning Approaches for Multimodal Intent Recognition: A Survey24 Jul 2025
- 2025MMHU: A Massive-Scale Multimodal Benchmark for Human Behavior Understanding16 Jul 2025
- 2025INTENT: Trajectory Prediction Framework with Intention-Guided Contrastive Clustering6 Mar 2025
- 2025Spatial Temporal Attention based Target Vehicle Trajectory Prediction for Internet of Vehicles1 Jan 2025
- 2024Joint Perception and Prediction for Autonomous Driving: A Survey18 Dec 2024
- 2024Feature Importance in Pedestrian Intention Prediction: A Context-Aware Review11 Sep 2024
- 2024Gating Syn-to-Real Knowledge for Pedestrian Crossing Prediction in Safe Driving24 Aug 2024
- 2024Enhanced Prediction of Multi-Agent Trajectories via Control Inference and State-Space Dynamics8 Aug 2024
- 2024MapsTP: HD Map Images Based Multimodal Trajectory Prediction for Automated Vehicles8 Jul 2024
- 2024Vulnerable Road User Detection and Safety Enhancement: A Comprehensive Survey29 May 2024
12 newest of 24 All 24 (JSON)