mlsanityData to 7 Oct 2026

Behavioral Intention Prediction in Driving Scenes: A Survey

arXiv 2211.00385 ↗First posted 1 Nov 2022cs.CV cs.AIcited by 30

Not on the map. Why?

Abstract (arXiv)

In the driving scene, the road agents usually conduct frequent interactions and intention understanding of the surroundings. Ego-agent (each road agent itself) predicts what behavior will be engaged by other road users all the time and expects a shared and consistent understanding for safe movement. Behavioral Intention Prediction (BIP) simulates such a human consideration process and fulfills the early prediction of specific behaviors. Similar to other prediction tasks, such as trajectory prediction, data-driven deep learning methods have taken the primary pipeline in research. The rapid development of BIP inevitably leads to new issues and challenges. To catalyze future research, this work provides a comprehensive review of BIP from the available datasets, key factors and challenges, pedestrian-centric and vehicle-centric BIP approaches, and BIP-aware applications. Based on the investigation, data-driven deep learning approaches have become the primary pipelines. The behavioral intention types are still monotonous in most current datasets and methods (e.g., Crossing (C) and Not Crossing (NC) for pedestrians and Lane Changing (LC) for vehicles) in this field. In addition, for the safe-critical scenarios (e.g., near-crashing situations), current research is limited. Through this investigation, we identify open issues in behavioral intention prediction and suggest possible insights for future research.

Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). Builds on 165 of its 310 references that are in the map. First posted on arXiv 1 Nov 2022.

Builds on

165 of 310 references.

References · 165

  1. 2017Attention Is All You Needcited by 59,932
  2. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  3. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
  4. 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
  5. 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
  6. 2019Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shiftcited by 1,274
  7. 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,213
  8. 2021Domain Generalization: A Surveycited by 760
  9. 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 728
  10. 2021A Survey of Uncertainty in Deep Neural Networkscited by 675
  11. 2021KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3Dcited by 570
  12. 2017AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehiclescited by 517
38 more
  1. 2022Image as a Foreign Language: BEiT Pretraining for All Vision and Vision-Language Taskscited by 510
  2. 2019Measuring Calibration in Deep Learningcited by 443
  3. 2019MultiPath: Multiple Probabilistic Anchor Trajectory Hypotheses for Behavior Predictioncited by 417
  4. 2021Dynamic Neural Networks: A Surveycited by 405
  5. 2018Deep Learning for Generic Object Detection: A Surveycited by 392
  6. 2020Learning Lane Graph Representations for Motion Forecastingcited by 380
  7. 2020TNT: Target-driveN Trajectory Predictioncited by 345
  8. 2020Social-STGCNN: A Social Spatio-Temporal Graph Convolutional Neural Network for Human Trajectory Predictioncited by 324
  9. 2019Deep Multi-modal Object Detection and Semantic Segmentation for Autonomous Driving: Datasets, Methods, and Challengescited by 313
  10. 2017DESIRE: Distant Future Prediction in Dynamic Scenes with Interacting Agentscited by 310
  11. 2020V2VNet: Vehicle-to-Vehicle Communication for Joint Perception and Predictioncited by 292
  12. 2021DenseTNT: End-to-end Trajectory Prediction from Dense Goal Setscited by 292
  13. 2021MetaDrive: Composing Diverse Driving Scenarios for Generalizable Reinforcement Learningcited by 281
  14. 2018The highD Dataset: A Drone Dataset of Naturalistic Vehicle Trajectories on German Highways for Validation of Highly Automated Driving Systemscited by 276
  15. 2022Cross-view Transformers for real-time Map-view Semantic Segmentationcited by 264
  16. 2019CoverNet: Multimodal Behavior Prediction using Trajectory Setscited by 259
  17. 2021MultiPath++: Efficient Information Fusion and Trajectory Aggregation for Behavior Predictioncited by 246
  18. 2019Human Motion Trajectory Prediction: A Surveycited by 231
  19. 2019INTERACTION Dataset: An INTERnational, Adversarial and Cooperative moTION Dataset in Interactive Driving Scenarios with Semantic Mapscited by 231
  20. 2019Social-BiGAT: Multimodal Trajectory Forecasting using Bicycle-GAN and Graph Attention Networkscited by 228
  21. 2018Human Action Recognition and Prediction: A Surveycited by 226
  22. 2020Rectifying Pseudo Label Learning via Uncertainty Estimation for Domain Adaptive Semantic Segmentationcited by 222
  23. 2020Neural Prototype Trees for Interpretable Fine-grained Image Recognitioncited by 213
  24. 2021MP3: A Unified Model to Map, Perceive, Predict and Plancited by 211
  25. 2021TrafficSim: Learning to Simulate Realistic Multi-Agent Behaviorscited by 192
  26. 2019PRECOG: PREdiction Conditioned On Goals in Visual Multi-Agent Settingscited by 178
  27. 2020Predicting Semantic Map Representations from Images using Pyramid Occupancy Networkscited by 175
  28. 2017Playing for Benchmarkscited by 169
  29. 2020Posterior Network: Uncertainty Estimation without OOD Samples via Density-Based Pseudo-Countscited by 163
  30. 2021IntentNet: Learning to Predict Intention from Raw Sensor Datacited by 158
  31. 2022V2X-Sim: Multi-Agent Collaborative Perception Dataset and Benchmark for Autonomous Drivingcited by 157
  32. 2020University-1652: A Multi-view Multi-source Benchmark for Drone-based Geo-localizationcited by 152
  33. 2020Perceive, Predict, and Plan: Safe Motion Planning Through Interpretable Semantic Representationscited by 150
  34. 2022Learning from All Vehiclescited by 135
  35. 2021AdvSim: Generating Safety-Critical Scenarios for Self-Driving Vehiclescited by 132
  36. 2019Meta-Sim: Learning to Generate Synthetic Datasetscited by 128
  37. 2019Rules of the Road: Predicting Driving Behavior with a Convolutional Model of Semantic Interactionscited by 117
  38. 2022ViP3D: End-to-end Visual Trajectory Prediction via 3D Agent Queriescited by 116

50 most cited of 165 All 165 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 4; 2023: 4; 2024: 11; 2025: 10; 2026: 1.

30 papers.

Sort:

By area:

  1. 2022PiPa: Pixel- and Patch-wise Self-supervised Learning for Domain Adaptative Semantic Segmentationcited by 41
  2. 2023MTP-GO: Graph-Based Probabilistic Multi-Agent Trajectory Prediction with Neural ODEscited by 19
  3. 2022Cognitive Accident Prediction in Driving Scenes: A Multimodality Benchmarkcited by 16
  4. 2024Diffusion-Based Environment-Aware Trajectory Predictioncited by 14
  5. 2022Heterogeneous Trajectory Forecasting via Risk and Scene Graph Learningcited by 11
  6. 2022Targeted Adversarial Attacks against Neural Network Trajectory Predictorscited by 11
  7. 2023Evaluating Pedestrian Trajectory Prediction Methods with Respect to Autonomous Drivingcited by 11
  8. 2024PIP-Net: Pedestrian Intention Prediction in the Wildcited by 11
  9. 2024Joint Perception and Prediction for Autonomous Driving: A Surveycited by 7
  10. 2024Vulnerable Road User Detection and Safety Enhancement: A Comprehensive Surveycited by 5
  11. 2025Deep Learning Approaches for Multimodal Intent Recognition: A Surveycited by 5
  12. 2025SalM2: An Extremely Lightweight Saliency Mamba Model for Real-Time Cognitive Awareness of Driver Attentioncited by 4
18 more
  1. 2023An Overview about Emerging Technologies of Autonomous Drivingcited by 2
  2. 2023SegDA: Maximum Separable Segment Mask with Pseudo Labels for Domain Adaptive Semantic Segmentationcited by 2
  3. 2024Toward Unified Practices in Trajectory Prediction Research on Bird's-Eye-View Datasetscited by 2
  4. 2024Enhanced Prediction of Multi-Agent Trajectories via Control Inference and State-Space Dynamicscited by 2
  5. 2025INTENT: Trajectory Prediction Framework with Intention-Guided Contrastive Clusteringcited by 2
  6. 2025Pedestrian-Aware Motion Planning for Autonomous Driving in Complex Urban Scenarioscited by 2
  7. 2025MMHU: A Massive-Scale Multimodal Benchmark for Human Behavior Understandingcited by 2
  8. 2024Gating Syn-to-Real Knowledge for Pedestrian Crossing Prediction in Safe Drivingcited by 1
  9. 2024Feature Importance in Pedestrian Intention Prediction: A Context-Aware Reviewcited by 1
  10. 2025Evaluating Scenario-based Decision-making for Interactive Autonomous Driving Using Rational Criteria: A Surveycited by 1
  11. 2025Occlusion-Aware Diffusion Model for Pedestrian Intention Predictioncited by 1
  12. 2024Designing deep neural networks for driver intention recognitioncited by 0
  13. 2024Vehicle Behavior Prediction by Episodic-Memory Implanted NDTcited by 0
  14. 2024MapsTP: HD Map Images Based Multimodal Trajectory Prediction for Automated Vehiclescited by 0
  15. 2025Spatial Temporal Attention based Target Vehicle Trajectory Prediction for Internet of Vehiclescited by 0
  16. 2025Toward Safety-First Human-Like Decision Making for Autonomous Vehicles in Time-Varying Traffic Flowcited by 0
  17. 2025PEDRA: Evaluating the Realism of Pedestrian Dynamics in Video Generationcited by 0
  18. 2026Unveiling Transferability in Trajectory Prediction via Latent Scene Embeddingscited by 0