Pedestrian Models for Autonomous Driving Part II: High-Level Models of Human Behavior
Not on the map. Why?
Abstract (arXiv)
Autonomous vehicles (AVs) must share space with pedestrians, both in carriageway cases such as cars at pedestrian crossings and off-carriageway cases such as delivery vehicles navigating through crowds on pedestrianized high-streets. Unlike static obstacles, pedestrians are active agents with complex, interactive motions. Planning AV actions in the presence of pedestrians thus requires modelling of their probable future behaviour as well as detecting and tracking them. This narrative review article is Part II of a pair, together surveying the current technology stack involved in this process, organising recent research into a hierarchical taxonomy ranging from low-level image detection to high-level psychological models, from the perspective of an AV designer. This self-contained Part II covers the higher levels of this stack, consisting of models of pedestrian behaviour, from prediction of individual pedestrians' likely destinations and paths, to game-theoretic models of interactions between pedestrians and autonomous vehicles. This survey clearly shows that, although there are good models for optimal walking behaviour, high-level psychological and social modelling of pedestrian behaviour still remains an open research question that requires many conceptual issues to be clarified. Early work has been done on descriptive and qualitative models of behaviour, but much work is still needed to translate them into quantitative algorithms for practical AV control.
Key facts. Cited by 23 papers in the map (data through 7 Oct 2026). First posted on arXiv 26 Mar 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 3; 2023: 5; 2024: 2; 2025: 4; 2026: 4.
23 papers.
Sort:
By area:
- 2021A Survey on Simulators for Testing Self-Driving Carscited by 26
- 2023Pedestrian Trajectory Prediction in Pedestrian-Vehicle Mixed Environments: A Systematic Reviewcited by 18
- 2021Spatiotemporal Deformable Scene Graphs for Complex Activity Detectioncited by 5
- 2022Benchmark for Models Predicting Human Behavior in Gap Acceptance Scenarioscited by 5
- 2021Comparing merging behaviors observed in naturalistic data with behaviors generated by a machine learned modelcited by 3
- 2022Beyond RMSE: Do machine-learned models of road user interaction produce human-like behavior?cited by 3
- 2023Modeling human road crossing decisions as reward maximization with visual perception limitationscited by 2
- 2023VILLS -- Video-Image Learning to Learn Semantics for Person Re-Identificationcited by 2
- 2024Pedestrian crossing decisions can be explained by bounded optimal decision-making under noisy visual perceptioncited by 2
- 2025A Quantitative Evaluation of the Expressivity of BMI, Pose and Gender in Body Embeddings for Recognition and Identificationcited by 2
- 2025Pedestrian-Aware Motion Planning for Autonomous Driving in Complex Urban Scenarioscited by 2
- 2023Smooth-Trajectron++: Augmenting the Trajectron++ behaviour prediction model with smooth attentioncited by 1
11 more
- 2024Text2Traj2Text: Learning-by-Synthesis Framework for Contextual Captioning of Human Movement Trajectoriescited by 1
- 2025TPK: Trustworthy Trajectory Prediction Integrating Prior Knowledge For Interpretability and Kinematic Feasibilitycited by 1
- 2026Resolving space-sharing conflicts in road user interactions through uncertainty reduction: An active inference-based computational modelcited by 1
- 2021A Utility Maximization Model of Pedestrian and Driver Interactionscited by 0
- 2021P2P-Loc: Point to Point Tiny Person Localizationcited by 0
- 2022OpenPodcar: an Open Source Vehicle for Self-Driving Car Researchcited by 0
- 2023Semantic and Articulated Pedestrian Sensing Onboard a Moving Vehiclecited by 0
- 2025Real-Time Learning of Predictive Dynamic Obstacle Models for Robotic Motion Planningcited by 0
- 2026Realistic adversarial scenario generation via human-like pedestrian model for autonomous vehicle control parameter optimisationcited by 0
- 2026Evaluating Few-Shot Temporal Reasoning of LLMs for Human Activity Prediction in Smart Environmentscited by 0
- 2026AttriBE: Quantifying Attribute Expressivity in Body Embeddings for Recognition and Identificationcited by 0
- 2026AttriBE: Quantifying Attribute Expressivity in Body Embeddings for Recognition and Identification29 Apr 2026
- 2026Resolving space-sharing conflicts in road user interactions through uncertainty reduction: An active inference-based computational model21 Apr 2026
- 2026Evaluating Few-Shot Temporal Reasoning of LLMs for Human Activity Prediction in Smart Environments20 Jan 2026
- 2026Realistic adversarial scenario generation via human-like pedestrian model for autonomous vehicle control parameter optimisation5 Jan 2026
- 2025Real-Time Learning of Predictive Dynamic Obstacle Models for Robotic Motion Planning2 Nov 2025
- 2025TPK: Trustworthy Trajectory Prediction Integrating Prior Knowledge For Interpretability and Kinematic Feasibility10 May 2025
- 2025Pedestrian-Aware Motion Planning for Autonomous Driving in Complex Urban Scenarios2 Apr 2025
- 2025A Quantitative Evaluation of the Expressivity of BMI, Pose and Gender in Body Embeddings for Recognition and Identification9 Mar 2025
- 2024Text2Traj2Text: Learning-by-Synthesis Framework for Contextual Captioning of Human Movement Trajectories19 Sep 2024
- 2024Pedestrian crossing decisions can be explained by bounded optimal decision-making under noisy visual perception6 Feb 2024
- 2023VILLS -- Video-Image Learning to Learn Semantics for Person Re-Identification27 Nov 2023
- 2023Semantic and Articulated Pedestrian Sensing Onboard a Moving Vehicle12 Sep 2023
11 more
- 2023Pedestrian Trajectory Prediction in Pedestrian-Vehicle Mixed Environments: A Systematic Review11 Aug 2023
- 2023Smooth-Trajectron++: Augmenting the Trajectron++ behaviour prediction model with smooth attention31 May 2023
- 2023Modeling human road crossing decisions as reward maximization with visual perception limitations27 Jan 2023
- 2022Benchmark for Models Predicting Human Behavior in Gap Acceptance Scenarios10 Nov 2022
- 2022Beyond RMSE: Do machine-learned models of road user interaction produce human-like behavior?22 Jun 2022
- 2022OpenPodcar: an Open Source Vehicle for Self-Driving Car Research9 May 2022
- 2021P2P-Loc: Point to Point Tiny Person Localization31 Dec 2021
- 2021A Utility Maximization Model of Pedestrian and Driver Interactions21 Oct 2021
- 2021Comparing merging behaviors observed in naturalistic data with behaviors generated by a machine learned model21 Apr 2021
- 2021Spatiotemporal Deformable Scene Graphs for Complex Activity Detection16 Apr 2021
- 2021A Survey on Simulators for Testing Self-Driving Cars13 Jan 2021
- 2021A Survey on Simulators for Testing Self-Driving Carscited by 26
- 2025Pedestrian-Aware Motion Planning for Autonomous Driving in Complex Urban Scenarioscited by 2
- 2026Realistic adversarial scenario generation via human-like pedestrian model for autonomous vehicle control parameter optimisationcited by 0
- 2026Realistic adversarial scenario generation via human-like pedestrian model for autonomous vehicle control parameter optimisation5 Jan 2026
- 2025Pedestrian-Aware Motion Planning for Autonomous Driving in Complex Urban Scenarios2 Apr 2025
- 2021A Survey on Simulators for Testing Self-Driving Cars13 Jan 2021
- 2023Pedestrian Trajectory Prediction in Pedestrian-Vehicle Mixed Environments: A Systematic Reviewcited by 18
- 2021Spatiotemporal Deformable Scene Graphs for Complex Activity Detectioncited by 5
- 2022Benchmark for Models Predicting Human Behavior in Gap Acceptance Scenarioscited by 5
- 2021Comparing merging behaviors observed in naturalistic data with behaviors generated by a machine learned modelcited by 3
- 2022Beyond RMSE: Do machine-learned models of road user interaction produce human-like behavior?cited by 3
- 2023Modeling human road crossing decisions as reward maximization with visual perception limitationscited by 2
- 2023VILLS -- Video-Image Learning to Learn Semantics for Person Re-Identificationcited by 2
- 2024Pedestrian crossing decisions can be explained by bounded optimal decision-making under noisy visual perceptioncited by 2
- 2025A Quantitative Evaluation of the Expressivity of BMI, Pose and Gender in Body Embeddings for Recognition and Identificationcited by 2
- 2023Smooth-Trajectron++: Augmenting the Trajectron++ behaviour prediction model with smooth attentioncited by 1
- 2024Text2Traj2Text: Learning-by-Synthesis Framework for Contextual Captioning of Human Movement Trajectoriescited by 1
- 2025TPK: Trustworthy Trajectory Prediction Integrating Prior Knowledge For Interpretability and Kinematic Feasibilitycited by 1
12 most cited of 19 All 19 (JSON)
- 2026AttriBE: Quantifying Attribute Expressivity in Body Embeddings for Recognition and Identification29 Apr 2026
- 2026Resolving space-sharing conflicts in road user interactions through uncertainty reduction: An active inference-based computational model21 Apr 2026
- 2025Real-Time Learning of Predictive Dynamic Obstacle Models for Robotic Motion Planning2 Nov 2025
- 2025TPK: Trustworthy Trajectory Prediction Integrating Prior Knowledge For Interpretability and Kinematic Feasibility10 May 2025
- 2025A Quantitative Evaluation of the Expressivity of BMI, Pose and Gender in Body Embeddings for Recognition and Identification9 Mar 2025
- 2024Text2Traj2Text: Learning-by-Synthesis Framework for Contextual Captioning of Human Movement Trajectories19 Sep 2024
- 2024Pedestrian crossing decisions can be explained by bounded optimal decision-making under noisy visual perception6 Feb 2024
- 2023VILLS -- Video-Image Learning to Learn Semantics for Person Re-Identification27 Nov 2023
- 2023Semantic and Articulated Pedestrian Sensing Onboard a Moving Vehicle12 Sep 2023
- 2023Pedestrian Trajectory Prediction in Pedestrian-Vehicle Mixed Environments: A Systematic Review11 Aug 2023
- 2023Smooth-Trajectron++: Augmenting the Trajectron++ behaviour prediction model with smooth attention31 May 2023
- 2023Modeling human road crossing decisions as reward maximization with visual perception limitations27 Jan 2023
12 newest of 19 All 19 (JSON)