Realistic adversarial scenario generation via human-like pedestrian model for autonomous vehicle control parameter optimisation
On the map: End-to-end autonomous driving → Adversarial scenarios and safety testing
Abstract (arXiv)
Autonomous vehicles (AVs) are rapidly advancing and are expected to play a central role in future mobility. Ensuring their safe deployment requires reliable interaction with other road users, not least pedestrians. Direct testing on public roads is costly and unsafe for rare but critical interactions, making simulation a practical alternative. Within simulation-based testing, adversarial scenarios are widely used to probe safety limits, but many prioritise difficulty over realism, producing exaggerated behaviours which may result in AV controllers that are overly conservative. We propose an alternative method, instead using a cognitively inspired pedestrian model featuring both inter-individual and intra-individual variability to generate behaviourally plausible adversarial scenarios. We provide a proof of concept demonstration of this method's potential for AV control optimisation, in closed-loop testing and tuning of an AV controller. Our results show that replacing the rule-based CARLA pedestrian with the human-like model yields more realistic gap acceptance patterns and smoother vehicle decelerations. Unsafe interactions occur only for certain pedestrian individuals and conditions, underscoring the importance of human variability in AV testing. Adversarial scenarios generated by this model can be used to optimise AV control towards safer and more efficient behaviour. Overall, this work illustrates how incorporating human-like road user models into simulation-based adversarial testing can enhance the credibility of AV evaluation and provide a practical basis to behaviourally informed controller optimisation.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Adversarial scenarios and safety testing, one of 9 directions in End-to-end autonomous driving. Builds on 8 of its 39 references that are in the map. First posted on arXiv 5 Jan 2026.
Builds on
8 of 39 references.
References · 8
- 2018Autonomous Vehicles that Interact with Pedestrians: A Survey of Theory and Practicecited by 74
- 2020Pedestrian Models for Autonomous Driving Part II: High-Level Models of Human Behaviorcited by 23
- 2024Dynamic Game-Theoretical Decision-Making Framework for Vehicle-Pedestrian Interaction with Human Bounded Rationalitycited by 6
- 2021Generalizing Decision Making for Automated Driving with an Invariant Environment Representation using Deep Reinforcement Learningcited by 3
- 2024Realistic Extreme Behavior Generation for Improved AV Testingcited by 3
- 2024Modeling Pedestrian Crossing Behavior: A Reinforcement Learning Approach with Sensory Motor Constraintscited by 3
- 2024Pedestrian crossing decisions can be explained by bounded optimal decision-making under noisy visual perceptioncited by 2
- 2023Suicidal Pedestrian: Generation of Safety-Critical Scenarios for Autonomous Vehiclescited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Adversarial Safety-Critical Scenario Generation using Naturalistic Human Driving Priors
- 2024Adversarial and Reactive Traffic Entities for Behavior-Realistic Driving Simulation: A Review
- 2023Stackelberg Driver Model for Continual Policy Improvement in Scenario-Based Closed-Loop Autonomous Driving
- 2025Adversarial Generation and Collaborative Evolution of Safety-Critical Scenarios for Autonomous Vehicles
- 2024AdvDiffuser: Generating Adversarial Safety-Critical Driving Scenarios via Guided Diffusion
- 2026Learning Responsibility-Attributed Adversarial Scenarios for Testing Autonomous Vehicles
- 2024Data-driven Diffusion Models for Enhancing Safety in Autonomous Vehicle Traffic Simulations
- 2023SAFE-SIM: Safety-Critical Closed-Loop Traffic Simulation with Diffusion-Controllable Adversaries