LLM-based Human-like Traffic Simulation for Self-driving Tests
On the map: End-to-end autonomous driving → Large language models for driving
Abstract (arXiv)
Ensuring realistic traffic dynamics is a prerequisite for simulation platforms to evaluate the reliability of self-driving systems before deployment in the real world. Because most road users are human drivers, reproducing their diverse behaviors within simulators is vital. Existing solutions, however, typically rely on either handcrafted heuristics or narrow data-driven models, which capture only fragments of real driving behaviors and offer limited driving style diversity and interpretability. To address this gap, we introduce HDSim, an HD traffic generation framework that combines cognitive theory with large language model (LLM) assistance to produce scalable and realistic traffic scenarios within simulation platforms. The framework advances the state of the art in two ways: (i) it introduces a hierarchical driver model that represents diverse driving style traits, and (ii) it develops a Perception-Mediated Behavior Influence strategy, where LLMs guide perception to indirectly shape driver actions. Experiments reveal that embedding HDSim into simulation improves detection of safety-critical failures in self-driving systems by up to 68% and yields realism-consistent accident interpretability.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Large language models for driving, one of 9 directions in End-to-end autonomous driving. Builds on 15 of its 30 references that are in the map. First posted on arXiv 23 Aug 2025.
Builds on
15 of 30 references.
Closest ancestors · 1
Same direction, newest first
Other references · 14
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
- 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 622
- 2022ST-P3: End-to-end Vision-based Autonomous Driving via Spatial-Temporal Feature Learningcited by 368
- 2021MetaDrive: Composing Diverse Driving Scenarios for Generalizable Reinforcement Learningcited by 290
- 2019INTERACTION Dataset: An INTERnational, Adversarial and Cooperative moTION Dataset in Interactive Driving Scenarios with Semantic Mapscited by 231
- 2022Safety-Enhanced Autonomous Driving Using Interpretable Sensor Fusion Transformercited by 212
- 2021End-to-End Urban Driving by Imitating a Reinforcement Learning Coachcited by 194
- 2021TrafficSim: Learning to Simulate Realistic Multi-Agent Behaviorscited by 193
- 2023Hidden Biases of End-to-End Driving Modelscited by 96
- 2023The Waymo Open Sim Agents Challengecited by 86
- 2024Promptable Closed-loop Traffic Simulationcited by 20
2 more
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Controllable Traffic Simulation through LLM-Guided Hierarchical Reasoning and Refinement
- 2026Human Behavior-Informed Crash Scenario Generation with Real-World Crash Priors for Autonomous Vehicle Safety Evaluation
- 2025DriveGen: Towards Infinite Diverse Traffic Scenarios with Large Models
- 2024Text-to-Drive: Diverse Driving Behavior Synthesis via Large Language Models
- 2025LLM-based Realistic Safety-Critical Driving Video Generation
- 2023DriveMLM: Aligning Multi-Modal Large Language Models with Behavioral Planning States for Autonomous Driving
- 2025Mind the Gap: Evaluating LLM Understanding of Human-Taught Road Safety Principles
- 2025AGENTS-LLM: Augmentative GENeration of Challenging Traffic Scenarios with an Agentic LLM Framework