Editing Driver Character: Socially-Controllable Behavior Generation for Interactive Traffic Simulation
Not on the map. Why?
Abstract (arXiv)
Traffic simulation plays a crucial role in evaluating and improving autonomous driving planning systems. After being deployed on public roads, autonomous vehicles need to interact with human road participants with different social preferences (e.g., selfish or courteous human drivers). To ensure that autonomous vehicles take safe and efficient maneuvers in different interactive traffic scenarios, we should be able to evaluate autonomous vehicles against reactive agents with different social characteristics in the simulation environment. We propose a socially-controllable behavior generation (SCBG) model for this purpose, which allows the users to specify the level of courtesy of the generated trajectory while ensuring realistic and human-like trajectory generation through learning from real-world driving data. Specifically, we define a novel and differentiable measure to quantify the level of courtesy of driving behavior, leveraging marginal and conditional behavior prediction models trained from real-world driving data. The proposed courtesy measure allows us to auto-label the courtesy levels of trajectories from real-world driving data and conveniently train an SCBG model generating trajectories based on the input courtesy values. We examined the SCBG model on the Waymo Open Motion Dataset (WOMD) and showed that we were able to control the SCBG model to generate realistic driving behaviors with desired courtesy levels. Interestingly, we found that the SCBG model was able to identify different motion patterns of courteous behaviors according to the scenarios.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 21 of its 28 references that are in the map. First posted on arXiv 24 Mar 2023.
Builds on
21 of 28 references.
References · 21
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
- 2021Large Scale Interactive Motion Forecasting for Autonomous Driving : The Waymo Open Motion Datasetcited by 532
- 2021MetaDrive: Composing Diverse Driving Scenarios for Generalizable Reinforcement Learningcited by 281
- 2021MultiPath++: Efficient Information Fusion and Trajectory Aggregation for Behavior Predictioncited by 246
- 2021TrafficSim: Learning to Simulate Realistic Multi-Agent Behaviorscited by 192
- 2022Guided Conditional Diffusion for Controllable Traffic Simulationcited by 189
- 2021Generating Useful Accident-Prone Driving Scenarios via a Learned Traffic Priorcited by 136
- 2021AdvSim: Generating Safety-Critical Scenarios for Self-Driving Vehiclescited by 132
- 2021Urban Driver: Learning to Drive from Real-world Demonstrations Using Policy Gradientscited by 122
- 2022M2I: From Factored Marginal Trajectory Prediction to Interactive Predictioncited by 81
- 2022BITS: Bi-level Imitation for Traffic Simulationcited by 80
- 2021SimNet: Learning Reactive Self-driving Simulations from Real-world Observationscited by 77
9 more
- 2022Symphony: Learning Realistic and Diverse Agents for Autonomous Driving Simulationcited by 61
- 2021Identifying Driver Interactions via Conditional Behavior Predictioncited by 48
- 2020Formal Scenario-Based Testing of Autonomous Vehicles: From Simulation to the Real Worldcited by 38
- 2020Socially-Compatible Behavior Design of Autonomous Vehicles with Verification on Real Human Datacited by 18
- 2021Diverse Critical Interaction Generation for Planning and Planner Evaluationcited by 15
- 2018Courteous Autonomous Carscited by 14
- 2022MPA: MultiPath++ Based Architecture for Motion Predictioncited by 13
- 2022Interventional Behavior Prediction: Avoiding Overly Confident Anticipation in Interactive Predictioncited by 8
- 2022Analyzing and Enhancing Closed-loop Stability in Reactive Simulationcited by 4
Built on by
Citing papers per year: 2023: 1; 2024: 4; 2025: 4; 2026: 1.
10 papers.
- 2023LanguageMPC: Large Language Models as Decision Makers for Autonomous Drivingcited by 188
- 2024CtRL-Sim: Reactive and Controllable Driving Agents with Offline Reinforcement Learningcited by 26
- 2024EditFollower: Tunable Car Following Models for Customizable Adaptive Cruise Control Systemscited by 4
- 2025Safety-Critical Traffic Simulation with Adversarial Transfer of Driving Intentionscited by 3
- 2025Control-ITRA: Controlling the Behavior of a Driving Modelcited by 2
- 2024TrafficGamer: Reliable and Flexible Traffic Simulation for Safety-Critical Scenarios with Game-Theoretic Oraclescited by 1
- 2024Optimal Driver Warning Generation in Dynamic Driving Environmentcited by 1
- 2025Towards Developing Socially Compliant Automated Vehicles: Advances, Expert Insights, and A Conceptual Frameworkcited by 0
- 2025Robust Planning for Autonomous Driving via Mixed Adversarial Diffusion Predictionscited by 0
- 2026Controllable Sim Agents with Behavior Latentscited by 0
- 2026Controllable Sim Agents with Behavior Latents2 Jul 2026
- 2025Robust Planning for Autonomous Driving via Mixed Adversarial Diffusion Predictions18 May 2025
- 2025Safety-Critical Traffic Simulation with Adversarial Transfer of Driving Intentions7 Mar 2025
- 2025Control-ITRA: Controlling the Behavior of a Driving Model17 Jan 2025
- 2025Towards Developing Socially Compliant Automated Vehicles: Advances, Expert Insights, and A Conceptual Framework10 Jan 2025
- 2024Optimal Driver Warning Generation in Dynamic Driving Environment9 Nov 2024
- 2024TrafficGamer: Reliable and Flexible Traffic Simulation for Safety-Critical Scenarios with Game-Theoretic Oracles28 Aug 2024
- 2024EditFollower: Tunable Car Following Models for Customizable Adaptive Cruise Control Systems23 Jun 2024
- 2024CtRL-Sim: Reactive and Controllable Driving Agents with Offline Reinforcement Learning29 Mar 2024
- 2023LanguageMPC: Large Language Models as Decision Makers for Autonomous Driving4 Oct 2023