DecompGAIL: Learning Realistic Traffic Behaviors with Decomposed Multi-Agent Generative Adversarial Imitation Learning
On the map: Offline RL and imitation learning from data → Imitation and offline RL for driving
Abstract (arXiv)
Realistic traffic simulation is critical for the development of autonomous driving systems and urban mobility planning, yet existing imitation learning approaches often fail to model realistic traffic behaviors. Behavior cloning suffers from covariate shift, while Generative Adversarial Imitation Learning (GAIL) is notoriously unstable in multi-agent settings. We identify a key source of this instability: irrelevant interaction misguidance, where a discriminator penalizes an ego vehicle's realistic behavior due to unrealistic interactions among its neighbors. To address this, we propose Decomposed Multi-agent GAIL (DecompGAIL), which explicitly decomposes realism into ego-map and ego-neighbor components, filtering out misleading neighbor: neighbor and neighbor: map interactions. We further introduce a social PPO objective that augments ego rewards with distance-weighted neighborhood rewards, encouraging overall realism across agents. Integrated into a lightweight SMART-based backbone, DecompGAIL achieves state-of-the-art performance on the WOMD Sim Agents 2025 benchmark.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Imitation and offline RL for driving, one of 13 directions in Offline RL and imitation learning from data. Builds on 35 of its 60 references that are in the map. First posted on arXiv 8 Oct 2025.
Builds on
35 of 60 references.
Closest ancestors · 5
Same direction, newest first
- 2024LASIL: Learner-Aware Supervised Imitation Learning For Long-term Microscopic Traffic Simulation26 Mar
- 2023CCIL: Context-conditioned imitation learning for urban driving4 May
- 2020Modeling Human Driving Behavior through Generative Adversarial Imitation Learning10 Jun
- 2019Simulating Emergent Properties of Human Driving Behavior Using Multi-Agent Reward Augmented Imitation Learning14 Mar
- 2018Multi-Agent Imitation Learning for Driving Simulation2 Mar
Other references · 30
- 2016Generative Adversarial Imitation Learningcited by 1,576
- 2018Which Training Methods for GANs do actually Converge?cited by 672
- 2021Large Scale Interactive Motion Forecasting for Autonomous Driving : The Waymo Open Motion Datasetcited by 532
- 2020Is Independent Learning All You Need in the StarCraft Multi-Agent Challenge?cited by 281
- 2019A Divergence Minimization Perspective on Imitation Learning Methodscited by 188
- 2018Multi-Agent Generative Adversarial Imitation Learningcited by 99
- 2017Imitating Driver Behavior with Generative Adversarial Networkscited by 92
- 2023The Waymo Open Sim Agents Challengecited by 86
- 2022BITS: Bi-level Imitation for Traffic Simulationcited by 80
- 2021SimNet: Learning Reactive Self-driving Simulations from Real-world Observationscited by 77
- 2022GoRela: Go Relative for Viewpoint-Invariant Motion Forecastingcited by 68
- 2019Multi-Agent Adversarial Inverse Reinforcement Learningcited by 60
18 more
- 2023Trajeglish: Traffic Modeling as Next-Token Predictioncited by 59
- 2024BehaviorGPT: Smart Agent Simulation for Autonomous Driving with Next-Patch Predictioncited by 49
- 2024Solving Motion Planning Tasks with a Scalable Generative Modelcited by 40
- 2024Closed-Loop Supervised Fine-Tuning of Tokenized Traffic Modelscited by 40
- 2021PredictionNet: Real-Time Joint Probabilistic Traffic Prediction for Planning, Control, and Simulationcited by 29
- 2024Improving Agent Behaviors with RL Fine-tuning for Autonomous Drivingcited by 27
- 2018Learning from Demonstration in the Wildcited by 25
- 2024SMART: Scalable Multi-agent Real-time Motion Generation via Next-token Predictioncited by 25
- 2024KiGRAS: Kinematic-Driven Generative Model for Realistic Agent Simulationcited by 17
- 2025Advancing Multi-agent Traffic Simulation via R1-Style Reinforcement Fine-Tuningcited by 14
- 2025UniMM: A Unified Mixture Model Framework for Multi-Agent Simulationcited by 13
- 2025TrajTok: Technical Report for 2025 Waymo Open Sim Agents Challengecited by 8
- 2021Learning to Simulate on Sparse Trajectory Datacited by 6
- 2025Direct Post-Training Preference Alignment for Multi-Agent Motion Generation Models Using Implicit Feedback from Pre-training Demonstrationscited by 6
- 2025Do LLM Modules Generalize? A Study on Motion Generation for Autonomous Drivingcited by 4
- 2022Exploring the trade off between human driving imitation and safety for traffic simulationcited by 3
- 2025SceneStreamer: Continuous Scenario Generation as Next Token Group Predictioncited by 2
- 2024LitSim: A Conflict-aware Policy for Long-term Interactive Traffic Simulationcited by 1
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026AutoWorld: Learning Multi-Agent Traffic Simulation with Self-Supervised World Modelscited by 2
- 2026Long-term Traffic Simulation via Structured Autoregressive Modelingcited by 1
- 2026General-purpose LLMs as Models of Human Driver Behavior: The Case of Simplified Mergingcited by 0
- 2026Artificial Intelligence for Modeling and Simulation of Mixed Automated and Human Trafficcited by 0
- 2026Flow-ERD: Agent-type Aware Flow Matching with Entropy-Regularized Distillation for Diverse Traffic Simulationcited by 0
- 2026Flow-ERD: Agent-type Aware Flow Matching with Entropy-Regularized Distillation for Diverse Traffic Simulation8 Jul 2026
- 2026Long-term Traffic Simulation via Structured Autoregressive Modeling30 Jun 2026
- 2026Artificial Intelligence for Modeling and Simulation of Mixed Automated and Human Traffic14 Apr 2026
- 2026AutoWorld: Learning Multi-Agent Traffic Simulation with Self-Supervised World Models30 Mar 2026
- 2026General-purpose LLMs as Models of Human Driver Behavior: The Case of Simplified Merging11 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2021Generative Adversarial Imitation Learning for End-to-End Autonomous Driving on Urban Environments
- 2022Hierarchical Model-Based Imitation Learning for Planning in Autonomous Driving
- 2023Learning Realistic Traffic Agents in Closed-loop
- 2021Iterative Imitation Policy Improvement for Interactive Autonomous Driving
- 2025Toward Efficient and Robust Behavior Models for Multi-Agent Driving Simulation
- 2026ForSim: Stepwise Forward Simulation for Traffic Policy Fine-Tuning
- 2024Analyzing Closed-loop Training Techniques for Realistic Traffic Agent Models in Autonomous Highway Driving Simulations
- 2022Enhanced Behavioral Cloning with Environmental Losses for Self-Driving Vehicles