mlsanityData to 14 Oct 2026

Toward Efficient and Robust Behavior Models for Multi-Agent Driving Simulation

arXiv 2512.05812 ↗First posted 5 Dec 2025cs.RO cs.CVcited by 1

On the map: End-to-end autonomous driving → Imitation-learning end-to-end planners

Abstract (arXiv)

Scalable multi-agent driving simulation requires behavior models that are both realistic and computationally efficient. We address this by optimizing the behavior model that controls individual traffic participants. To improve efficiency, we adopt an instance-centric scene representation, where each traffic participant and map element is modeled in its own local coordinate frame. This design enables efficient, viewpoint-invariant scene encoding and allows static map tokens to be reused across simulation steps. To model interactions, we employ a query-centric symmetric context encoder with relative positional encodings between local frames. We use Adversarial Inverse Reinforcement Learning to learn the behavior model and propose an adaptive reward transformation that automatically balances robustness and realism during training. Experiments demonstrate that our approach scales efficiently with the number of tokens, significantly reducing training and inference times, while outperforming several agent-centric baselines in terms of positional accuracy and robustness.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Imitation-learning end-to-end planners, one of 9 directions in End-to-end autonomous driving. Builds on 29 of its 39 references that are in the map. First posted on arXiv 5 Dec 2025.

Builds on

29 of 39 references.

Closest ancestors · 4

Same direction, newest first

  1. 2024GPUDrive: Data-driven, multi-agent driving simulation at 1 million FPS2 Aug
  2. 2023Waymax: An Accelerated, Data-Driven Simulator for Large-Scale Autonomous Driving Research12 Oct
  3. 2023TrafficBots: Towards World Models for Autonomous Driving Simulation and Motion Prediction7 Mar
  4. 2022Imitation Is Not Enough: Robustifying Imitation with Reinforcement Learning for Challenging Driving Scenarios21 Dec

Other references · 25

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
  3. 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 2,026
  4. 2021Perceiver: General Perception with Iterative Attentioncited by 1,104
  5. 2020VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representationcited by 530
  6. 2018ChauffeurNet: Learning to Drive by Imitating the Best and Synthesizing the Worstcited by 397
  7. 2023Driving with LLMs: Fusing Object-Level Vector Modality for Explainable Autonomous Drivingcited by 232
  8. 2019INTERACTION Dataset: An INTERnational, Adversarial and Cooperative moTION Dataset in Interactive Driving Scenarios with Semantic Mapscited by 231
  9. 2021TrafficSim: Learning to Simulate Realistic Multi-Agent Behaviorscited by 193
  10. 2021Scene Transformer: A unified architecture for predicting multiple agent trajectoriescited by 165
  11. 2023MTR++: Multi-Agent Motion Prediction with Symmetric Scene Modeling and Guided Intention Queryingcited by 140
  12. 2019Model-free Deep Reinforcement Learning for Urban Autonomous Drivingcited by 98
13 more
  1. 2021SimNet: Learning Reactive Self-driving Simulations from Real-world Observationscited by 77
  2. 2021Feedback in Imitation Learning: The Three Regimes of Covariate Shiftcited by 68
  3. 2025Robust Autonomy Emerges from Self-Playcited by 67
  4. 2020Modeling Human Driving Behavior through Generative Adversarial Imitation Learningcited by 45
  5. 2023Real-Time Motion Prediction via Heterogeneous Polyline Transformer with Relative Pose Encodingcited by 33
  6. 2021Imagining The Road Ahead: Multi-Agent Trajectory Prediction via Differentiable Simulationcited by 32
  7. 2024SIMPL: A Simple and Efficient Multi-agent Motion Prediction Baseline for Autonomous Drivingcited by 27
  8. 2024SLEDGE: Synthesizing Driving Environments with Generative Models and Rule-Based Trafficcited by 27
  9. 2025Building reliable sim driving agents by scaling self-playcited by 21
  10. 2022Narrowing the Coordinate-frame Gap in Behavior Prediction Models: Distillation for Efficient and Accurate Scene-centric Motion Forecastingcited by 10
  11. 2025Highly Accurate and Diverse Traffic Data: The DeepScenario Open 3D Datasetcited by 7
  12. 2024BeTAIL: Behavior Transformer Adversarial Imitation Learning from Human Racing Gameplaycited by 5
  13. 2024Importance Sampling-Guided Meta-Training for Intelligent Agents in Highly Interactive Environmentscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2021Objective-aware Traffic Simulation via Inverse Reinforcement Learning
  2. 2024Versatile Behavior Diffusion for Generalized Traffic Agent Simulation
  3. 2024CtRL-Sim: Reactive and Controllable Driving Agents with Offline Reinforcement Learning
  4. 2025Advancing Multi-agent Traffic Simulation via R1-Style Reinforcement Fine-Tuning
  5. 2026Aligning Microscopic Vehicle and Macroscopic Traffic Statistics: Reconstructing Driving Behavior from Partial Data
  6. 2019Simulating Emergent Properties of Human Driving Behavior Using Multi-Agent Reward Augmented Imitation Learning
  7. 2025Post-Training and Test-Time Scaling of Generative Agent Behavior Models for Interactive Autonomous Driving
  8. 2023Learning Realistic Traffic Agents in Closed-loop