Control-ITRA: Controlling the Behavior of a Driving Model
Not on the map. Why?
Abstract (arXiv)
Simulating realistic driving behavior is crucial for developing and testing autonomous systems in complex traffic environments. Equally important is the ability to control the behavior of simulated agents to tailor scenarios to specific research needs and safety considerations. This paper extends the general-purpose multi-agent driving behavior model ITRA (Scibior et al., 2021), by introducing a method called Control-ITRA to influence agent behavior through waypoint assignment and target speed modulation. By conditioning agents on these two aspects, we provide a mechanism for them to adhere to specific trajectories and indirectly adjust their aggressiveness. We compare different approaches for integrating these conditions during training and demonstrate that our method can generate controllable, infraction-free trajectories while preserving realism in both seen and unseen locations.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 35 of its 53 references that are in the map. First posted on arXiv 17 Jan 2025.
Builds on
35 of 53 references.
References · 35
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
- 2018Addressing Function Approximation Error in Actor-Critic Methodscited by 2,302
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
- 2016Asynchronous Methods for Deep Reinforcement Learningcited by 2,218
- 2018Soft Actor-Critic Algorithms and Applicationscited by 1,179
- 2019MultiPath: Multiple Probabilistic Anchor Trajectory Hypotheses for Behavior Predictioncited by 417
- 2015A Recurrent Latent Variable Model for Sequential Datacited by 362
- 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllabilitycited by 337
- 2021DenseTNT: End-to-end Trajectory Prediction from Dense Goal Setscited by 292
- 2018Multimodal Trajectory Predictions for Autonomous Driving using Deep Convolutional Networkscited by 289
- 2022Wayformer: Motion Forecasting via Simple & Efficient Attention Networkscited by 279
23 more
- 2020It Is Not the Journey but the Destination: Endpoint Conditioned Trajectory Predictioncited by 235
- 2021Multimodal Motion Prediction with Stacked Transformerscited by 207
- 2021TrafficSim: Learning to Simulate Realistic Multi-Agent Behaviorscited by 192
- 2022Guided Conditional Diffusion for Controllable Traffic Simulationcited by 189
- 2019PRECOG: PREdiction Conditioned On Goals in Visual Multi-Agent Settingscited by 178
- 2019Multiple Futures Predictioncited by 178
- 2020From Goals, Waypoints & Paths To Long Term Human Trajectory Forecastingcited by 166
- 2023Waymax: An Accelerated, Data-Driven Simulator for Large-Scale Autonomous Driving Researchcited by 158
- 2023MotionLM: Multi-Agent Motion Forecasting as Language Modelingcited by 154
- 2020Implicit Latent Variable Model for Scene-Consistent Motion Forecastingcited by 116
- 2023Language-Guided Traffic Simulation via Scene-Level Diffusioncited by 110
- 2018Uncertainty-aware Short-term Motion Prediction of Traffic Actors for Autonomous Drivingcited by 90
- 2021Multi-modal Motion Prediction with Transformer-based Neural Network for Autonomous Drivingcited by 73
- 2022MUSE-VAE: Multi-Scale VAE for Environment-Aware Long Term Trajectory Predictioncited by 59
- 2024SceneDiffuser: Efficient and Controllable Driving Simulation Initialization and Rolloutcited by 47
- 2023SAFE-SIM: Safety-Critical Closed-Loop Traffic Simulation with Diffusion-Controllable Adversariescited by 36
- 2021Imagining The Road Ahead: Multi-Agent Trajectory Prediction via Differentiable Simulationcited by 32
- 2024CtRL-Sim: Reactive and Controllable Driving Agents with Offline Reinforcement Learningcited by 26
- 2024SMART: Scalable Multi-agent Real-time Motion Generation via Next-token Predictioncited by 25
- 2023A Diffusion-Model of Joint Interactive Navigationcited by 16
- 2020MADRaS : Multi Agent Driving Simulatorcited by 15
- 2023Editing Driver Character: Socially-Controllable Behavior Generation for Interactive Traffic Simulationcited by 10
- 2024TorchDriveEnv: A Reinforcement Learning Benchmark for Autonomous Driving with Reactive, Realistic, and Diverse Non-Playable Characterscited by 6
Built on by
Citing papers per year: 2026: 2.
2 papers.