SUMMIT: A Simulator for Urban Driving in Massive Mixed Traffic
Not on the map. Why?
Abstract (arXiv)
Autonomous driving in an unregulated urban crowd is an outstanding challenge, especially, in the presence of many aggressive, high-speed traffic participants. This paper presents SUMMIT, a high-fidelity simulator that facilitates the development and testing of crowd-driving algorithms. By leveraging the open-source OpenStreetMap map database and a heterogeneous multi-agent motion prediction model developed in our earlier work, SUMMIT simulates dense, unregulated urban traffic for heterogeneous agents at any worldwide locations that OpenStreetMap supports. SUMMIT is built as an extension of CARLA and inherits from it the physics and visual realism for autonomous driving simulation. SUMMIT supports a wide range of applications, including perception, vehicle control and planning, and end-to-end learning. We provide a context-aware planner together with benchmark scenarios and show that SUMMIT generates complex, realistic traffic behaviors in challenging crowd-driving settings.
Key facts. Cited by 39 papers in the map (data through 7 Oct 2026). First posted on arXiv 11 Nov 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 8; 2023: 7; 2024: 7; 2025: 6; 2026: 5.
39 papers.
Sort:
By area:
- 2021MetaDrive: Composing Diverse Driving Scenarios for Generalizable Reinforcement Learningcited by 281
- 2023Waymax: An Accelerated, Data-Driven Simulator for Large-Scale Autonomous Driving Researchcited by 158
- 2024ChatScene: Knowledge-Enabled Safety-Critical Scenario Generation for Autonomous Vehiclescited by 92
- 2022SafeBench: A Benchmarking Platform for Safety Evaluation of Autonomous Vehiclescited by 65
- 2022Nocturne: a scalable driving benchmark for bringing multi-agent learning one step closer to the real worldcited by 56
- 2023How Simulation Helps Autonomous Driving:A Survey of Sim2real, Digital Twins, and Parallel Intelligencecited by 55
- 2024GPUDrive: Data-driven, multi-agent driving simulation at 1 million FPScited by 43
- 2025A Survey of Sim-to-Real Methods in RL: Progress, Prospects and Challenges with Foundation Modelscited by 36
- 2021Learning to Simulate Self-Driven Particles System with Coordinated Policy Optimizationcited by 33
- 2025Scenario Dreamer: Vectorized Latent Diffusion for Generating Driving Simulation Environmentscited by 27
- 2023Choose Your Simulator Wisely: A Review on Open-source Simulators for Autonomous Drivingcited by 26
- 2024MetaUrban: An Embodied AI Simulation Platform for Urban Micromobilitycited by 19
27 more
- 2023What Truly Matters in Trajectory Prediction for Autonomous Driving?cited by 17
- 2021Autonomous Driving Strategies at Intersections: Scenarios, State-of-the-Art, and Future Outlookscited by 15
- 2021Closing the Planning-Learning Loop with Application to Autonomous Drivingcited by 12
- 2022LEADER: Learning Attention over Driving Behaviors for Planning under Uncertaintycited by 9
- 2023Learning to Control and Coordinate Mixed Traffic Through Robot Vehicles at Complex and Unsignalized Intersectionscited by 9
- 2022Deep Learning based Computer Vision Methods for Complex Traffic Environments Perception: A Reviewcited by 7
- 2023FusionPlanner: A Multi-task Motion Planner for Mining Trucks via Multi-sensor Fusioncited by 7
- 2024TorchDriveEnv: A Reinforcement Learning Benchmark for Autonomous Driving with Reactive, Realistic, and Diverse Non-Playable Characterscited by 6
- 2024Vulnerable Road User Detection and Safety Enhancement: A Comprehensive Surveycited by 5
- 2021A Reinforcement Learning Benchmark for Autonomous Driving in Intersection Scenarioscited by 4
- 2022WorldGen: A Large Scale Generative Simulatorcited by 4
- 2021An Intelligent Self-driving Truck System For Highway Transportationcited by 3
- 2024Adversarial and Reactive Traffic Entities for Behavior-Realistic Driving Simulation: A Reviewcited by 3
- 2025Getting SMARTER for Motion Planning in Autonomous Driving Systemscited by 3
- 2022TRoVE: Transforming Road Scene Datasets into Photorealistic Virtual Environmentscited by 2
- 2024TrafficGamer: Reliable and Flexible Traffic Simulation for Safety-Critical Scenarios with Game-Theoretic Oraclescited by 1
- 2025Towards Benchmarking and Assessing the Safety and Robustness of Autonomous Driving on Safety-critical Scenarioscited by 1
- 2022OpenPodcar: an Open Source Vehicle for Self-Driving Car Researchcited by 0
- 2022RegTraffic: A Regression Based Traffic Simulator for Spatiotemporal Traffic Modeling, Simulation and Visualizationcited by 0
- 2023Zero-shot Transfer Learning of Driving Policy via Socially Adversarial Traffic Flowcited by 0
- 2025Sky-Drive: A Distributed Multi-Agent Simulation Platform for Human-AI Collaborative and Socially-Aware Future Transportationcited by 0
- 2025Realistic Urban Traffic Generator using Decentralized Federated Learning for the SUMO simulatorcited by 0
- 2026CARLA-Round: A Multi-Factor Simulation Dataset for Roundabout Trajectory Predictioncited by 0
- 2026RVN-Bench: A Benchmark for Reactive Visual Navigationcited by 0
- 2026ScenarioControl: Vision-Language Controllable Vectorized Latent Scenario Generationcited by 0
- 2026Dash2Sim: Closed-Loop Driving Simulation from in-the-wild Dashcam Videoscited by 0
- 2026End-to-end Conditional Diffusion for Realistic and Controllable Visual Traffic Scenario Generationcited by 0
- 2026End-to-end Conditional Diffusion for Realistic and Controllable Visual Traffic Scenario Generation21 Jul 2026
- 2026Dash2Sim: Closed-Loop Driving Simulation from in-the-wild Dashcam Videos5 Jun 2026
- 2026ScenarioControl: Vision-Language Controllable Vectorized Latent Scenario Generation18 Apr 2026
- 2026RVN-Bench: A Benchmark for Reactive Visual Navigation4 Mar 2026
- 2026CARLA-Round: A Multi-Factor Simulation Dataset for Roundabout Trajectory Prediction17 Jan 2026
- 2025Realistic Urban Traffic Generator using Decentralized Federated Learning for the SUMO simulator9 Jun 2025
- 2025Sky-Drive: A Distributed Multi-Agent Simulation Platform for Human-AI Collaborative and Socially-Aware Future Transportation25 Apr 2025
- 2025Towards Benchmarking and Assessing the Safety and Robustness of Autonomous Driving on Safety-critical Scenarios31 Mar 2025
- 2025Scenario Dreamer: Vectorized Latent Diffusion for Generating Driving Simulation Environments28 Mar 2025
- 2025Getting SMARTER for Motion Planning in Autonomous Driving Systems20 Feb 2025
- 2025A Survey of Sim-to-Real Methods in RL: Progress, Prospects and Challenges with Foundation Models18 Feb 2025
- 2024Adversarial and Reactive Traffic Entities for Behavior-Realistic Driving Simulation: A Review21 Sep 2024
27 more
- 2024TrafficGamer: Reliable and Flexible Traffic Simulation for Safety-Critical Scenarios with Game-Theoretic Oracles28 Aug 2024
- 2024GPUDrive: Data-driven, multi-agent driving simulation at 1 million FPS2 Aug 2024
- 2024MetaUrban: An Embodied AI Simulation Platform for Urban Micromobility11 Jul 2024
- 2024Vulnerable Road User Detection and Safety Enhancement: A Comprehensive Survey29 May 2024
- 2024ChatScene: Knowledge-Enabled Safety-Critical Scenario Generation for Autonomous Vehicles22 May 2024
- 2024TorchDriveEnv: A Reinforcement Learning Benchmark for Autonomous Driving with Reactive, Realistic, and Diverse Non-Playable Characters7 May 2024
- 2023Choose Your Simulator Wisely: A Review on Open-source Simulators for Autonomous Driving18 Nov 2023
- 2023Waymax: An Accelerated, Data-Driven Simulator for Large-Scale Autonomous Driving Research12 Oct 2023
- 2023FusionPlanner: A Multi-task Motion Planner for Mining Trucks via Multi-sensor Fusion14 Aug 2023
- 2023What Truly Matters in Trajectory Prediction for Autonomous Driving?27 Jun 2023
- 2023How Simulation Helps Autonomous Driving:A Survey of Sim2real, Digital Twins, and Parallel Intelligence2 May 2023
- 2023Zero-shot Transfer Learning of Driving Policy via Socially Adversarial Traffic Flow25 Apr 2023
- 2023Learning to Control and Coordinate Mixed Traffic Through Robot Vehicles at Complex and Unsignalized Intersections12 Jan 2023
- 2022RegTraffic: A Regression Based Traffic Simulator for Spatiotemporal Traffic Modeling, Simulation and Visualization23 Nov 2022
- 2022Deep Learning based Computer Vision Methods for Complex Traffic Environments Perception: A Review9 Nov 2022
- 2022WorldGen: A Large Scale Generative Simulator3 Oct 2022
- 2022LEADER: Learning Attention over Driving Behaviors for Planning under Uncertainty23 Sep 2022
- 2022TRoVE: Transforming Road Scene Datasets into Photorealistic Virtual Environments16 Aug 2022
- 2022Nocturne: a scalable driving benchmark for bringing multi-agent learning one step closer to the real world20 Jun 2022
- 2022SafeBench: A Benchmarking Platform for Safety Evaluation of Autonomous Vehicles20 Jun 2022
- 2022OpenPodcar: an Open Source Vehicle for Self-Driving Car Research9 May 2022
- 2021An Intelligent Self-driving Truck System For Highway Transportation31 Dec 2021
- 2021Learning to Simulate Self-Driven Particles System with Coordinated Policy Optimization26 Oct 2021
- 2021MetaDrive: Composing Diverse Driving Scenarios for Generalizable Reinforcement Learning26 Sep 2021
- 2021A Reinforcement Learning Benchmark for Autonomous Driving in Intersection Scenarios22 Sep 2021
- 2021Autonomous Driving Strategies at Intersections: Scenarios, State-of-the-Art, and Future Outlooks24 Jun 2021
- 2021Closing the Planning-Learning Loop with Application to Autonomous Driving11 Jan 2021
- 2024ChatScene: Knowledge-Enabled Safety-Critical Scenario Generation for Autonomous Vehiclescited by 92
- 2022SafeBench: A Benchmarking Platform for Safety Evaluation of Autonomous Vehiclescited by 65
- 2024GPUDrive: Data-driven, multi-agent driving simulation at 1 million FPScited by 43
- 2021Closing the Planning-Learning Loop with Application to Autonomous Drivingcited by 12
- 2022LEADER: Learning Attention over Driving Behaviors for Planning under Uncertaintycited by 9
- 2024TorchDriveEnv: A Reinforcement Learning Benchmark for Autonomous Driving with Reactive, Realistic, and Diverse Non-Playable Characterscited by 6
- 2021A Reinforcement Learning Benchmark for Autonomous Driving in Intersection Scenarioscited by 4
- 2021An Intelligent Self-driving Truck System For Highway Transportationcited by 3
- 2024Adversarial and Reactive Traffic Entities for Behavior-Realistic Driving Simulation: A Reviewcited by 3
- 2024TrafficGamer: Reliable and Flexible Traffic Simulation for Safety-Critical Scenarios with Game-Theoretic Oraclescited by 1
- 2025Towards Benchmarking and Assessing the Safety and Robustness of Autonomous Driving on Safety-critical Scenarioscited by 1
- 2023Zero-shot Transfer Learning of Driving Policy via Socially Adversarial Traffic Flowcited by 0
12 most cited of 14 All 14 (JSON)
- 2026Dash2Sim: Closed-Loop Driving Simulation from in-the-wild Dashcam Videos5 Jun 2026
- 2025Sky-Drive: A Distributed Multi-Agent Simulation Platform for Human-AI Collaborative and Socially-Aware Future Transportation25 Apr 2025
- 2025Towards Benchmarking and Assessing the Safety and Robustness of Autonomous Driving on Safety-critical Scenarios31 Mar 2025
- 2024Adversarial and Reactive Traffic Entities for Behavior-Realistic Driving Simulation: A Review21 Sep 2024
- 2024TrafficGamer: Reliable and Flexible Traffic Simulation for Safety-Critical Scenarios with Game-Theoretic Oracles28 Aug 2024
- 2024GPUDrive: Data-driven, multi-agent driving simulation at 1 million FPS2 Aug 2024
- 2024ChatScene: Knowledge-Enabled Safety-Critical Scenario Generation for Autonomous Vehicles22 May 2024
- 2024TorchDriveEnv: A Reinforcement Learning Benchmark for Autonomous Driving with Reactive, Realistic, and Diverse Non-Playable Characters7 May 2024
- 2023Zero-shot Transfer Learning of Driving Policy via Socially Adversarial Traffic Flow25 Apr 2023
- 2022LEADER: Learning Attention over Driving Behaviors for Planning under Uncertainty23 Sep 2022
- 2022SafeBench: A Benchmarking Platform for Safety Evaluation of Autonomous Vehicles20 Jun 2022
- 2021An Intelligent Self-driving Truck System For Highway Transportation31 Dec 2021
12 newest of 14 All 14 (JSON)
- 2022Nocturne: a scalable driving benchmark for bringing multi-agent learning one step closer to the real worldcited by 56
- 2023How Simulation Helps Autonomous Driving:A Survey of Sim2real, Digital Twins, and Parallel Intelligencecited by 55
- 2025A Survey of Sim-to-Real Methods in RL: Progress, Prospects and Challenges with Foundation Modelscited by 36
- 2021Learning to Simulate Self-Driven Particles System with Coordinated Policy Optimizationcited by 33
- 2023Choose Your Simulator Wisely: A Review on Open-source Simulators for Autonomous Drivingcited by 26
- 2023What Truly Matters in Trajectory Prediction for Autonomous Driving?cited by 17
- 2021Autonomous Driving Strategies at Intersections: Scenarios, State-of-the-Art, and Future Outlookscited by 15
- 2023Learning to Control and Coordinate Mixed Traffic Through Robot Vehicles at Complex and Unsignalized Intersectionscited by 9
- 2022Deep Learning based Computer Vision Methods for Complex Traffic Environments Perception: A Reviewcited by 7
- 2023FusionPlanner: A Multi-task Motion Planner for Mining Trucks via Multi-sensor Fusioncited by 7
- 2024Vulnerable Road User Detection and Safety Enhancement: A Comprehensive Surveycited by 5
- 2022WorldGen: A Large Scale Generative Simulatorcited by 4
12 most cited of 21 All 21 (JSON)
- 2026End-to-end Conditional Diffusion for Realistic and Controllable Visual Traffic Scenario Generation21 Jul 2026
- 2026ScenarioControl: Vision-Language Controllable Vectorized Latent Scenario Generation18 Apr 2026
- 2026RVN-Bench: A Benchmark for Reactive Visual Navigation4 Mar 2026
- 2026CARLA-Round: A Multi-Factor Simulation Dataset for Roundabout Trajectory Prediction17 Jan 2026
- 2025Realistic Urban Traffic Generator using Decentralized Federated Learning for the SUMO simulator9 Jun 2025
- 2025Getting SMARTER for Motion Planning in Autonomous Driving Systems20 Feb 2025
- 2025A Survey of Sim-to-Real Methods in RL: Progress, Prospects and Challenges with Foundation Models18 Feb 2025
- 2024Vulnerable Road User Detection and Safety Enhancement: A Comprehensive Survey29 May 2024
- 2023Choose Your Simulator Wisely: A Review on Open-source Simulators for Autonomous Driving18 Nov 2023
- 2023FusionPlanner: A Multi-task Motion Planner for Mining Trucks via Multi-sensor Fusion14 Aug 2023
- 2023What Truly Matters in Trajectory Prediction for Autonomous Driving?27 Jun 2023
- 2023How Simulation Helps Autonomous Driving:A Survey of Sim2real, Digital Twins, and Parallel Intelligence2 May 2023
12 newest of 21 All 21 (JSON)