mlsanityData to 7 Oct 2026

ChatSUMO: Large Language Model for Automating Traffic Scenario Generation in Simulation of Urban MObility

arXiv 2409.09040 ↗First posted 29 Aug 2024cs.HC cs.AI cs.CLcited by 34

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs), capable of handling multi-modal input and outputs such as text, voice, images, and video, are transforming the way we process information. Beyond just generating textual responses to prompts, they can integrate with different software platforms to offer comprehensive solutions across diverse applications. In this paper, we present ChatSUMO, a LLM-based agent that integrates language processing skills to generate abstract and real-world simulation scenarios in the widely-used traffic simulator - Simulation of Urban MObility (SUMO). Our methodology begins by leveraging the LLM for user input which converts to relevant keywords needed to run python scripts. These scripts are designed to convert specified regions into coordinates, fetch data from OpenStreetMap, transform it into a road network, and subsequently run SUMO simulations with the designated traffic conditions. The outputs of the simulations are then interpreted by the LLM resulting in informative comparisons and summaries. Users can continue the interaction and generate a variety of customized scenarios without prior traffic simulation expertise. For simulation generation, we created a real-world simulation for the city of Albany with an accuracy of 96%. ChatSUMO also realizes the customizing of edge edit, traffic light optimization, and vehicle edit by users effectively.

Key facts. Cited by 34 papers in the map (data through 7 Oct 2026). Builds on 25 of its 44 references that are in the map. First posted on arXiv 29 Aug 2024.

Builds on

25 of 44 references.

References · 25

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2024The Llama 3 Herd of Modelscited by 14,192
  5. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  6. 2023A Survey on Evaluation of Large Language Modelscited by 1,227
  7. 2024Gemma: Open Models Based on Gemini Research and Technologycited by 889
  8. 2023NExT-GPT: Any-to-Any Multimodal LLMcited by 610
  9. 2023DiLu: A Knowledge-Driven Approach to Autonomous Driving with Large Language Modelscited by 204
  10. 2023LanguageMPC: Large Language Models as Decision Makers for Autonomous Drivingcited by 188
  11. 2022Talking About Large Language Modelscited by 174
  12. 2018Traffic Graph Convolutional Recurrent Neural Network: A Deep Learning Framework for Network-Scale Traffic Learning and Forecastingcited by 145
13 more
  1. 2023Vision Language Models in Autonomous Driving: A Survey and Outlookcited by 124
  2. 2023Language-Guided Traffic Simulation via Scene-Level Diffusioncited by 110
  3. 2024ChatScene: Knowledge-Enabled Safety-Critical Scenario Generation for Autonomous Vehiclescited by 92
  4. 2024UrbanGPT: Spatio-Temporal Large Language Modelscited by 81
  5. 2023ADAPT: Action-aware Driving Caption Transformercited by 78
  6. 2023Prompt to Transfer: Sim-to-Real Transfer for Traffic Signal Control with Prompt Learningcited by 36
  7. 2023TrafficSafetyGPT: Tuning a Pre-trained Large Language Model to a Domain-Specific Expert in Transportation Safetycited by 27
  8. 2020A Smart, Efficient, and Reliable Parking Surveillance System with Edge Artificial Intelligence on IoT Devicescited by 21
  9. 2023BEVGPT: Generative Pre-trained Large Model for Autonomous Driving Prediction, Decision-Making, and Planningcited by 15
  10. 2024Traffic Performance GPT (TP-GPT): Real-Time Data Informed Intelligent ChatBot for Transportation Surveillance and Managementcited by 15
  11. 2021An Overview of Agent-based Traffic Simulatorscited by 11
  12. 2024GenFollower: Enhancing Car-Following Prediction with Large Language Modelscited by 8
  13. 2018Multi-range Reasoning for Machine Comprehensioncited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 4; 2025: 18; 2026: 12.

34 papers.

Sort:

By area:

  1. 2025Foundation Models in Autonomous Driving: A Survey on Scenario Generation and Scenario Analysiscited by 37
  2. 2025Exploring the Roles of Large Language Models in Reshaping Transportation Systems: A Survey, Framework, and Roadmapcited by 26
  3. 2025Challenger: Affordable Adversarial Driving Video Generationcited by 16
  4. 2024Realistic Corner Case Generation for Autonomous Vehicles with Multimodal Large Language Modelcited by 11
  5. 2025A Lightweight Large Language Model-Based Multi-Agent System for 2D Frame Structural Analysiscited by 9
  6. 2025From Words to Collisions: LLM-Guided Evaluation and Adversarial Generation of Safety-Critical Driving Scenarioscited by 8
  7. 2025Large Language Models and Their Applications in Roadway Safety and Mobility Enhancement: A Comprehensive Reviewcited by 8
  8. 2025CrashSage: A Large Language Model-Centered Framework for Contextual and Interpretable Traffic Crash Analysiscited by 6
  9. 2025Leveraging Multimodal-LLMs Assisted by Instance Segmentation for Intelligent Traffic Monitoringcited by 5
  10. 2025Simulating the Unseen: Crash Prediction Must Learn from What Did Not Happencited by 5
  11. 2026A Survey on Evaluating Quality and Trustworthiness in LLM-Generated Datacited by 5
  12. 2025Adversarial Generation and Collaborative Evolution of Safety-Critical Scenarios for Autonomous Vehiclescited by 4
22 more
  1. 2024Adversarial and Reactive Traffic Entities for Behavior-Realistic Driving Simulation: A Reviewcited by 3
  2. 2024Beyond Words: Evaluating Large Language Models in Transportation Planningcited by 3
  3. 2025SUMO-MCP: Leveraging the Model Context Protocol for Autonomous Traffic Simulation and Optimizationcited by 3
  4. 2025AgentSUMO: An Agentic Framework for Interactive Simulation Scenario Generation in SUMO via Large Language Modelscited by 3
  5. 2025TrafficSimAgent: A Hierarchical Agent Framework for Autonomous Traffic Simulation with MCP Controlcited by 3
  6. 2025LinguaSim: Interactive Multi-Vehicle Testing Scenario Generation via Natural Language Instruction Based on Large Language Modelscited by 2
  7. 2024Traffic Co-Simulation Framework Empowered by Infrastructure Camera Sensing and Reinforcement Learningcited by 1
  8. 2025Chat2SPaT: A Large Language Model Based Tool for Automating Traffic Signal Control Plan Managementcited by 1
  9. 2026GTA: Generative Traffic Agents for Simulating Realistic Mobility Behaviorcited by 1
  10. 2026Chat2Scenic: An Iterative RAG-Based Framework for Scenario Generation in Autonomous Drivingcited by 1
  11. 2025Toward Copyright Integrity and Verifiability via Multi-Bit Watermarking for Intelligent Transportation Systemscited by 0
  12. 2025Leveraging RAG-LLMs for Urban Mobility Simulation and Analysiscited by 0
  13. 2025GraphTrafficGPT: Enhancing Traffic Management Through Graph-Based AI Agent Coordinationcited by 0
  14. 2026LLM-Augmented Traffic Signal Control with LSTM-Based Traffic State Prediction and Safety-Constrained Decision Supportcited by 0
  15. 2026What Will Happen Next: Large Models-Driven Deduction for Emergency Instancescited by 0
  16. 2026Decoupled Intelligence: A Multi-Agent LLM Framework for Controllable Traffic Scenario Generation in SUMOcited by 0
  17. 2026AGORA: Can Deliberation and Governance Gates Absorb Participation Bias in Transit Planning?cited by 0
  18. 2026Large Multimodal Agents for Intelligent Transportation Systems: Architectures, Evidence, and Deployment Challengescited by 0
  19. 2026SimSkill: A Self-Evolving LLM Agent for Skill and Knowledge Accumulation in Traffic Simulationcited by 0
  20. 2026SimTIO: A Simulation-Grounded Multi-Agent LLM Framework for Compositional Traffic Intervention Optimizationcited by 0
  21. 2026PlannerForge: LLM Agents for Scenario-Based Testing of Motion Planners in Autonomous Drivingcited by 0
  22. 2026Teach-to-Crash: A Closed-Loop Student-Teacher LLM Framework for Collision-Inducing Test Scenario Generationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024Multimodal Road Network Generation Based on Large Language Model ↗
  2. 2026CityBehavEx: A Scalable and Empirically Validated LLM-Assisted Urban Simulation Platform
  3. 2025LLM-ABM for Transportation: Assessing the Potential of LLM Agents in System Analysis
  4. 2026TrafficAlign: Aligning Large Language Models for Traffic Scenario Generation
  5. 2024Large Language Models as Urban Residents: An LLM Agent Framework for Personal Mobility Generation
  6. 2025Modeling realistic human behavior using generative agents in a multimodal transport system: Software architecture and Application to Toulouse
  7. 2024Large Language Models (LLMs) as Traffic Control Systems at Urban Intersections: A New Paradigm
  8. 2026When Plausible Is Not Realistic: Evaluating Human Mobility in LLM-Based Urban Simulation