Large Language Models (LLMs) as Traffic Control Systems at Urban Intersections: A New Paradigm
Not on the map. Why?
Abstract (arXiv)
This study introduces a novel approach for traffic control systems by using Large Language Models (LLMs) as traffic controllers. The study utilizes their logical reasoning, scene understanding, and decision-making capabilities to optimize throughput and provide feedback based on traffic conditions in real-time. LLMs centralize traditionally disconnected traffic control processes and can integrate traffic data from diverse sources to provide context-aware decisions. LLMs can also deliver tailored outputs using various means such as wireless signals and visuals to drivers, infrastructures, and autonomous vehicles. To evaluate LLMs ability as traffic controllers, this study proposed a four-stage methodology. The methodology includes data creation and environment initialization, prompt engineering, conflict identification, and fine-tuning. We simulated multi-lane four-leg intersection scenarios and generates detailed datasets to enable conflict detection using LLMs and Python simulation as a ground truth. We used chain-of-thought prompts to lead LLMs in understanding the context, detecting conflicts, resolving them using traffic rules, and delivering context-sensitive traffic management solutions. We evaluated the prformance GPT-mini, Gemini, and Llama as traffic controllers. Results showed that the fine-tuned GPT-mini achieved 83% accuracy and an F1-score of 0.84. GPT-mini model exhibited a promising performance in generating actionable traffic management insights, with high ROUGE-L scores across conflict identification of 0.95, decision-making of 0.91, priority assignment of 0.94, and waiting time optimization of 0.92. We demonstrated that LLMs can offer precise recommendations to drivers in real-time including yielding, slowing, or stopping based on vehicle dynamics.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 15 of its 55 references that are in the map. First posted on arXiv 16 Nov 2024.
Builds on
15 of 55 references.
References · 15
- 2023DriveGPT4: Interpretable End-to-end Autonomous Driving via Large Language Modelcited by 455
- 2023LanguageMPC: Large Language Models as Decision Makers for Autonomous Drivingcited by 188
- 2018Toward Driving Scene Understanding: A Dataset for Learning Driver Behavior and Causal Reasoningcited by 102
- 2021DL-Traff: Survey and Benchmark of Deep Learning Models for Urban Traffic Predictioncited by 73
- 2023Receive, Reason, and React: Drive as You Say with Large Language Models in Autonomous Vehiclescited by 72
- 2023MTD-GPT: A Multi-Task Decision-Making GPT Model for Autonomous Driving at Unsignalized Intersectionscited by 38
- 2024LLM-Assisted Light: Leveraging Large Language Model Capabilities for Human-Mimetic Traffic Signal Control in Complex Urban Environmentscited by 31
- 2024TPLLM: A Traffic Prediction Framework Based on Pretrained Large Language Modelscited by 23
- 2024iLLM-TSC: Integration reinforcement learning and large language model for traffic signal control policy improvementcited by 23
- 2024Visual Reasoning and Multi-Agent Approach in Multimodal Large Language Models (MLLMs): Solving TSP and mTSP Combinatorial Challengescited by 21
- 2023Enhancing Network Management Using Code Generated by Large Language Modelscited by 20
- 2024Large Language Models for Mobility Analysis in Transportation Systems: A Survey on Forecasting Taskscited by 15
3 more
- 2024Advancing Object Detection in Transportation with Multimodal Large Language Models (MLLMs): A Comprehensive Review and Empirical Testingcited by 10
- 2022Evaluating a Signalized Intersection Performance Using Unmanned Aerial Datacited by 3
- 2021Impact of risk factors on work zone crashes using logistic models and Random Forestcited by 2
Built on by
Citing papers per year: 2025: 8; 2026: 4.
12 papers.
- 2025Exploring the Roles of Large Language Models in Reshaping Transportation Systems: A Survey, Framework, and Roadmapcited by 26
- 2025Large Language Models and Their Applications in Roadway Safety and Mobility Enhancement: A Comprehensive Reviewcited by 8
- 2025CrashSage: A Large Language Model-Centered Framework for Contextual and Interpretable Traffic Crash Analysiscited by 6
- 2025Leveraging Multimodal-LLMs Assisted by Instance Segmentation for Intelligent Traffic Monitoringcited by 5
- 2025HazardNet: A Small-Scale Vision Language Model for Real-Time Traffic Safety Detection at Edge Devicescited by 1
- 2025Multimodal Large Language Models for Enhanced Traffic Safety: A Comprehensive Review and Future Trendscited by 1
- 2025VTS-LLM: Domain-Adaptive LLM Agent for Enhancing Awareness in Vessel Traffic Services through Natural Languagecited by 1
- 2025Visual Reasoning at Urban Intersections: FineTuning GPT-4o for Traffic Conflict Detectioncited by 0
- 2026LIDSA: Cognitive Arbitration for Signal-Free Autonomous Intersection Managementcited by 0
- 2026HiLLTS: Zero-Shot Hierarchical LLM-Guided Traffic Signal Control for Sustainable Transportationcited by 0
- 2026Large Multimodal Agents for Intelligent Transportation Systems: Architectures, Evidence, and Deployment Challengescited by 0
- 2026VLALight: Lightweight Vision-Language-Action Models for Emergency-Aware Traffic Signal Controlcited by 0
- 2026VLALight: Lightweight Vision-Language-Action Models for Emergency-Aware Traffic Signal Control25 Sep 2026
- 2026Large Multimodal Agents for Intelligent Transportation Systems: Architectures, Evidence, and Deployment Challenges8 Aug 2026
- 2026HiLLTS: Zero-Shot Hierarchical LLM-Guided Traffic Signal Control for Sustainable Transportation17 Jul 2026
- 2026LIDSA: Cognitive Arbitration for Signal-Free Autonomous Intersection Management12 May 2026
- 2025Large Language Models and Their Applications in Roadway Safety and Mobility Enhancement: A Comprehensive Review19 May 2025
- 2025CrashSage: A Large Language Model-Centered Framework for Contextual and Interpretable Traffic Crash Analysis8 May 2025
- 2025VTS-LLM: Domain-Adaptive LLM Agent for Enhancing Awareness in Vessel Traffic Services through Natural Language2 May 2025
- 2025Multimodal Large Language Models for Enhanced Traffic Safety: A Comprehensive Review and Future Trends21 Apr 2025
- 2025Exploring the Roles of Large Language Models in Reshaping Transportation Systems: A Survey, Framework, and Roadmap27 Mar 2025
- 2025Visual Reasoning at Urban Intersections: FineTuning GPT-4o for Traffic Conflict Detection27 Feb 2025
- 2025HazardNet: A Small-Scale Vision Language Model for Real-Time Traffic Safety Detection at Edge Devices27 Feb 2025
- 2025Leveraging Multimodal-LLMs Assisted by Instance Segmentation for Intelligent Traffic Monitoring16 Feb 2025
Similar, not cited
Close in wording, no citation either way
- 2023LLMLight: Large Language Models as Traffic Signal Control Agents
- 2026Virtual Traffic Police: Large Language Model-Augmented Traffic Signal Control for Unforeseen Incidents
- 2025A Dual Large Language Models Architecture with Herald Guided Prompts for Parallel Fine Grained Traffic Signal Control
- 2023Evaluation of Large Language Models for Decision Making in Autonomous Driving
- 2026TrafficAlign: Aligning Large Language Models for Traffic Scenario Generation
- 2023LLM4Drive: A Survey of Large Language Models for Autonomous Driving
- 2024Leveraging Large Language Models with Chain-of-Thought and Prompt Engineering for Traffic Crash Severity Analysis and Inference
- 2024Multimodal LLM for Intelligent Transportation Systems