mlsanityData to 7 Oct 2026

A Dual Large Language Models Architecture with Herald Guided Prompts for Parallel Fine Grained Traffic Signal Control

arXiv 2511.00136 ↗First posted 31 Oct 2025cs.LG cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

Leveraging large language models (LLMs) in traffic signal control (TSC) improves optimization efficiency and interpretability compared to traditional reinforcement learning (RL) methods. However, existing LLM-based approaches are limited by fixed time signal durations and are prone to hallucination errors, while RL methods lack robustness in signal timing decisions and suffer from poor generalization. To address these challenges, this paper proposes HeraldLight, a dual LLMs architecture enhanced by Herald guided prompts. The Herald Module extracts contextual information and forecasts queue lengths for each traffic phase based on real-time conditions. The first LLM, LLM-Agent, uses these forecasts to make fine grained traffic signal control, while the second LLM, LLM-Critic, refines LLM-Agent's outputs, correcting errors and hallucinations. These refined outputs are used for score-based fine-tuning to improve accuracy and robustness. Simulation experiments using CityFlow on real world datasets covering 224 intersections in Jinan (12), Hangzhou (16), and New York (196) demonstrate that HeraldLight outperforms state of the art baselines, achieving a 20.03% reduction in average travel time across all scenarios and a 10.74% reduction in average queue length on the Jinan and Hangzhou scenarios. The source code is available on GitHub: https://github.com/BUPT-ANTlab/HeraldLight.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 16 of its 28 references that are in the map. First posted on arXiv 31 Oct 2025.

Builds on

16 of 28 references.

References · 16

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  2. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
  3. 2019CoLight: Learning Network-level Cooperation for Traffic Signal Controlcited by 133
  4. 2019CityFlow: A Multi-Agent Reinforcement Learning Environment for Large Scale City Traffic Scenariocited by 114
  5. 2019A Survey on Traffic Signal Control Methodscited by 78
  6. 2023Making Large Language Models Better Reasoners with Alignmentcited by 63
  7. 2020AttendLight: Universal Attention-Based Reinforcement Learning Model for Traffic Signal Controlcited by 60
  8. 2023Open-TI: Open Traffic Intelligence with Augmented Language Modelcited by 38
  9. 2023Prompt to Transfer: Sim-to-Real Transfer for Traffic Signal Control with Prompt Learningcited by 36
  10. 2021Expression might be enough: representing pressure and demand for reinforcement learning based traffic signal controlcited by 28
  11. 2021Efficient Pressure: Improving efficiency for signalized intersectionscited by 24
  12. 2024iLLM-TSC: Integration reinforcement learning and large language model for traffic signal control policy improvementcited by 23
4 more
  1. 2023UniTSA: A Universal Reinforcement Learning Framework for V2X Traffic Signal Controlcited by 12
  2. 2025Traffic-R1: Reinforced LLMs Bring Human-Like Reasoning to Traffic Signal Control Systemscited by 12
  3. 2024Towards LLM-Powered Ambient Sensor Based Multi-Person Human Activity Recognitioncited by 5
  4. 2022DynamicLight: Two-Stage Dynamic Traffic Signal Timingcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2023LLMLight: Large Language Models as Traffic Signal Control Agents
  2. 2026LATS: Large Language Model Assisted Teacher-Student Framework for Multi-Agent Reinforcement Learning in Traffic Signal Control
  3. 2026ProcessLight: Process Supervision for Large Language Model Based Traffic Signal Control
  4. 2024Large Language Models (LLMs) as Traffic Control Systems at Urban Intersections: A New Paradigm
  5. 2026DGLight: DQN-Guided GRPO Fine-Tuning of Large Language Models for Traffic Signal Control
  6. 2026OracleTSC: Oracle-Informed Reward Hurdle and Uncertainty Regularization for Traffic Signal Control
  7. 2025CoLLMLight: Cooperative Large Language Model Agents for Network-Wide Traffic Signal Control
  8. 2025LLM-Guided Reinforcement Learning with Representative Agents for Traffic Modeling