C2T: Captioning-Structure and LLM-Aligned Common-Sense Reward Learning for Traffic--Vehicle Coordination
Not on the map. Why?
Abstract (arXiv)
State-of-the-art (SOTA) urban traffic control increasingly employs Multi-Agent Reinforcement Learning (MARL) to coordinate Traffic Light Controllers (TLCs) and Connected Autonomous Vehicles (CAVs). However, the performance of these systems is fundamentally capped by their hand-crafted, myopic rewards (e.g., intersection pressure), which fail to capture high-level, human-centric goals like safety, flow stability, and comfort. To overcome this limitation, we introduce C2T, a novel framework that learns a common-sense coordination model from traffic-vehicle dynamics. C2T distills "common-sense" knowledge from a Large Language Model (LLM) into a learned intrinsic reward function. This new reward is then used to guide the coordination policy of a cooperative multi-intersection TLC MARL system on CityFlow-based multi-intersection benchmarks. Our framework significantly outperforms strong MARL baselines in traffic efficiency, safety, and an energy-related proxy. We further highlight C2T's flexibility in principle, allowing distinct "efficiency-focused" versus "safety-focused" policies by modifying the LLM prompt.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 26 references that are in the map. First posted on arXiv 10 Apr 2026.
Builds on
15 of 26 references.
References · 15
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2017Deep reinforcement learning from human preferencescited by 3,846
- 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 1,916
- 2016Generative Adversarial Imitation Learningcited by 1,576
- 2023DriveLM: Driving with Graph Visual Question Answeringcited by 527
- 2017Learning Robust Rewards with Adversarial Inverse Reinforcement Learningcited by 485
- 2019CoLight: Learning Network-level Cooperation for Traffic Signal Controlcited by 133
- 2019CityFlow: A Multi-Agent Reinforcement Learning Environment for Large Scale City Traffic Scenariocited by 114
- 2023LLMLight: Large Language Models as Traffic Signal Control Agentscited by 73
- 2020AttendLight: Universal Attention-Based Reinforcement Learning Model for Traffic Signal Controlcited by 60
- 2023NuScenes-MQA: Integrated Evaluation of Captions and QA for Autonomous Driving Datasets using Markup Annotationscited by 31
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025MAESTRO: Multi-Agent Environment Shaping through Task and Reward Optimization
- 2026LATS: Large Language Model Assisted Teacher-Student Framework for Multi-Agent Reinforcement Learning in Traffic Signal Control
- 2026TrafficClaw: A Generalizable LLM Agent in the Unified Physical Environment for Urban Traffic Control
- 2025An Automated Reinforcement Learning Reward Design Framework with Large Language Model for Cooperative Platoon Coordination
- 2022CoTV: Cooperative Control for Traffic Light Signals and Connected Autonomous Vehicles using Deep Reinforcement Learning
- 2025LearningFlow: Automated Policy Learning Workflow for Urban Driving with Large Language Models
- 2024OffLight: An Offline Multi-Agent Reinforcement Learning Framework for Traffic Signal Control
- 2025VLMLight: Safety-Critical Traffic Signal Control via Vision-Language Meta-Control and Dual-Branch Reasoning Architecture