mlsanityData to 7 Oct 2026

C2T: Captioning-Structure and LLM-Aligned Common-Sense Reward Learning for Traffic--Vehicle Coordination

arXiv 2604.13098 ↗First posted 10 Apr 2026cs.MA cs.CV cs.ROcited by 0

Not on the map. Why?

Abstract (arXiv)

State-of-the-art (SOTA) urban traffic control increasingly employs Multi-Agent Reinforcement Learning (MARL) to coordinate Traffic Light Controllers (TLCs) and Connected Autonomous Vehicles (CAVs). However, the performance of these systems is fundamentally capped by their hand-crafted, myopic rewards (e.g., intersection pressure), which fail to capture high-level, human-centric goals like safety, flow stability, and comfort. To overcome this limitation, we introduce C2T, a novel framework that learns a common-sense coordination model from traffic-vehicle dynamics. C2T distills "common-sense" knowledge from a Large Language Model (LLM) into a learned intrinsic reward function. This new reward is then used to guide the coordination policy of a cooperative multi-intersection TLC MARL system on CityFlow-based multi-intersection benchmarks. Our framework significantly outperforms strong MARL baselines in traffic efficiency, safety, and an energy-related proxy. We further highlight C2T's flexibility in principle, allowing distinct "efficiency-focused" versus "safety-focused" policies by modifying the LLM prompt.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 26 references that are in the map. First posted on arXiv 10 Apr 2026.

Builds on

15 of 26 references.

References · 15

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2017Proximal Policy Optimization Algorithmscited by 14,441
  3. 2017Deep reinforcement learning from human preferencescited by 3,846
  4. 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 1,916
  5. 2016Generative Adversarial Imitation Learningcited by 1,576
  6. 2023DriveLM: Driving with Graph Visual Question Answeringcited by 527
  7. 2017Learning Robust Rewards with Adversarial Inverse Reinforcement Learningcited by 485
  8. 2019CoLight: Learning Network-level Cooperation for Traffic Signal Controlcited by 133
  9. 2019CityFlow: A Multi-Agent Reinforcement Learning Environment for Large Scale City Traffic Scenariocited by 114
  10. 2023LLMLight: Large Language Models as Traffic Signal Control Agentscited by 73
  11. 2020AttendLight: Universal Attention-Based Reinforcement Learning Model for Traffic Signal Controlcited by 60
  12. 2023NuScenes-MQA: Integrated Evaluation of Captions and QA for Autonomous Driving Datasets using Markup Annotationscited by 31
3 more
  1. 2021Expression might be enough: representing pressure and demand for reinforcement learning based traffic signal controlcited by 28
  2. 2025Ask a Strong LLM Judge when Your Reward Model is Uncertaincited by 13
  3. 2024Efficient Diversity-based Experience Replay for Deep Reinforcement Learningcited by 7

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025MAESTRO: Multi-Agent Environment Shaping through Task and Reward Optimization
  2. 2026LATS: Large Language Model Assisted Teacher-Student Framework for Multi-Agent Reinforcement Learning in Traffic Signal Control
  3. 2026TrafficClaw: A Generalizable LLM Agent in the Unified Physical Environment for Urban Traffic Control
  4. 2025An Automated Reinforcement Learning Reward Design Framework with Large Language Model for Cooperative Platoon Coordination
  5. 2022CoTV: Cooperative Control for Traffic Light Signals and Connected Autonomous Vehicles using Deep Reinforcement Learning
  6. 2025LearningFlow: Automated Policy Learning Workflow for Urban Driving with Large Language Models
  7. 2024OffLight: An Offline Multi-Agent Reinforcement Learning Framework for Traffic Signal Control
  8. 2025VLMLight: Safety-Critical Traffic Signal Control via Vision-Language Meta-Control and Dual-Branch Reasoning Architecture