CoMAL: Collaborative Multi-Agent Large Language Models for Mixed-Autonomy Traffic
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
The integration of autonomous vehicles into urban traffic has great potential to improve efficiency by reducing congestion and optimizing traffic flow systematically. In this paper, we introduce CoMAL (Collaborative Multi-Agent LLMs), a framework designed to address the mixed-autonomy traffic problem by collaboration among autonomous vehicles to optimize traffic flow. CoMAL is built upon large language models, operating in an interactive traffic simulation environment. It utilizes a Perception Module to observe surrounding agents and a Memory Module to store strategies for each agent. The overall workflow includes a Collaboration Module that encourages autonomous vehicles to discuss the effective strategy and allocate roles, a reasoning engine to determine optimal behaviors based on assigned roles, and an Execution Module that controls vehicle actions using a hybrid approach combining rule-based models. Experimental results demonstrate that CoMAL achieves superior performance on the Flow benchmark. Additionally, we evaluate the impact of different language models and compare our framework with reinforcement learning approaches. It highlights the strong cooperative capability of LLM agents and presents a promising solution to the mixed-autonomy traffic challenge. The code is available at https://github.com/Hyan-Yao/CoMAL.
Key facts. Cited by 22 papers in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 24 of its 40 references that are in the map. First posted on arXiv 18 Oct 2024.
Builds on
24 of 40 references.
References · 24
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2015Trust Region Policy Optimizationcited by 2,580
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
- 2022Planning-oriented Autonomous Drivingcited by 1,087
- 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 769
- 2017Evolution Strategies as a Scalable Alternative to Reinforcement Learningcited by 574
- 2016Benchmarking Deep Reinforcement Learning for Continuous Controlcited by 371
- 2023GPT-Driver: Learning to Drive with GPTcited by 347
- 2023Multi-Agent Collaboration: Harnessing the Power of Intelligent LLM Agentscited by 333
- 2023Parting with Misconceptions about Learning-based Vehicle Motion Planningcited by 242
- 2023DiLu: A Knowledge-Driven Approach to Autonomous Driving with Large Language Modelscited by 207
- 2024The Landscape of Emerging AI Agent Architectures for Reasoning, Planning, and Tool Calling: A Surveycited by 168
12 more
- 2023Recent Advancements in End-to-End Autonomous Driving using Deep Learning: A Surveycited by 103
- 2018Simple random search provides a competitive approach to reinforcement learningcited by 75
- 2017Flow: A Modular Learning Framework for Mixed Autonomy Trafficcited by 73
- 2021A Survey on Interpretable Reinforcement Learningcited by 73
- 2023Open-TI: Open Traffic Intelligence with Augmented Language Modelcited by 38
- 2024Can Vehicle Motion Planning Generalize to Realistic Long-tail Scenarios?cited by 38
- 2023Prompt to Transfer: Sim-to-Real Transfer for Traffic Signal Control with Prompt Learningcited by 36
- 2022LibSignal: An Open Library for Traffic Signal Controlcited by 16
- 2022Robustness and Adaptability of Reinforcement Learning based Cooperative Autonomous Driving in Mixed-autonomy Trafficcited by 15
- 2023Reinforcement Learning Approaches for Traffic Signal Control under Missing Datacited by 13
- 2017String stability and a delay-based spacing policy for vehicle platoons subject to disturbancescited by 3
- 2024A Multi-Agent Rollout Approach for Highway Bottleneck Decongestion in Mixed Autonomycited by 2
Built on by
Citing papers per year: 2025: 14; 2026: 8.
22 papers.
Sort:
By area:
- 2025A Survey of Context Engineering for Large Language Modelscited by 126
- 2025Exploring the Roles of Large Language Models in Reshaping Transportation Systems: A Survey, Framework, and Roadmapcited by 26
- 2025LangCoop: Collaborative Driving with Languagecited by 25
- 2025CoLLMLight: Cooperative Large Language Model Agents for Network-Wide Traffic Signal Controlcited by 15
- 2025CoLMDriver: LLM-based Negotiation Benefits Cooperative Autonomous Drivingcited by 13
- 2025Generative AI in Transportation Planning: A Surveycited by 8
- 2025Generative AI for Autonomous Driving: Frontiers and Opportunitiescited by 7
- 2025LiloDriver: A Lifelong Learning Framework for Closed-loop Motion Planning in Long-tail Autonomous Driving Scenarioscited by 7
- 2025CoopReflect: Towards Natural Language Communication for Cooperative Autonomous Driving via Multi-Agent Learningcited by 7
- 2026Every Response Counts: Quantifying Uncertainty of LLM-based Multi-Agent Systems through Tensor Decompositioncited by 7
- 2025Everyone Contributes! Incentivizing Strategic Cooperation in Multi-LLM Systems via Sequential Public Goods Gamescited by 4
- 2026Conformal Feedback Alignment: Quantifying Answer-Level Reliability for Robust LLM Alignmentcited by 4
10 more
- 2026LangMARL: Natural Language Multi-Agent Reinforcement Learningcited by 4
- 2025Instructional Agents: Reducing Teaching Faculty Workload through Multi-Agent Instructional Designcited by 3
- 2026HIPO: Instruction Hierarchy via Constrained Reinforcement Learningcited by 3
- 2025Empowering Real-World: A Survey on the Technology, Practice, and Evaluation of LLM-driven Industry Agentscited by 2
- 2025SafeCoop: Unravelling Full Stack Safety in Agentic Collaborative Drivingcited by 2
- 2025An LLM-Powered Cooperative Framework for Large-Scale Multi-Vehicle Navigationcited by 1
- 2026HiDrive: A Closed-Loop Benchmark for High-Level Autonomous Drivingcited by 1
- 2026MASkills: Continual Skills Optimization for Multi-Agent LLM Systemscited by 1
- 2026Developing AI Agents with Simulated Data: Why, what, and how?cited by 0
- 2026Information-Directed Offline-to-Online Reinforcement Learningcited by 0
- 2026MASkills: Continual Skills Optimization for Multi-Agent LLM Systems2 Sep 2026
- 2026Information-Directed Offline-to-Online Reinforcement Learning28 May 2026
- 2026HiDrive: A Closed-Loop Benchmark for High-Level Autonomous Driving11 May 2026
- 2026Every Response Counts: Quantifying Uncertainty of LLM-based Multi-Agent Systems through Tensor Decomposition9 Apr 2026
- 2026LangMARL: Natural Language Multi-Agent Reinforcement Learning1 Apr 2026
- 2026HIPO: Instruction Hierarchy via Constrained Reinforcement Learning17 Mar 2026
- 2026Developing AI Agents with Simulated Data: Why, what, and how?17 Feb 2026
- 2026Conformal Feedback Alignment: Quantifying Answer-Level Reliability for Robust LLM Alignment24 Jan 2026
- 2025SafeCoop: Unravelling Full Stack Safety in Agentic Collaborative Driving20 Oct 2025
- 2025Empowering Real-World: A Survey on the Technology, Practice, and Evaluation of LLM-driven Industry Agents20 Oct 2025
- 2025An LLM-Powered Cooperative Framework for Large-Scale Multi-Vehicle Navigation9 Oct 2025
- 2025Instructional Agents: Reducing Teaching Faculty Workload through Multi-Agent Instructional Design27 Aug 2025
10 more
- 2025Everyone Contributes! Incentivizing Strategic Cooperation in Multi-LLM Systems via Sequential Public Goods Games4 Aug 2025
- 2025A Survey of Context Engineering for Large Language Models17 Jul 2025
- 2025CoopReflect: Towards Natural Language Communication for Cooperative Autonomous Driving via Multi-Agent Learning23 May 2025
- 2025LiloDriver: A Lifelong Learning Framework for Closed-loop Motion Planning in Long-tail Autonomous Driving Scenarios22 May 2025
- 2025Generative AI for Autonomous Driving: Frontiers and Opportunities13 May 2025
- 2025LangCoop: Collaborative Driving with Language18 Apr 2025
- 2025Exploring the Roles of Large Language Models in Reshaping Transportation Systems: A Survey, Framework, and Roadmap27 Mar 2025
- 2025CoLLMLight: Cooperative Large Language Model Agents for Network-Wide Traffic Signal Control14 Mar 2025
- 2025CoLMDriver: LLM-based Negotiation Benefits Cooperative Autonomous Driving11 Mar 2025
- 2025Generative AI in Transportation Planning: A Survey10 Mar 2025
- 2025LangCoop: Collaborative Driving with Languagecited by 25
- 2025Generative AI for Autonomous Driving: Frontiers and Opportunitiescited by 7
- 2025LiloDriver: A Lifelong Learning Framework for Closed-loop Motion Planning in Long-tail Autonomous Driving Scenarioscited by 7
- 2025CoopReflect: Towards Natural Language Communication for Cooperative Autonomous Driving via Multi-Agent Learningcited by 7
- 2025SafeCoop: Unravelling Full Stack Safety in Agentic Collaborative Drivingcited by 2
- 2026HiDrive: A Closed-Loop Benchmark for High-Level Autonomous Drivingcited by 1
- 2026HiDrive: A Closed-Loop Benchmark for High-Level Autonomous Driving11 May 2026
- 2025SafeCoop: Unravelling Full Stack Safety in Agentic Collaborative Driving20 Oct 2025
- 2025CoopReflect: Towards Natural Language Communication for Cooperative Autonomous Driving via Multi-Agent Learning23 May 2025
- 2025LiloDriver: A Lifelong Learning Framework for Closed-loop Motion Planning in Long-tail Autonomous Driving Scenarios22 May 2025
- 2025Generative AI for Autonomous Driving: Frontiers and Opportunities13 May 2025
- 2025LangCoop: Collaborative Driving with Language18 Apr 2025
- 2025CoLLMLight: Cooperative Large Language Model Agents for Network-Wide Traffic Signal Controlcited by 15
- 2026Every Response Counts: Quantifying Uncertainty of LLM-based Multi-Agent Systems through Tensor Decompositioncited by 7
- 2026LangMARL: Natural Language Multi-Agent Reinforcement Learningcited by 4
- 2025Instructional Agents: Reducing Teaching Faculty Workload through Multi-Agent Instructional Designcited by 3
- 2026MASkills: Continual Skills Optimization for Multi-Agent LLM Systemscited by 1
- 2026MASkills: Continual Skills Optimization for Multi-Agent LLM Systems2 Sep 2026
- 2026Every Response Counts: Quantifying Uncertainty of LLM-based Multi-Agent Systems through Tensor Decomposition9 Apr 2026
- 2026LangMARL: Natural Language Multi-Agent Reinforcement Learning1 Apr 2026
- 2025Instructional Agents: Reducing Teaching Faculty Workload through Multi-Agent Instructional Design27 Aug 2025
- 2025CoLLMLight: Cooperative Large Language Model Agents for Network-Wide Traffic Signal Control14 Mar 2025
- 2025A Survey of Context Engineering for Large Language Modelscited by 126
- 2025Exploring the Roles of Large Language Models in Reshaping Transportation Systems: A Survey, Framework, and Roadmapcited by 26
- 2025CoLMDriver: LLM-based Negotiation Benefits Cooperative Autonomous Drivingcited by 13
- 2025Generative AI in Transportation Planning: A Surveycited by 8
- 2025Everyone Contributes! Incentivizing Strategic Cooperation in Multi-LLM Systems via Sequential Public Goods Gamescited by 4
- 2025An LLM-Powered Cooperative Framework for Large-Scale Multi-Vehicle Navigationcited by 1
- 2026Developing AI Agents with Simulated Data: Why, what, and how?cited by 0
- 2026Developing AI Agents with Simulated Data: Why, what, and how?17 Feb 2026
- 2025An LLM-Powered Cooperative Framework for Large-Scale Multi-Vehicle Navigation9 Oct 2025
- 2025Everyone Contributes! Incentivizing Strategic Cooperation in Multi-LLM Systems via Sequential Public Goods Games4 Aug 2025
- 2025A Survey of Context Engineering for Large Language Models17 Jul 2025
- 2025Exploring the Roles of Large Language Models in Reshaping Transportation Systems: A Survey, Framework, and Roadmap27 Mar 2025
- 2025CoLMDriver: LLM-based Negotiation Benefits Cooperative Autonomous Driving11 Mar 2025
- 2025Generative AI in Transportation Planning: A Survey10 Mar 2025
Similar, not cited
Close in wording, no citation either way
- 2025Impact of Collective Behaviors of Autonomous Vehicles on Urban Traffic Dynamics: A Multi-Agent Reinforcement Learning Approach
- 2025Multi-Agent Autonomous Driving Systems with Large Language Models: A Survey of Recent Advances
- 2026TrafficClaw: A Generalizable LLM Agent in the Unified Physical Environment for Urban Traffic Control
- 2024KoMA: Knowledge-driven Multi-agent Framework for Autonomous Driving with Large Language Models
- 2026COIN: Collaborative Interaction-Aware Multi-Agent Reinforcement Learning for Self-Driving Systems
- 2024AgentsCoDriver: Large Language Model Empowered Collaborative Driving with Lifelong Learning
- 2026CMU-Drive and V2V-VLA: Cooperative Multi-agent Unified Driving with Reasoning Benchmark and Vehicle-to-Vehicle Vision-Language-Action Models
- 2024Agent-Agnostic Centralized Training for Decentralized Multi-Agent Cooperative Driving