Towards Interactive and Learnable Cooperative Driving Automation: a Large Language Model-Driven Decision-Making Framework
On the map: End-to-end autonomous driving → Cooperative and V2X driving
Abstract (arXiv)
At present, Connected Autonomous Vehicles (CAVs) have begun to open road testing around the world, but their safety and efficiency performance in complex scenarios is still not satisfactory. Cooperative driving leverages the connectivity ability of CAVs to achieve synergies greater than the sum of their parts, making it a promising approach to improving CAV performance in complex scenarios. However, the lack of interaction and continuous learning ability limits current cooperative driving to single-scenario applications and specific Cooperative Driving Automation (CDA). To address these challenges, this paper proposes CoDrivingLLM, an interactive and learnable LLM-driven cooperative driving framework, to achieve all-scenario and all-CDA. First, since Large Language Models(LLMs) are not adept at handling mathematical calculations, an environment module is introduced to update vehicle positions based on semantic decisions, thus avoiding potential errors from direct LLM control of vehicle positions. Second, based on the four levels of CDA defined by the SAE J3216 standard, we propose a Chain-of-Thought (COT) based reasoning module that includes state perception, intent sharing, negotiation, and decision-making, enhancing the stability of LLMs in multi-step reasoning tasks. Centralized conflict resolution is then managed through a conflict coordinator in the reasoning process. Finally, by introducing a memory module and employing retrieval-augmented generation, CAVs are endowed with the ability to learn from their past experiences. We validate the proposed CoDrivingLLM through ablation experiments on the negotiation module, reasoning with different shots experience, and comparison with other cooperative driving methods.
Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Placed in Cooperative and V2X driving, one of 9 directions in End-to-end autonomous driving. Builds on 21 of its 44 references that are in the map. First posted on arXiv 19 Sep 2024.
Builds on
21 of 44 references.
Closest ancestors · 2
Same direction, newest first
- 2023Towards Socially Responsive Autonomous Vehicles: A Reinforcement Learning Framework with Driving Priors and Coordination Awareness18 Sep
- 2023Cooperative Driving of Connected Autonomous Vehicles in Heterogeneous Mixed Traffic: A Game Theoretic Approach5 May
Other references · 19
- 2017Attention Is All You Needcited by 60,361
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2023DiLu: A Knowledge-Driven Approach to Autonomous Driving with Large Language Modelscited by 207
- 2023LanguageMPC: Large Language Models as Decision Makers for Autonomous Drivingcited by 190
- 2021A Survey of Zero-shot Generalisation in Deep Reinforcement Learningcited by 170
- 2023Drive Like a Human: Rethinking Autonomous Driving with Large Language Modelscited by 160
- 2021Why Generalization in RL is Difficult: Epistemic POMDPs and Implicit Partial Observabilitycited by 109
- 2023Receive, Reason, and React: Drive as You Say with Large Language Models in Autonomous Vehiclescited by 72
- 2023Personalized Autonomous Driving with Large Language Models: Field Experimentscited by 48
- 2024AgentsCoDriver: Large Language Model Empowered Collaborative Driving with Lifelong Learningcited by 40
7 more
- 2019Cooperation-Aware Lane Change Maneuver in Dense Traffic based on Model Predictive Control with Recurrent Neural Networkcited by 14
- 2024Cooperative Decision-Making for CAVs at Unsignalized Intersections: A MARL Approach with Attention and Hierarchical Game Priorscited by 14
- 2024Instruct Large Language Models to Drive like Humanscited by 11
- 2019Cooperative Driving at Unsignalized Intersections Using Tree Searchcited by 10
- 2023Communication-Efficient Decentralized Multi-Agent Reinforcement Learning for Cooperative Adaptive Cruise Controlcited by 9
- 2021Connected and Automated Vehicle Distributed Control for On-ramp Merging Scenario: A Virtual Rotation Approachcited by 5
- 2021Conflict-free Cooperation Method for Connected and Automated Vehicles at Unsignalized Intersections: Graph-based Modeling and Optimality Analysiscited by 3
Built on by
Citing papers per year: 2024: 1; 2025: 11; 2026: 4.
16 papers.
Sort:
By area:
- 2025Exploring the Roles of Large Language Models in Reshaping Transportation Systems: A Survey, Framework, and Roadmapcited by 26
- 2025LangCoop: Collaborative Driving with Languagecited by 25
- 2025DrugPilot: LLM-based Parameterized Reasoning Agent for Drug Discoverycited by 19
- 2024Language-Driven Policy Distillation for Cooperative Driving in Multi-Agent Reinforcement Learningcited by 14
- 2025TeLL-Drive: Enhancing Autonomous Driving with Teacher LLM-Guided Deep Reinforcement Learningcited by 13
- 2025CoLMDriver: LLM-based Negotiation Benefits Cooperative Autonomous Drivingcited by 13
- 2025Large Language Models and Their Applications in Roadway Safety and Mobility Enhancement: A Comprehensive Reviewcited by 8
- 2025Interact, Instruct to Improve: A LLM-Driven Parallel Actor-Reasoner Framework for Enhancing Autonomous Vehicle Interactionscited by 3
- 2025Large Language Model-assisted Autonomous Vehicle Recovery from Immobilizationcited by 3
- 2025SafeCoop: Unravelling Full Stack Safety in Agentic Collaborative Drivingcited by 2
- 2025Integrating Machine Learning into Belief-Desire-Intention Agents: Current Advances and Open Challengescited by 1
- 2026Virtual Traffic Police: Large Language Model-Augmented Traffic Signal Control for Unforeseen Incidentscited by 1
4 more
- 2026Decision-Making with Lightweight Confidence-Aware Language Model for Autonomous Drivingcited by 1
- 2025Driving Through Uncertainty: Risk-Averse Control with LLM Commonsense for Autonomous Driving under Perception Deficitscited by 0
- 2026CooperDrive: Enhancing Driving Decisions Through Cooperative Perceptioncited by 0
- 2026Large Language Models in the Loop: A Stability- and Network-Aware Survey in Networked Control, Cyber-Physical, and Multi-Agent Systemscited by 0
- 2026Large Language Models in the Loop: A Stability- and Network-Aware Survey in Networked Control, Cyber-Physical, and Multi-Agent Systems15 Sep 2026
- 2026Decision-Making with Lightweight Confidence-Aware Language Model for Autonomous Driving25 May 2026
- 2026CooperDrive: Enhancing Driving Decisions Through Cooperative Perception15 Apr 2026
- 2026Virtual Traffic Police: Large Language Model-Augmented Traffic Signal Control for Unforeseen Incidents22 Jan 2026
- 2025Large Language Model-assisted Autonomous Vehicle Recovery from Immobilization29 Oct 2025
- 2025Integrating Machine Learning into Belief-Desire-Intention Agents: Current Advances and Open Challenges23 Oct 2025
- 2025SafeCoop: Unravelling Full Stack Safety in Agentic Collaborative Driving20 Oct 2025
- 2025DrugPilot: LLM-based Parameterized Reasoning Agent for Drug Discovery20 May 2025
- 2025Large Language Models and Their Applications in Roadway Safety and Mobility Enhancement: A Comprehensive Review19 May 2025
- 2025LangCoop: Collaborative Driving with Language18 Apr 2025
- 2025Exploring the Roles of Large Language Models in Reshaping Transportation Systems: A Survey, Framework, and Roadmap27 Mar 2025
- 2025CoLMDriver: LLM-based Negotiation Benefits Cooperative Autonomous Driving11 Mar 2025
4 more
- 2025Driving Through Uncertainty: Risk-Averse Control with LLM Commonsense for Autonomous Driving under Perception Deficits10 Mar 2025
- 2025Interact, Instruct to Improve: A LLM-Driven Parallel Actor-Reasoner Framework for Enhancing Autonomous Vehicle Interactions1 Mar 2025
- 2025TeLL-Drive: Enhancing Autonomous Driving with Teacher LLM-Guided Deep Reinforcement Learning3 Feb 2025
- 2024Language-Driven Policy Distillation for Cooperative Driving in Multi-Agent Reinforcement Learning31 Oct 2024
- 2025LangCoop: Collaborative Driving with Languagecited by 25
- 2024Language-Driven Policy Distillation for Cooperative Driving in Multi-Agent Reinforcement Learningcited by 14
- 2025TeLL-Drive: Enhancing Autonomous Driving with Teacher LLM-Guided Deep Reinforcement Learningcited by 13
- 2025Large Language Model-assisted Autonomous Vehicle Recovery from Immobilizationcited by 3
- 2025SafeCoop: Unravelling Full Stack Safety in Agentic Collaborative Drivingcited by 2
- 2025Driving Through Uncertainty: Risk-Averse Control with LLM Commonsense for Autonomous Driving under Perception Deficitscited by 0
- 2026CooperDrive: Enhancing Driving Decisions Through Cooperative Perceptioncited by 0
- 2026CooperDrive: Enhancing Driving Decisions Through Cooperative Perception15 Apr 2026
- 2025Large Language Model-assisted Autonomous Vehicle Recovery from Immobilization29 Oct 2025
- 2025SafeCoop: Unravelling Full Stack Safety in Agentic Collaborative Driving20 Oct 2025
- 2025LangCoop: Collaborative Driving with Language18 Apr 2025
- 2025Driving Through Uncertainty: Risk-Averse Control with LLM Commonsense for Autonomous Driving under Perception Deficits10 Mar 2025
- 2025TeLL-Drive: Enhancing Autonomous Driving with Teacher LLM-Guided Deep Reinforcement Learning3 Feb 2025
- 2024Language-Driven Policy Distillation for Cooperative Driving in Multi-Agent Reinforcement Learning31 Oct 2024
- 2025Exploring the Roles of Large Language Models in Reshaping Transportation Systems: A Survey, Framework, and Roadmapcited by 26
- 2025CoLMDriver: LLM-based Negotiation Benefits Cooperative Autonomous Drivingcited by 13
- 2025Large Language Models and Their Applications in Roadway Safety and Mobility Enhancement: A Comprehensive Reviewcited by 8
- 2025Integrating Machine Learning into Belief-Desire-Intention Agents: Current Advances and Open Challengescited by 1
- 2026Virtual Traffic Police: Large Language Model-Augmented Traffic Signal Control for Unforeseen Incidentscited by 1
- 2026Virtual Traffic Police: Large Language Model-Augmented Traffic Signal Control for Unforeseen Incidents22 Jan 2026
- 2025Integrating Machine Learning into Belief-Desire-Intention Agents: Current Advances and Open Challenges23 Oct 2025
- 2025Large Language Models and Their Applications in Roadway Safety and Mobility Enhancement: A Comprehensive Review19 May 2025
- 2025Exploring the Roles of Large Language Models in Reshaping Transportation Systems: A Survey, Framework, and Roadmap27 Mar 2025
- 2025CoLMDriver: LLM-based Negotiation Benefits Cooperative Autonomous Driving11 Mar 2025
Similar, not cited
Close in wording, no citation either way
- 2026CoLMIN: LLM-based Multi-Decision Path Negotiation for Cooperative Autonomous Driving
- 2026CMU-Drive and V2V-VLA: Cooperative Multi-agent Unified Driving with Reasoning Benchmark and Vehicle-to-Vehicle Vision-Language-Action Models
- 2025V2V-LLM: Vehicle-to-Vehicle Cooperative Autonomous Driving with Multimodal Large Language Models
- 2025V2V-GoT: Vehicle-to-Vehicle Cooperative Autonomous Driving with Multimodal Large Language Models and Graph-of-Thoughts
- 2024Testing Large Language Models on Driving Theory Knowledge and Skills for Connected Autonomous Vehicles
- 2025CoopReflect: Towards Natural Language Communication for Cooperative Autonomous Driving via Multi-Agent Learning
- 2023DriveMLM: Aligning Multi-Modal Large Language Models with Behavioral Planning States for Autonomous Driving
- 2024KoMA: Knowledge-driven Multi-agent Framework for Autonomous Driving with Large Language Models