Reinforcement Learning-Augmented LLM Agents for Collaborative Decision Making and Performance Optimization
On the map: LLM agents and tool use → Reinforcement learning for LLM agents
Abstract (arXiv)
Large Language Models (LLMs) perform well in language tasks but often lack collaborative awareness and struggle to optimize global performance in multi-agent settings. We present a reinforcement learning-augmented LLM agent framework that formulates cooperation as a decentralized partially observable Markov decision process (Dec-POMDP) and adopts centralized training with decentralized execution (CTDE). We introduce Group Relative Policy Optimization (GRPO) to jointly optimize agent policies with access to global signals during training, together with a simplified joint reward that balances task quality, speed, and coordination cost. On collaborative writing and coding benchmarks, our framework delivers a 3x increase in task processing speed over single-agent baselines, 98.7% structural/style consistency in writing, and a 74.6% test pass rate in coding. The approach consistently outperforms strong multi-agent LLM baselines and provides a practical path toward reliable collaboration in complex workflows.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reinforcement learning for LLM agents, one of 16 directions in LLM agents and tool use. Builds on 9 of its 12 references that are in the map. First posted on arXiv 31 Dec 2025.
Builds on
9 of 12 references.
References · 9
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
- 2017Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environmentscited by 1,558
- 2023AgentBench: Evaluating LLMs as Agentscited by 1,267
- 2021The Surprising Effectiveness of PPO in Cooperative, Multi-Agent Gamescited by 942
- 2017Counterfactual Multi-Agent Policy Gradientscited by 751
- 2018QMIX: Monotonic Value Function Factorisation for Deep Multi-Agent Reinforcement Learningcited by 708
- 2021Trust Region Policy Optimisation in Multi-Agent Reinforcement Learningcited by 186
- 2022Revisiting Some Common Practices in Cooperative Multi-Agent Reinforcement Learningcited by 32
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025End-to-End Optimization of LLM-Driven Multi-Agent Search Systems via Heterogeneous-Group-Based Reinforcement Learning
- 2025LLM Collaboration With Multi-Agent Reinforcement Learning
- 2025Controlling Performance and Budget of a Centralized Multi-agent LLM System with Reinforcement Learning
- 2025Enhancing Multi-Agent Systems via Reinforcement Learning with LLM-based Planner and Graph-based Policy
- 2025Stronger-MAS: Multi-Agent Reinforcement Learning for Collaborative LLMs
- 2025Training-Free Group Relative Policy Optimization
- 2026SRPO: Setwise Relative Policy Optimization for Multi-Agent LLMs
- 2026Learning Decentralized LLM Collaboration with Multi-Agent Actor Critic