MARLIN: Multi-Agent Reinforcement Learning Guided by Language-Based Inter-Robot Negotiation
On the map: LLM agents and tool use → Reinforcement learning for LLM agents
Abstract (arXiv)
Multi-agent reinforcement learning is a key method for training multi-robot systems. Through rewarding or punishing robots over a series of episodes according to their performance, they can be trained and then deployed in the real world. However, poorly trained policies can lead to unsafe behaviour during early training stages. We introduce Multi-Agent Reinforcement Learning guided by language-based Inter-robot Negotiation (MARLIN), a hybrid framework in which large language models provide high-level planning before the reinforcement learning policy has learned effective behaviours. Robots use language models to negotiate actions and generate plans that guide policy learning. The system dynamically switches between reinforcement learning and language-model-based negotiation during training, enabling safer and more effective exploration. MARLIN is evaluated using both simulated and physical robots with local and remote language models. Results show that, compared to standard multi-agent reinforcement learning, the hybrid approach achieves higher performance in early training without reducing final performance. The code is available at https://github.com/SooratiLab/MARLIN.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Reinforcement learning for LLM agents, one of 16 directions in LLM agents and tool use. Builds on 34 of its 56 references that are in the map. First posted on arXiv 18 Oct 2024.
Builds on
34 of 56 references.
Closest ancestors · 3
Same direction, newest first
- 2024Safe Multi-agent Reinforcement Learning with Natural Language Constraints30 May
- 2024Knowing What Not to Do: Leverage Language Model Insights for Action Space Pruning in Multi-agent Reinforcement Learning27 May
- 2024LLM-based Multi-Agent Reinforcement Learning: Current and Future Directions17 May
Other references · 31
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023GPT-4 Technical Reportcited by 18,396
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
- 2021The Surprising Effectiveness of PPO in Cooperative, Multi-Agent Gamescited by 942
19 more
- 2022LM-Nav: Robotic Navigation with Large Pre-Trained Models of Language, Vision, and Actioncited by 439
- 2023RoCo: Dialectic Multi-Robot Collaboration with Large Language Modelscited by 172
- 2023Scalable Multi-Robot Collaboration with Large Language Models: Centralized or Decentralized Systems?cited by 106
- 2023Can an Embodied Agent Find Your "Cat-shaped Mug"? LLM-Guided Exploration for Zero-Shot Object Navigationcited by 74
- 2024Towards Efficient LLM Grounding for Embodied Multi-Agent Collaborationcited by 45
- 2024Large Language Model Inference Acceleration: A Comprehensive Hardware Perspectivecited by 38
- 2023Heterogeneous Multi-Robot Reinforcement Learningcited by 36
- 2018Multi-Agent Common Knowledge Reinforcement Learningcited by 31
- 2023Is Centralized Training with Decentralized Execution Framework Centralized Enough for MARL?cited by 18
- 2023Language and Sketching: An LLM-driven Interactive Multimodal Multitask Robot Navigation Frameworkcited by 16
- 2022Real-Time Reinforcement Learning for Vision-Based Robotics Utilizing Local and Remote Computerscited by 13
- 2024Wonderful Team: Zero-Shot Physical Task Planning with Visual LLMscited by 11
- 2024A Survey of Language-Based Communication in Roboticscited by 10
- 2024Skip n: A Simple Method to Reduce Hallucination in Large Vision-Language Modelscited by 9
- 2024Language-Conditioned Offline RL for Multi-Robot Navigationcited by 9
- 2024MAexp: A Generic Platform for RL-based Multi-Agent Explorationcited by 7
- 2023COMPOSER: Scalable and Robust Modular Policies for Snake Robotscited by 5
- 2024Conversational Language Models for Human-in-the-Loop Multi-Robot Coordinationcited by 4
- 2023Demonstrating Performance Benefits of Human-Swarm Teamingcited by 1
Built on by
Citing papers per year: 2025: 3; 2026: 2.
5 papers.
- 2025Large Language Models for Multi-Robot Systems: A Surveycited by 27
- 2025Magentic Marketplace: An Open-Source Environment for Studying Agentic Marketscited by 19
- 2025Prompting Robot Teams with Natural Languagecited by 0
- 2026LLM-ALSO: LLM-Driven Adaptive Learning-Signal Optimization for Multi-Agent Reinforcement Learningcited by 0
- 2026A MARL Centered Reference Architecture for Large Language Model Augmentation in Smart Manufacturingcited by 0
- 2026A MARL Centered Reference Architecture for Large Language Model Augmentation in Smart Manufacturing7 Aug 2026
- 2026LLM-ALSO: LLM-Driven Adaptive Learning-Signal Optimization for Multi-Agent Reinforcement Learning28 May 2026
- 2025Magentic Marketplace: An Open-Source Environment for Studying Agentic Markets27 Oct 2025
- 2025Prompting Robot Teams with Natural Language29 Sep 2025
- 2025Large Language Models for Multi-Robot Systems: A Survey6 Feb 2025
Similar, not cited
Close in wording, no citation either way
- 2025ICCO: Learning an Instruction-conditioned Coordinator for Language-guided Task-aligned Multi-robot Control
- 2025LAMARL: LLM-Aided Multi-Agent Reinforcement Learning for Cooperative Policy Generation
- 2024Generalising Multi-Agent Cooperation through Task-Agnostic Communication
- 2025MARFT: Multi-Agent Reinforcement Fine-Tuning
- 2025CRAFT: Coaching Reinforcement Learning Autonomously using Foundation Models for Multi-Robot Coordination Tasks
- 2023Conditionally Combining Robot Skills using Large Language Models
- 2025Automated Hybrid Reward Scheduling via Large Language Models for Robotic Skill Learning
- 2026LangMARL: Natural Language Multi-Agent Reinforcement Learning