mlsanityData to 14 Oct 2026

MARLIN: Multi-Agent Reinforcement Learning Guided by Language-Based Inter-Robot Negotiation

arXiv 2410.14383 ↗First posted 18 Oct 2024cs.ROcited by 5

On the map: LLM agents and tool use → Reinforcement learning for LLM agents

Abstract (arXiv)

Multi-agent reinforcement learning is a key method for training multi-robot systems. Through rewarding or punishing robots over a series of episodes according to their performance, they can be trained and then deployed in the real world. However, poorly trained policies can lead to unsafe behaviour during early training stages. We introduce Multi-Agent Reinforcement Learning guided by language-based Inter-robot Negotiation (MARLIN), a hybrid framework in which large language models provide high-level planning before the reinforcement learning policy has learned effective behaviours. Robots use language models to negotiate actions and generate plans that guide policy learning. The system dynamically switches between reinforcement learning and language-model-based negotiation during training, enabling safer and more effective exploration. MARLIN is evaluated using both simulated and physical robots with local and remote language models. Results show that, compared to standard multi-agent reinforcement learning, the hybrid approach achieves higher performance in early training without reducing final performance. The code is available at https://github.com/SooratiLab/MARLIN.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Reinforcement learning for LLM agents, one of 16 directions in LLM agents and tool use. Builds on 34 of its 56 references that are in the map. First posted on arXiv 18 Oct 2024.

Builds on

34 of 56 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024Safe Multi-agent Reinforcement Learning with Natural Language Constraints30 May
  2. 2024Knowing What Not to Do: Leverage Language Model Insights for Action Space Pruning in Multi-agent Reinforcement Learning27 May
  3. 2024LLM-based Multi-Agent Reinforcement Learning: Current and Future Directions17 May

Other references · 31

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2017Proximal Policy Optimization Algorithmscited by 15,215
  4. 2024The Llama 3 Herd of Modelscited by 14,715
  5. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  6. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  7. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  8. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  9. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
  10. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
  11. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
  12. 2021The Surprising Effectiveness of PPO in Cooperative, Multi-Agent Gamescited by 942
19 more
  1. 2022LM-Nav: Robotic Navigation with Large Pre-Trained Models of Language, Vision, and Actioncited by 439
  2. 2023RoCo: Dialectic Multi-Robot Collaboration with Large Language Modelscited by 172
  3. 2023Scalable Multi-Robot Collaboration with Large Language Models: Centralized or Decentralized Systems?cited by 106
  4. 2023Can an Embodied Agent Find Your "Cat-shaped Mug"? LLM-Guided Exploration for Zero-Shot Object Navigationcited by 74
  5. 2024Towards Efficient LLM Grounding for Embodied Multi-Agent Collaborationcited by 45
  6. 2024Large Language Model Inference Acceleration: A Comprehensive Hardware Perspectivecited by 38
  7. 2023Heterogeneous Multi-Robot Reinforcement Learningcited by 36
  8. 2018Multi-Agent Common Knowledge Reinforcement Learningcited by 31
  9. 2023Is Centralized Training with Decentralized Execution Framework Centralized Enough for MARL?cited by 18
  10. 2023Language and Sketching: An LLM-driven Interactive Multimodal Multitask Robot Navigation Frameworkcited by 16
  11. 2022Real-Time Reinforcement Learning for Vision-Based Robotics Utilizing Local and Remote Computerscited by 13
  12. 2024Wonderful Team: Zero-Shot Physical Task Planning with Visual LLMscited by 11
  13. 2024A Survey of Language-Based Communication in Roboticscited by 10
  14. 2024Skip n: A Simple Method to Reduce Hallucination in Large Vision-Language Modelscited by 9
  15. 2024Language-Conditioned Offline RL for Multi-Robot Navigationcited by 9
  16. 2024MAexp: A Generic Platform for RL-based Multi-Agent Explorationcited by 7
  17. 2023COMPOSER: Scalable and Robust Modular Policies for Snake Robotscited by 5
  18. 2024Conversational Language Models for Human-in-the-Loop Multi-Robot Coordinationcited by 4
  19. 2023Demonstrating Performance Benefits of Human-Swarm Teamingcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 2.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025ICCO: Learning an Instruction-conditioned Coordinator for Language-guided Task-aligned Multi-robot Control
  2. 2025LAMARL: LLM-Aided Multi-Agent Reinforcement Learning for Cooperative Policy Generation
  3. 2024Generalising Multi-Agent Cooperation through Task-Agnostic Communication
  4. 2025MARFT: Multi-Agent Reinforcement Fine-Tuning
  5. 2025CRAFT: Coaching Reinforcement Learning Autonomously using Foundation Models for Multi-Robot Coordination Tasks
  6. 2023Conditionally Combining Robot Skills using Large Language Models
  7. 2025Automated Hybrid Reward Scheduling via Large Language Models for Robotic Skill Learning
  8. 2026LangMARL: Natural Language Multi-Agent Reinforcement Learning