# Multi-Agent Reinforcement Learning: A Report on Challenges and Approaches

arXiv: https://arxiv.org/abs/1807.09427 · HTML: https://mlsanity.com/paper/1807.09427/

## Key facts

- Cited by 6 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 25 Jul 2018.

## Built on by (most cited first, 6 of 6)

- [Offline Estimation of Controlled Markov Chains: Minimaxity and Sample Complexity](https://mlsanity.com/paper/2211.07092/) (2022)
- [Adaptive Feature Fusion: Enhancing Generalization in Deep Learning Models](https://mlsanity.com/paper/2304.03290/) (2023)
- [Multi-Agent Reinforcement Learning: Methods, Applications, Visionary Prospects, and Challenges](https://mlsanity.com/paper/2305.10091/) (2023)
- [Deep Reinforcement Learning for Decentralized Multi-Robot Control: A DQN Approach to Robustness and Information Integration](https://mlsanity.com/paper/2408.11339/) (2024)
- [State-of-the-art in Robot Learning for Multi-Robot Collaboration: A Comprehensive Survey](https://mlsanity.com/paper/2408.11822/) (2024)
- [Distributed Optimization of Modular Production Systems using Model-based Reinforcement Learning with Inverse Models](https://mlsanity.com/paper/2609.11615/) (2026)

## Abstract (arXiv)

Reinforcement Learning (RL) is a learning paradigm concerned with learning to control a system so as to maximize an objective over the long term. This approach to learning has received immense interest in recent times and success manifests itself in the form of human-level performance on games like textitGo. While RL is emerging as a practical component in real-life systems, most successes have been in Single Agent domains. This report will instead specifically focus on challenges that are unique to Multi-Agent Systems interacting in mixed cooperative and competitive environments. The report concludes with advances in the paradigm of training Multi-Agent Systems called textitDecentralized Actor, Centralized Critic, based on an extension of MDPs called textitDecentralized Partially Observable MDPs, which has seen a renewed interest lately.