# Multi-agent reinforcement learning

Area: [Deep reinforcement learning methods](https://mlsanity.com/deeprl/index.md). HTML: https://mlsanity.com/deeprl/multi-agent-reinforcement-learning/

## Key facts

- Multi-agent reinforcement learning: 182 papers on arXiv since 2024 (data through 14 Oct 2026).
- 3 of its 182 mapped papers (2%) cite “When is Mean-Field Reinforcement Learning Tractable and Relevant?” (2024, arXiv 2402.05757).
- 3 of its 182 mapped papers (2%) cite “Independent Policy Mirror Descent for Markov Potential Games: Scaling to Large Number of Players” (2024, arXiv 2408.08075).
- 3 new papers 30 Sep–14 Oct.

## Most cited here

- [When is Mean-Field Reinforcement Learning Tractable and Relevant?](https://mlsanity.com/paper/2402.05757/) (2024), cited by 3 papers here
- [Independent Policy Mirror Descent for Markov Potential Games: Scaling to Large Number of Players](https://mlsanity.com/paper/2408.08075/) (2024), cited by 3 papers here
- [Independent Learning in Constrained Markov Potential Games](https://mlsanity.com/paper/2402.17885/) (2024), cited by 2 papers here
- [Provable Policy Gradient Methods for Average-Reward Markov Potential Games](https://mlsanity.com/paper/2403.05738/) (2024), cited by 2 papers here
- [Learning Robot Soccer from Egocentric Vision with Deep Reinforcement Learning](https://mlsanity.com/paper/2405.02425/) (2024), cited by 2 papers here
- [Online Planning for Multi-UAV Pursuit-Evasion in Unknown Environments Using Deep Reinforcement Learning](https://mlsanity.com/paper/2409.15866/) (2024), cited by 2 papers here
- [Independent Learning in Performative Markov Potential Games](https://mlsanity.com/paper/2504.20593/) (2025), cited by 2 papers here
- [Emergent Communication Protocol Learning for Task Offloading in Industrial Internet of Things](https://mlsanity.com/paper/2401.12914/) (2024), cited by 1 papers here
- [Generalization of Heterogeneous Multi-Robot Policies via Awareness and Communication of Capabilities](https://mlsanity.com/paper/2401.13127/) (2024), cited by 1 papers here
- [Near-Optimal Reinforcement Learning with Self-Play under Adaptivity Constraints](https://mlsanity.com/paper/2402.01111/) (2024), cited by 1 papers here

## New (30 Sep–14 Oct)

- [A Reinforcement Learning Framework for Safety-Aware Haptic Shared Control in Surgical Robotics](https://mlsanity.com/paper/2610.15422/) (2026-10-11)
- [Self-Referenced Social Preferences: Cooperation without Observing Others Rewards](https://mlsanity.com/paper/2610.07881/) (2026-10-06)
- [MASkillBlender: Decentralized Whole-Body Coordination for Multi-Humanoid Loco-Manipulation via Skill Blending](https://mlsanity.com/paper/2610.01102/) (2026-10-01)