Optimization for Reinforcement Learning: From Single Agent to Cooperative Agents
Not on the map. Why?
Abstract (arXiv)
This article reviews recent advances in multi-agent reinforcement learning algorithms for large-scale control systems and communication networks, which learn to communicate and cooperate. We provide an overview of this emerging field, with an emphasis on the decentralized setting under different coordination protocols. We highlight the evolution of reinforcement learning algorithms from single-agent to multi-agent systems, from a distributed optimization perspective, and conclude with future directions and challenges, in the hope to catalyze the growing synergy among distributed optimization, signal processing, and reinforcement learning communities.
Key facts. Cited by 20 papers in the map (data through 14 Oct 2026). First posted on arXiv 1 Dec 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 1; 2023: 1; 2024: 3; 2025: 3; 2026: 2.
20 papers.
Sort:
By area:
- 2021Edge Artificial Intelligence for 6G: Vision, Enabling Technologies, and Applicationscited by 97
- 2021Deep Reinforcement Learning Versus Evolution Strategies: A Comparative Surveycited by 28
- 2021Pervasive AI for IoT applications: A Survey on Resource-efficient Distributed Artificial Intelligencecited by 18
- 2025A Survey on Agent Workflow -- Status and Futurecited by 14
- 2021Learning to Coordinate in Multi-Agent Systems: A Coordinated Actor-Critic Algorithm and Finite-Time Guaranteescited by 6
- 2021MARL with General Utilities via Decentralized Shadow Reward Actor-Criticcited by 5
- 2021Kolmogorov-Smirnov Test-Based Actively-Adaptive Thompson Sampling for Non-Stationary Banditscited by 4
- 2021Towards Learning Generalizable Driving Policies from Restricted Latent Representationscited by 4
- 2021Reinforcement Learning for Intelligent Healthcare Systems: A Comprehensive Surveycited by 3
- 2025Multilinear Tensor Low-Rank Approximation for Policy-Gradient Methods in Reinforcement Learningcited by 3
- 2024Matrix Low-Rank Approximation For Policy Gradient Methodscited by 2
- 2024FlowRL: Flow-Augmented Few-Shot Reinforcement Learning for Semi-Structured Sensor Datacited by 2
8 more
- 2024Reinforcement Learning for Bidding Strategy Optimization in Day-Ahead Energy Marketcited by 2
- 2021Convergence Rates of Average-Reward Multi-agent Reinforcement Learning via Randomized Linear Programmingcited by 1
- 2021Distributed Policy Gradient with Variance Reduction in Multi-Agent Reinforcement Learningcited by 1
- 2025Feature-Aware Task-to-Core Allocation in Embedded Multi-core Platforms via Statistical Learningcited by 1
- 2022Cooperative Actor-Critic via TD Error Aggregationcited by 0
- 2023Continuous-Time Distributed Dynamic Programming for Networked Multi-Agent Markov Decision Processescited by 0
- 2026Offline Multi-Agent Reinforcement Learning for 6G Communications: Fundamentals, Applications and Future Directionscited by 0
- 2026ZeroDVFS: Zero-Shot LLM-Guided Core and Frequency Allocation for Embedded Platformscited by 0
- 2026ZeroDVFS: Zero-Shot LLM-Guided Core and Frequency Allocation for Embedded Platforms13 Jan 2026
- 2026Offline Multi-Agent Reinforcement Learning for 6G Communications: Fundamentals, Applications and Future Directions1 Jan 2026
- 2025A Survey on Agent Workflow -- Status and Future2 Aug 2025
- 2025Feature-Aware Task-to-Core Allocation in Embedded Multi-core Platforms via Statistical Learning26 Jan 2025
- 2025Multilinear Tensor Low-Rank Approximation for Policy-Gradient Methods in Reinforcement Learning8 Jan 2025
- 2024Reinforcement Learning for Bidding Strategy Optimization in Day-Ahead Energy Market25 Nov 2024
- 2024FlowRL: Flow-Augmented Few-Shot Reinforcement Learning for Semi-Structured Sensor Data21 Sep 2024
- 2024Matrix Low-Rank Approximation For Policy Gradient Methods27 May 2024
- 2023Continuous-Time Distributed Dynamic Programming for Networked Multi-Agent Markov Decision Processes31 Jul 2023
- 2022Cooperative Actor-Critic via TD Error Aggregation25 Jul 2022
- 2021Distributed Policy Gradient with Variance Reduction in Multi-Agent Reinforcement Learning25 Nov 2021
- 2021Edge Artificial Intelligence for 6G: Vision, Enabling Technologies, and Applications24 Nov 2021
8 more
- 2021Towards Learning Generalizable Driving Policies from Restricted Latent Representations5 Nov 2021
- 2021Convergence Rates of Average-Reward Multi-agent Reinforcement Learning via Randomized Linear Programming22 Oct 2021
- 2021Learning to Coordinate in Multi-Agent Systems: A Coordinated Actor-Critic Algorithm and Finite-Time Guarantees11 Oct 2021
- 2021Deep Reinforcement Learning Versus Evolution Strategies: A Comparative Survey28 Sep 2021
- 2021Reinforcement Learning for Intelligent Healthcare Systems: A Comprehensive Survey5 Aug 2021
- 2021Kolmogorov-Smirnov Test-Based Actively-Adaptive Thompson Sampling for Non-Stationary Bandits30 May 2021
- 2021MARL with General Utilities via Decentralized Shadow Reward Actor-Critic29 May 2021
- 2021Pervasive AI for IoT applications: A Survey on Resource-efficient Distributed Artificial Intelligence4 May 2021
- 2025Multilinear Tensor Low-Rank Approximation for Policy-Gradient Methods in Reinforcement Learningcited by 3
- 2024Matrix Low-Rank Approximation For Policy Gradient Methodscited by 2
- 2024FlowRL: Flow-Augmented Few-Shot Reinforcement Learning for Semi-Structured Sensor Datacited by 2
- 2024Reinforcement Learning for Bidding Strategy Optimization in Day-Ahead Energy Marketcited by 2
- 2025Multilinear Tensor Low-Rank Approximation for Policy-Gradient Methods in Reinforcement Learning8 Jan 2025
- 2024Reinforcement Learning for Bidding Strategy Optimization in Day-Ahead Energy Market25 Nov 2024
- 2024FlowRL: Flow-Augmented Few-Shot Reinforcement Learning for Semi-Structured Sensor Data21 Sep 2024
- 2024Matrix Low-Rank Approximation For Policy Gradient Methods27 May 2024
- 2025A Survey on Agent Workflow -- Status and Futurecited by 14
- 2025A Survey on Agent Workflow -- Status and Future2 Aug 2025
- 2021Edge Artificial Intelligence for 6G: Vision, Enabling Technologies, and Applicationscited by 97
- 2021Deep Reinforcement Learning Versus Evolution Strategies: A Comparative Surveycited by 28
- 2021Pervasive AI for IoT applications: A Survey on Resource-efficient Distributed Artificial Intelligencecited by 18
- 2021Learning to Coordinate in Multi-Agent Systems: A Coordinated Actor-Critic Algorithm and Finite-Time Guaranteescited by 6
- 2021MARL with General Utilities via Decentralized Shadow Reward Actor-Criticcited by 5
- 2021Kolmogorov-Smirnov Test-Based Actively-Adaptive Thompson Sampling for Non-Stationary Banditscited by 4
- 2021Reinforcement Learning for Intelligent Healthcare Systems: A Comprehensive Surveycited by 3
- 2021Convergence Rates of Average-Reward Multi-agent Reinforcement Learning via Randomized Linear Programmingcited by 1
- 2021Distributed Policy Gradient with Variance Reduction in Multi-Agent Reinforcement Learningcited by 1
- 2025Feature-Aware Task-to-Core Allocation in Embedded Multi-core Platforms via Statistical Learningcited by 1
- 2022Cooperative Actor-Critic via TD Error Aggregationcited by 0
- 2023Continuous-Time Distributed Dynamic Programming for Networked Multi-Agent Markov Decision Processescited by 0
12 most cited of 13 All 13 (JSON)
- 2026ZeroDVFS: Zero-Shot LLM-Guided Core and Frequency Allocation for Embedded Platforms13 Jan 2026
- 2025Feature-Aware Task-to-Core Allocation in Embedded Multi-core Platforms via Statistical Learning26 Jan 2025
- 2023Continuous-Time Distributed Dynamic Programming for Networked Multi-Agent Markov Decision Processes31 Jul 2023
- 2022Cooperative Actor-Critic via TD Error Aggregation25 Jul 2022
- 2021Distributed Policy Gradient with Variance Reduction in Multi-Agent Reinforcement Learning25 Nov 2021
- 2021Edge Artificial Intelligence for 6G: Vision, Enabling Technologies, and Applications24 Nov 2021
- 2021Convergence Rates of Average-Reward Multi-agent Reinforcement Learning via Randomized Linear Programming22 Oct 2021
- 2021Learning to Coordinate in Multi-Agent Systems: A Coordinated Actor-Critic Algorithm and Finite-Time Guarantees11 Oct 2021
- 2021Deep Reinforcement Learning Versus Evolution Strategies: A Comparative Survey28 Sep 2021
- 2021Reinforcement Learning for Intelligent Healthcare Systems: A Comprehensive Survey5 Aug 2021
- 2021Kolmogorov-Smirnov Test-Based Actively-Adaptive Thompson Sampling for Non-Stationary Bandits30 May 2021
- 2021MARL with General Utilities via Decentralized Shadow Reward Actor-Critic29 May 2021
12 newest of 13 All 13 (JSON)