A Communication-Efficient Multi-Agent Actor-Critic Algorithm for Distributed Reinforcement Learning
Not on the map. Why?
Abstract (arXiv)
This paper considers a distributed reinforcement learning problem in which a network of multiple agents aim to cooperatively maximize the globally averaged return through communication with only local neighbors. A randomized communication-efficient multi-agent actor-critic algorithm is proposed for possibly unidirectional communication relationships depicted by a directed graph. It is shown that the algorithm can solve the problem for strongly connected graphs by allowing each agent to transmit only two scalar-valued variables at one time.
Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Jul 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 4; 2023: 1; 2024: 1; 2025: 1.
16 papers.
Sort:
- 2021Distributed Learning in Wireless Networks: Recent Progress and Future Challengescited by 125
- 2021Sample and Communication-Efficient Decentralized Actor-Critic Algorithms with Finite-Time Analysiscited by 25
- 2021Pervasive AI for IoT applications: A Survey on Resource-efficient Distributed Artificial Intelligencecited by 18
- 2021Adversarial attacks in consensus-based multi-agent reinforcement learningcited by 17
- 2021MDPGT: Momentum-based Decentralized Policy Gradient Trackingcited by 6
- 2024Sample and Communication Efficient Fully Decentralized MARL Policy Evaluation via a New Approach: Local TD updatecited by 3
- 2022One Policy is Enough: Parallel Exploration with a Single Policy is Near-Optimal for Reward-Free Reinforcement Learningcited by 2
- 2021DeCOM: Decomposed Policy for Constrained Cooperative Multi-Agent Reinforcement Learningcited by 1
- 2021Resilient Consensus-based Multi-agent Reinforcement Learning with Function Approximationcited by 1
- 2022Finite-Time Analysis of Fully Decentralized Single-Timescale Actor-Criticcited by 1
- 2025A Communication-Efficient Decentralized Actor-Critic Algorithmcited by 1
- 2021Event-Based Communication in Distributed Q-Learningcited by 0
4 more
- 2021Finite-Time Error Bounds for Distributed Linear Stochastic Approximationcited by 0
- 2022Robust Event-Driven Interactions in Cooperative Multi-Agent Learningcited by 0
- 2022Cooperative Actor-Critic via TD Error Aggregationcited by 0
- 2023Networked Communication for Decentralised Agents in Mean-Field Gamescited by 0
- 2025A Communication-Efficient Decentralized Actor-Critic Algorithm22 Oct 2025
- 2024Sample and Communication Efficient Fully Decentralized MARL Policy Evaluation via a New Approach: Local TD update23 Mar 2024
- 2023Networked Communication for Decentralised Agents in Mean-Field Games5 Jun 2023
- 2022Cooperative Actor-Critic via TD Error Aggregation25 Jul 2022
- 2022Finite-Time Analysis of Fully Decentralized Single-Timescale Actor-Critic12 Jun 2022
- 2022One Policy is Enough: Parallel Exploration with a Single Policy is Near-Optimal for Reward-Free Reinforcement Learning31 May 2022
- 2022Robust Event-Driven Interactions in Cooperative Multi-Agent Learning7 Apr 2022
- 2021MDPGT: Momentum-based Decentralized Policy Gradient Tracking6 Dec 2021
- 2021Finite-Time Error Bounds for Distributed Linear Stochastic Approximation24 Nov 2021
- 2021Resilient Consensus-based Multi-agent Reinforcement Learning with Function Approximation12 Nov 2021
- 2021DeCOM: Decomposed Policy for Constrained Cooperative Multi-Agent Reinforcement Learning10 Nov 2021
- 2021Sample and Communication-Efficient Decentralized Actor-Critic Algorithms with Finite-Time Analysis8 Sep 2021
4 more
- 2021Event-Based Communication in Distributed Q-Learning3 Sep 2021
- 2021Pervasive AI for IoT applications: A Survey on Resource-efficient Distributed Artificial Intelligence4 May 2021
- 2021Distributed Learning in Wireless Networks: Recent Progress and Future Challenges5 Apr 2021
- 2021Adversarial attacks in consensus-based multi-agent reinforcement learning11 Mar 2021
- 2021Distributed Learning in Wireless Networks: Recent Progress and Future Challengescited by 125
- 2021Sample and Communication-Efficient Decentralized Actor-Critic Algorithms with Finite-Time Analysiscited by 25
- 2021Pervasive AI for IoT applications: A Survey on Resource-efficient Distributed Artificial Intelligencecited by 18
- 2021Adversarial attacks in consensus-based multi-agent reinforcement learningcited by 17
- 2021MDPGT: Momentum-based Decentralized Policy Gradient Trackingcited by 6
- 2024Sample and Communication Efficient Fully Decentralized MARL Policy Evaluation via a New Approach: Local TD updatecited by 3
- 2022One Policy is Enough: Parallel Exploration with a Single Policy is Near-Optimal for Reward-Free Reinforcement Learningcited by 2
- 2021DeCOM: Decomposed Policy for Constrained Cooperative Multi-Agent Reinforcement Learningcited by 1
- 2021Resilient Consensus-based Multi-agent Reinforcement Learning with Function Approximationcited by 1
- 2022Finite-Time Analysis of Fully Decentralized Single-Timescale Actor-Criticcited by 1
- 2025A Communication-Efficient Decentralized Actor-Critic Algorithmcited by 1
- 2021Event-Based Communication in Distributed Q-Learningcited by 0
12 most cited of 16 All 16 (JSON)
- 2025A Communication-Efficient Decentralized Actor-Critic Algorithm22 Oct 2025
- 2024Sample and Communication Efficient Fully Decentralized MARL Policy Evaluation via a New Approach: Local TD update23 Mar 2024
- 2023Networked Communication for Decentralised Agents in Mean-Field Games5 Jun 2023
- 2022Cooperative Actor-Critic via TD Error Aggregation25 Jul 2022
- 2022Finite-Time Analysis of Fully Decentralized Single-Timescale Actor-Critic12 Jun 2022
- 2022One Policy is Enough: Parallel Exploration with a Single Policy is Near-Optimal for Reward-Free Reinforcement Learning31 May 2022
- 2022Robust Event-Driven Interactions in Cooperative Multi-Agent Learning7 Apr 2022
- 2021MDPGT: Momentum-based Decentralized Policy Gradient Tracking6 Dec 2021
- 2021Finite-Time Error Bounds for Distributed Linear Stochastic Approximation24 Nov 2021
- 2021Resilient Consensus-based Multi-agent Reinforcement Learning with Function Approximation12 Nov 2021
- 2021DeCOM: Decomposed Policy for Constrained Cooperative Multi-Agent Reinforcement Learning10 Nov 2021
- 2021Sample and Communication-Efficient Decentralized Actor-Critic Algorithms with Finite-Time Analysis8 Sep 2021
12 newest of 16 All 16 (JSON)