R-MADDPG for Partially Observable Environments and Limited Communication
Not on the map. Why?
Abstract (arXiv)
There are several real-world tasks that would benefit from applying multiagent reinforcement learning (MARL) algorithms, including the coordination among self-driving cars. The real world has challenging conditions for multiagent learning systems, such as its partial observable and nonstationary nature. Moreover, if agents must share a limited resource (e.g. network bandwidth) they must all learn how to coordinate resource use. This paper introduces a deep recurrent multiagent actor-critic framework (R-MADDPG) for handling multiagent coordination under partial observable set-tings and limited communication. We investigate recurrency effects on performance and communication use of a team of agents. We demonstrate that the resulting framework learns time dependencies for sharing missing observations, handling resource limitations, and developing different communication patterns among agents.
Key facts. Cited by 36 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Feb 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 14; 2022: 7; 2023: 4; 2024: 4; 2025: 3; 2026: 4.
36 papers.
Sort:
By area:
- 2021Deep Multiagent Reinforcement Learning: Challenges and Directionscited by 42
- 2024Multi-Agent Reinforcement Learning for Autonomous Driving: A Surveycited by 30
- 2021Unbiased Asymmetric Reinforcement Learning under Partial Observabilitycited by 24
- 2021Deep Reinforcement Learning Versus Evolution Strategies: A Comparative Surveycited by 23
- 2021Pervasive AI for IoT applications: A Survey on Resource-efficient Distributed Artificial Intelligencecited by 18
- 2022Transferring Multi-Agent Reinforcement Learning Policies for Autonomous Driving using Sim-to-Realcited by 16
- 2021Network-wide traffic signal control optimization using a multi-agent deep reinforcement learningcited by 12
- 2023From Explicit Communication to Tacit Cooperation:A Novel Paradigm for Cooperative MARLcited by 11
- 2023Informed POMDP: Leveraging Additional Information in Model-Based RLcited by 11
- 2022A Deeper Understanding of State-Based Critics in Multi-Agent Reinforcement Learningcited by 9
- 2021SIDE: State Inference for Partially Observable Cooperative Multi-Agent Reinforcement Learningcited by 7
- 2024On Diffusion Models for Multi-Agent Partial Observability: Shared Attractors, Error Bounds, and Composite Flowcited by 5
24 more
- 2026Cochain Perspectives on Temporal-Difference Signals for Learning Beyond Markov Dynamicscited by 5
- 2024Beyond Local Views: Global State Inference with Diffusion Models for Cooperative Multi-Agent Reinforcement Learningcited by 4
- 2021Deep reinforcement learning of event-triggered communication and control for multi-agent cooperative transportcited by 3
- 2021Minimizing Communication while Maximizing Performance in Multi-Agent Reinforcement Learningcited by 3
- 2021Reinforcement Learning for Intelligent Healthcare Systems: A Comprehensive Surveycited by 3
- 2022Centralized Training with Hybrid Execution in Multi-Agent Reinforcement Learningcited by 2
- 2023Non-Stationary Policy Learning for Multi-Timescale Multi-Agent Reinforcement Learningcited by 2
- 2021Hierarchical RNNs-Based Transformers MADDPG for Mixed Cooperative-Competitive Environmentscited by 1
- 2021MACRPO: Multi-Agent Cooperative Recurrent Policy Optimizationcited by 1
- 2021Soft Hierarchical Graph Recurrent Networks for Many-Agent Partially Observable Environmentscited by 1
- 2022A Policy Resonance Approach to Solve the Problem of Responsibility Diffusion in Multiagent Reinforcement Learningcited by 1
- 2022Learning Practical Communication Strategies in Cooperative Multi-Agent Reinforcement Learningcited by 1
- 2024Towards Fault Tolerance in Multi-Agent Reinforcement Learningcited by 1
- 2025Belief States for Cooperative Multi-Agent Reinforcement Learning under Partial Observabilitycited by 1
- 2021Effective Communications: A Joint Learning and Communication Framework for Multi-Agent Reinforcement Learning over Noisy Channelscited by 0
- 2021Local Advantage Networks for Cooperative Multi-Agent Reinforcement Learningcited by 0
- 2022A New Approach to Training Multiple Cooperative Agents for Autonomous Drivingcited by 0
- 2022Multi-robot Social-aware Cooperative Planning in Pedestrian Environments Using Multi-agent Reinforcement Learningcited by 0
- 2023On Multi-Agent Deep Deterministic Policy Gradients and their Explainability for SMARTS Environmentcited by 0
- 2025Learning Multi-Robot Coordination through Locality-Based Factorized Multi-Agent Actor-Critic Algorithmcited by 0
- 2025Structured Cooperative Multi-Agent Reinforcement Learning: a Bayesian Network Perspectivecited by 0
- 2026Wireless Communication Enhanced Value Decomposition for Multi-Agent Reinforcement Learningcited by 0
- 2026Value-Aware Prediction for Robust Multi-Agent Coordination Under Communication Losscited by 0
- 2026Reinformed Dreamer: An Asymmetric World Model Efficiently Trained through Latent Guidancecited by 0
- 2026Reinformed Dreamer: An Asymmetric World Model Efficiently Trained through Latent Guidance28 Jul 2026
- 2026Value-Aware Prediction for Robust Multi-Agent Coordination Under Communication Loss20 Jul 2026
- 2026Wireless Communication Enhanced Value Decomposition for Multi-Agent Reinforcement Learning9 Apr 2026
- 2026Cochain Perspectives on Temporal-Difference Signals for Learning Beyond Markov Dynamics6 Feb 2026
- 2025Structured Cooperative Multi-Agent Reinforcement Learning: a Bayesian Network Perspective11 Oct 2025
- 2025Belief States for Cooperative Multi-Agent Reinforcement Learning under Partial Observability11 Apr 2025
- 2025Learning Multi-Robot Coordination through Locality-Based Factorized Multi-Agent Actor-Critic Algorithm24 Mar 2025
- 2024Towards Fault Tolerance in Multi-Agent Reinforcement Learning30 Nov 2024
- 2024On Diffusion Models for Multi-Agent Partial Observability: Shared Attractors, Error Bounds, and Composite Flow17 Oct 2024
- 2024Multi-Agent Reinforcement Learning for Autonomous Driving: A Survey19 Aug 2024
- 2024Beyond Local Views: Global State Inference with Diffusion Models for Cooperative Multi-Agent Reinforcement Learning18 Aug 2024
- 2023Non-Stationary Policy Learning for Multi-Timescale Multi-Agent Reinforcement Learning17 Jul 2023
24 more
- 2023Informed POMDP: Leveraging Additional Information in Model-Based RL20 Jun 2023
- 2023From Explicit Communication to Tacit Cooperation:A Novel Paradigm for Cooperative MARL28 Apr 2023
- 2023On Multi-Agent Deep Deterministic Policy Gradients and their Explainability for SMARTS Environment20 Jan 2023
- 2022Multi-robot Social-aware Cooperative Planning in Pedestrian Environments Using Multi-agent Reinforcement Learning29 Nov 2022
- 2022Centralized Training with Hybrid Execution in Multi-Agent Reinforcement Learning12 Oct 2022
- 2022A New Approach to Training Multiple Cooperative Agents for Autonomous Driving5 Sep 2022
- 2022Learning Practical Communication Strategies in Cooperative Multi-Agent Reinforcement Learning2 Sep 2022
- 2022A Policy Resonance Approach to Solve the Problem of Responsibility Diffusion in Multiagent Reinforcement Learning16 Aug 2022
- 2022Transferring Multi-Agent Reinforcement Learning Policies for Autonomous Driving using Sim-to-Real22 Mar 2022
- 2022A Deeper Understanding of State-Based Critics in Multi-Agent Reinforcement Learning3 Jan 2022
- 2021Local Advantage Networks for Cooperative Multi-Agent Reinforcement Learning23 Dec 2021
- 2021Deep Reinforcement Learning Versus Evolution Strategies: A Comparative Survey28 Sep 2021
- 2021Soft Hierarchical Graph Recurrent Networks for Many-Agent Partially Observable Environments5 Sep 2021
- 2021MACRPO: Multi-Agent Cooperative Recurrent Policy Optimization2 Sep 2021
- 2021Reinforcement Learning for Intelligent Healthcare Systems: A Comprehensive Survey5 Aug 2021
- 2021Deep Multiagent Reinforcement Learning: Challenges and Directions29 Jun 2021
- 2021Minimizing Communication while Maximizing Performance in Multi-Agent Reinforcement Learning15 Jun 2021
- 2021Unbiased Asymmetric Reinforcement Learning under Partial Observability25 May 2021
- 2021SIDE: State Inference for Partially Observable Cooperative Multi-Agent Reinforcement Learning13 May 2021
- 2021Hierarchical RNNs-Based Transformers MADDPG for Mixed Cooperative-Competitive Environments11 May 2021
- 2021Pervasive AI for IoT applications: A Survey on Resource-efficient Distributed Artificial Intelligence4 May 2021
- 2021Network-wide traffic signal control optimization using a multi-agent deep reinforcement learning20 Apr 2021
- 2021Deep reinforcement learning of event-triggered communication and control for multi-agent cooperative transport29 Mar 2021
- 2021Effective Communications: A Joint Learning and Communication Framework for Multi-Agent Reinforcement Learning over Noisy Channels2 Jan 2021
- 2021Deep Multiagent Reinforcement Learning: Challenges and Directionscited by 42
- 2021Unbiased Asymmetric Reinforcement Learning under Partial Observabilitycited by 24
- 2021Deep Reinforcement Learning Versus Evolution Strategies: A Comparative Surveycited by 23
- 2021Pervasive AI for IoT applications: A Survey on Resource-efficient Distributed Artificial Intelligencecited by 18
- 2021Network-wide traffic signal control optimization using a multi-agent deep reinforcement learningcited by 12
- 2023From Explicit Communication to Tacit Cooperation:A Novel Paradigm for Cooperative MARLcited by 11
- 2022A Deeper Understanding of State-Based Critics in Multi-Agent Reinforcement Learningcited by 9
- 2021SIDE: State Inference for Partially Observable Cooperative Multi-Agent Reinforcement Learningcited by 7
- 2026Cochain Perspectives on Temporal-Difference Signals for Learning Beyond Markov Dynamicscited by 5
- 2021Deep reinforcement learning of event-triggered communication and control for multi-agent cooperative transportcited by 3
- 2021Minimizing Communication while Maximizing Performance in Multi-Agent Reinforcement Learningcited by 3
- 2021Reinforcement Learning for Intelligent Healthcare Systems: A Comprehensive Surveycited by 3
12 most cited of 30 All 30 (JSON)
- 2026Value-Aware Prediction for Robust Multi-Agent Coordination Under Communication Loss20 Jul 2026
- 2026Wireless Communication Enhanced Value Decomposition for Multi-Agent Reinforcement Learning9 Apr 2026
- 2026Cochain Perspectives on Temporal-Difference Signals for Learning Beyond Markov Dynamics6 Feb 2026
- 2025Structured Cooperative Multi-Agent Reinforcement Learning: a Bayesian Network Perspective11 Oct 2025
- 2025Belief States for Cooperative Multi-Agent Reinforcement Learning under Partial Observability11 Apr 2025
- 2025Learning Multi-Robot Coordination through Locality-Based Factorized Multi-Agent Actor-Critic Algorithm24 Mar 2025
- 2024Towards Fault Tolerance in Multi-Agent Reinforcement Learning30 Nov 2024
- 2023Non-Stationary Policy Learning for Multi-Timescale Multi-Agent Reinforcement Learning17 Jul 2023
- 2023From Explicit Communication to Tacit Cooperation:A Novel Paradigm for Cooperative MARL28 Apr 2023
- 2023On Multi-Agent Deep Deterministic Policy Gradients and their Explainability for SMARTS Environment20 Jan 2023
- 2022Multi-robot Social-aware Cooperative Planning in Pedestrian Environments Using Multi-agent Reinforcement Learning29 Nov 2022
- 2022Centralized Training with Hybrid Execution in Multi-Agent Reinforcement Learning12 Oct 2022
12 newest of 30 All 30 (JSON)