mlsanityData to 13 Oct 2026

Multi-Agent Reinforcement Learning for Active Voltage Control on Power Distribution Networks

arXiv 2110.14300 ↗First posted 27 Oct 2021cs.LG cs.MAcited by 52

Not on the map. Why?

Abstract (arXiv)

This paper presents a problem in power networks that creates an exciting and yet challenging real-world scenario for application of multi-agent reinforcement learning (MARL). The emerging trend of decarbonisation is placing excessive stress on power distribution networks. Active voltage control is seen as a promising solution to relieve power congestion and improve voltage quality without extra hardware investment, taking advantage of the controllable apparatuses in the network, such as roof-top photovoltaics (PVs) and static var compensators (SVCs). These controllable apparatuses appear in a vast number and are distributed in a wide geographic area, making MARL a natural candidate. This paper formulates the active voltage control problem in the framework of Dec-POMDP and establishes an open-source environment. It aims to bridge the gap between the power community and the MARL community and be a drive force towards real-world applications of MARL algorithms. Finally, we analyse the special characteristics of the active voltage control problems that cause challenges (e.g. interpretability) for state-of-the-art MARL approaches, and summarise the potential directions.

Key facts. Cited by 52 papers in the map (data through 13 Oct 2026). Builds on 19 of its 60 references that are in the map. First posted on arXiv 27 Oct 2021.

Builds on

19 of 60 references.

References · 19

  1. 2016Layer Normalizationcited by 5,624
  2. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,352
  3. 2018Addressing Function Approximation Error in Actor-Critic Methodscited by 2,310
  4. 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 1,940
  5. 2017Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environmentscited by 1,525
  6. 2018Soft Actor-Critic Algorithms and Applicationscited by 1,185
  7. 2021The Surprising Effectiveness of PPO in Cooperative, Multi-Agent Gamescited by 910
  8. 2017Counterfactual Multi-Agent Policy Gradientscited by 739
  9. 2020Is Independent Learning All You Need in the StarCraft Multi-Agent Challenge?cited by 286
  10. 2017pandapower - an Open Source Python Tool for Convenient Modeling, Analysis and Optimization of Electric Power Systemscited by 81
  11. 2019Shapley Q-value: A Local Reward Approach to Solve Global Reward Gamescited by 71
  12. 2019Reducing Overestimation Bias in Multi-Agent Domains Using Double Centralized Criticscited by 46
7 more
  1. 2020Efficient Contextual Bandits with Continuous Actionscited by 24
  2. 2021Gym-ANM: Reinforcement Learning Environments for Active Network Management Tasks in Electricity Distribution Systemscited by 18
  3. 2020Online Multi-agent Reinforcement Learning for Decentralized Inverter-based Volt-VAR Controlcited by 15
  4. 2017Real-Time Local Volt/VAR Control Under External Disturbances with High PV Penetrationcited by 5
  5. 2020Distributed Voltage Regulation of Active Distribution System Based on Enhanced Multi-agent Deep Reinforcement Learningcited by 4
  6. 2021Design and implementation of an environment for Learning to Run a Power Network (L2RPN)cited by 4
  7. 2014A Fully Distributed Reactive Power Optimization and Control Method for Active Distribution Networkscited by 2

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2022: 10; 2023: 14; 2024: 12; 2025: 10; 2026: 6.

52 papers.

Sort:

By area:

  1. 2022Multi-agent Dynamic Algorithm Configurationcited by 36
  2. 2022Towards Comprehensive Testing on the Robustness of Cooperative Multi-agent Reinforcement Learningcited by 21
  3. 2022Contrastive Identity-Aware Learning for Multi-Agent Value Decompositioncited by 19
  4. 2023Is Centralized Training with Decentralized Execution Framework Centralized Enough for MARL?cited by 18
  5. 2025Multi-Agent Reinforcement Learning for Resources Allocation Optimization: A Surveycited by 14
  6. 2023Multi-agent Continual Coordination via Progressive Task Contextualizationcited by 11
  7. 2024RL2: Reinforce Large Language Model to Assist Safe Reinforcement Learning for Energy Management of Active Distribution Networkscited by 9
  8. 2022Interaction Pattern Disentangling for Multi-Agent Reinforcement Learningcited by 8
  9. 2023Off-the-Grid MARL: Datasets with Baselines for Offline Multi-Agent Reinforcement Learningcited by 8
  10. 2022Robust Reinforcement Learning in Continuous Control Tasks with Uncertainty Set Regularizationcited by 7
  11. 2023Communication-Robust Multi-Agent Learning by Adaptable Auxiliary Multi-Agent Adversary Generationcited by 6
  12. 2024Open Ad Hoc Teamwork with Cooperative Game Theorycited by 6
38 more
  1. 2022Stabilizing Voltage in Power Distribution Networks via Multi-Agent Reinforcement Learning with Transformercited by 5
  2. 2022MA2QL: A Minimalist Approach to Fully Decentralized Multi-Agent Reinforcement Learningcited by 5
  3. 2023Centralised rehearsal of decentralised cooperation: Multi-agent reinforcement learning for the scalable coordination of residential energy flexibilitycited by 5
  4. 2024Fully Decentralized Cooperative Multi-Agent Reinforcement Learning: A Surveycited by 5
  5. 2023Best Possible Q-Learningcited by 4
  6. 2025Shapley Machine: A Game-Theoretic Framework for N-Agent Ad Hoc Teamworkcited by 4
  7. 2023Robust Multi-agent Communication via Multi-view Message Certificationcited by 3
  8. 2024Approximate Global Convergence of Independent Learning in Multi-Agent Systemscited by 3
  9. 2024RL-ADN: A High-Performance Deep Reinforcement Learning Environment for Optimal Energy Storage Systems Dispatch in Active Distribution Networkscited by 3
  10. 2025A Principle of Targeted Intervention for Multi-Agent Reinforcement Learningcited by 3
  11. 2022Influence-Augmented Local Simulators: A Scalable Solution for Fast Deep RL in Large Networked Systemscited by 2
  12. 2023Multi-Agent Reinforcement Learning for Fast-Timescale Demand Response of Residential Loadscited by 2
  13. 2023Efficient Communication via Self-supervised Information Aggregation for Online and Offline Multi-agent Reinforcement Learningcited by 2
  14. 2023A Constraint Enforcement Deep Reinforcement Learning Framework for Optimal Energy Storage Systems Dispatchcited by 2
  15. 2023Federated Reinforcement Learning for Electric Vehicles Charging Control on Distribution Networkscited by 2
  16. 2024Multi-Agent Reinforcement Learning for Energy Networks: Computational Challenges, Progress and Open Problemscited by 2
  17. 2024Temporal Prototype-Aware Learning for Active Voltage Control on Power Distribution Networkscited by 2
  18. 2022Ad Hoc Teamwork in the Presence of Adversariescited by 1
  19. 2022Distributed Energy Management and Demand Response in Smart Grids: A Multi-Agent Deep Reinforcement Learning Frameworkcited by 1
  20. 2023Dual Self-Awareness Value Decomposition Framework without Individual Global Max for Cooperative Multi-Agent Reinforcement Learningcited by 1
  21. 2023Networked Multiagent Safe Reinforcement Learning for Low-carbon Demand Management in Distribution Networkcited by 1
  22. 2024Configurable Mirror Descent: Towards a Unification of Decision Makingcited by 1
  23. 2024Decentralized multi-agent reinforcement learning algorithm using a cluster-synchronized laser networkcited by 1
  24. 2025CORD: Generalizable Cooperation via Role Diversitycited by 1
  25. 2025Toward Adaptable Multi-Agent Reinforcement Learning: An Assumption-Aware Reviewcited by 1
  26. 2025Empirical Study on Robustness and Resilience in Cooperative Multi-Agent Reinforcement Learningcited by 1
  27. 2023Promoting Cooperation in Multi-Agent Reinforcement Learning via Mutual Helpcited by 0
  28. 2024Fair Reinforcement Learning Algorithm for PV Active Control in LV Distribution Networkscited by 0
  29. 2024Safe Imitation Learning-based Optimal Energy Storage Systems Dispatch in Distribution Networkscited by 0
  30. 2024Tacit Learning with Adaptive Information Selection for Cooperative Multi-Agent Reinforcement Learningcited by 0
  31. 2025Offline Reinforcement Learning for Microgrid Voltage Regulationcited by 0
  32. 2025Large Language Model as An Operator: An Experience-Driven Solution for Distribution Network Voltage Controlcited by 0
  33. 2025Vulnerable Agent Identification in Large-Scale Multi-Agent Reinforcement Learningcited by 0
  34. 2025DeepForgeSeal: Latent Space-Driven Semi-Fragile Watermarking for Deepfake Detection Using Adversarial Reinforcement Learningcited by 0
  35. 2026Explicit Credit Assignment through Local Rewards and Dependence Graphs in Multi-Agent Reinforcement Learningcited by 0
  36. 2026ACPO: Agent-Chained Policy Optimization for Multi-Agent Reinforcement Learningcited by 0
  37. 2026Decentralized Multi-agent Reinforcement Learning for Resilient Critical Infrastructurescited by 0
  38. 2026Safety Screening for Voltage Control in Active Distribution Grids via Distributionally Robust Conformal Screeningcited by 0

50 most cited of 52 All 52 (JSON)