Power Grid Congestion Management via Topology Optimization with AlphaZero
Not on the map. Why?
Abstract (arXiv)
The energy sector is facing rapid changes in the transition towards clean renewable sources. However, the growing share of volatile, fluctuating renewable generation such as wind or solar energy has already led to an increase in power grid congestion and network security concerns. Grid operators mitigate these by modifying either generation or demand (redispatching, curtailment, flexible loads). Unfortunately, redispatching of fossil generators leads to excessive grid operation costs and higher emissions, which is in direct opposition to the decarbonization of the energy sector. In this paper, we propose an AlphaZero-based grid topology optimization agent as a non-costly, carbon-free congestion management alternative. Our experimental evaluation confirms the potential of topology optimization for power grid operation, achieves a reduction of the average amount of required redispatching by 60%, and shows the interoperability with traditional congestion management methods. Our approach also ranked 1st in the WCCI 2022 Learning to Run a Power Network (L2RPN) competition. Based on our findings, we identify and discuss open research problems as well as technical challenges for a productive system on a real power grid.
Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 11 of its 30 references that are in the map. First posted on arXiv 10 Nov 2022.
Builds on
11 of 30 references.
References · 11
- 2019Mastering Atari, Go, Chess and Shogi by Planning with a Learned Modelcited by 1,327
- 2017Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithmcited by 723
- 2017In-Datacenter Performance Analysis of a Tensor Processing Unitcited by 610
- 2021Learning to run a Power Network Challenge: a Retrospective Analysiscited by 52
- 2019Learning to run a power network challenge for training topology controllerscited by 33
- 2020Reinforcement Learning for Electricity Network Operationcited by 20
- 2021Action Set Based Policy Optimization for Safe Power Grid Managementcited by 18
- 2021Learning to run a power network with trustcited by 17
- 2020Exploring grid topology reconfiguration using a simple deep reinforcement learning approachcited by 15
- 2020Towards an AI assistant for power grid operatorscited by 6
- 2020Substation-Level Grid Topology Optimization Using Bus Splittingcited by 2
Built on by
Citing papers per year: 2023: 5; 2024: 5; 2025: 7; 2026: 3.
20 papers.
Sort:
By area:
- 2023Managing power grids through topology actions: A comparative study between advanced rule-based and reinforcement learning agentscited by 15
- 2023Hierarchical Reinforcement Learning for Power Network Topology Controlcited by 11
- 2024HUGO -- Highlighting Unseen Grid Options: Combining Deep Reinforcement Learning with a Heuristic Target Topology Approachcited by 10
- 2025Centrally Coordinated Multi-Agent Reinforcement Learning for Power Grid Topology Controlcited by 5
- 2025Think Twice, Act Once: A Co-Evolution Framework of LLM and RL for Large-Scale Decision Makingcited by 5
- 2024Blackout Mitigation via Physics-guided RLcited by 3
- 2024State and Action Factorization in Power Gridscited by 3
- 2024Fault Detection for agents on power grid topology optimization: A Comprehensive analysiscited by 2
- 2025Learning Topology Actions for Power Grid Control: A Graph-Based Soft-Label Imitation Learning Approachcited by 2
- 2025Graph-Enhanced Model-Free Reinforcement Learning Agents for Efficient Power Grid Topological Controlcited by 2
- 2023Reinforcement Learning Based Power Grid Day-Ahead Planning and AI-Assisted Controlcited by 1
- 2023Active Third-Person Imitation Learningcited by 1
8 more
- 2025Multi-Objective Reinforcement Learning for Power Grid Topology Controlcited by 1
- 2026Learning to Run Power Networks: Effective AlphaZero-inspired Topological Controlcited by 1
- 2023Multi-Agent Reinforcement Learning for Power Grid Topology Optimizationcited by 0
- 2024Opportunities of Reinforcement Learning in South Africa's Just Transitioncited by 0
- 2025Power Grid Control with Graph-Based Distributed Reinforcement Learningcited by 0
- 2025Transferable Graph Learning for Transmission Congestion Management via Busbar Splittingcited by 0
- 2026Physics Informed Reinforcement Learning with Gibbs Priors for Topology Control in Power Gridscited by 0
- 2026A Comparative Study of Graph Representations for GNN-Based Power Grid Control in L2RPNcited by 0
- 2026A Comparative Study of Graph Representations for GNN-Based Power Grid Control in L2RPN2 Sep 2026
- 2026Learning to Run Power Networks: Effective AlphaZero-inspired Topological Control14 Aug 2026
- 2026Physics Informed Reinforcement Learning with Gibbs Priors for Topology Control in Power Grids2 Apr 2026
- 2025Transferable Graph Learning for Transmission Congestion Management via Busbar Splitting23 Oct 2025
- 2025Power Grid Control with Graph-Based Distributed Reinforcement Learning2 Sep 2025
- 2025Think Twice, Act Once: A Co-Evolution Framework of LLM and RL for Large-Scale Decision Making3 Jun 2025
- 2025Graph-Enhanced Model-Free Reinforcement Learning Agents for Efficient Power Grid Topological Control26 Mar 2025
- 2025Learning Topology Actions for Power Grid Control: A Graph-Based Soft-Label Imitation Learning Approach19 Mar 2025
- 2025Centrally Coordinated Multi-Agent Reinforcement Learning for Power Grid Topology Control12 Feb 2025
- 2025Multi-Objective Reinforcement Learning for Power Grid Topology Control27 Jan 2025
- 2024Opportunities of Reinforcement Learning in South Africa's Just Transition6 Nov 2024
- 2024State and Action Factorization in Power Grids3 Sep 2024
8 more
- 2024Fault Detection for agents on power grid topology optimization: A Comprehensive analysis24 Jun 2024
- 2024HUGO -- Highlighting Unseen Grid Options: Combining Deep Reinforcement Learning with a Heuristic Target Topology Approach1 May 2024
- 2024Blackout Mitigation via Physics-guided RL17 Jan 2024
- 2023Active Third-Person Imitation Learning27 Dec 2023
- 2023Hierarchical Reinforcement Learning for Power Network Topology Control3 Nov 2023
- 2023Multi-Agent Reinforcement Learning for Power Grid Topology Optimization4 Oct 2023
- 2023Managing power grids through topology actions: A comparative study between advanced rule-based and reinforcement learning agents3 Apr 2023
- 2023Reinforcement Learning Based Power Grid Day-Ahead Planning and AI-Assisted Control15 Feb 2023
- 2023Managing power grids through topology actions: A comparative study between advanced rule-based and reinforcement learning agentscited by 15
- 2023Hierarchical Reinforcement Learning for Power Network Topology Controlcited by 11
- 2024HUGO -- Highlighting Unseen Grid Options: Combining Deep Reinforcement Learning with a Heuristic Target Topology Approachcited by 10
- 2025Centrally Coordinated Multi-Agent Reinforcement Learning for Power Grid Topology Controlcited by 5
- 2024Blackout Mitigation via Physics-guided RLcited by 3
- 2024State and Action Factorization in Power Gridscited by 3
- 2024Fault Detection for agents on power grid topology optimization: A Comprehensive analysiscited by 2
- 2025Graph-Enhanced Model-Free Reinforcement Learning Agents for Efficient Power Grid Topological Controlcited by 2
- 2023Reinforcement Learning Based Power Grid Day-Ahead Planning and AI-Assisted Controlcited by 1
- 2025Multi-Objective Reinforcement Learning for Power Grid Topology Controlcited by 1
- 2026Learning to Run Power Networks: Effective AlphaZero-inspired Topological Controlcited by 1
- 2023Multi-Agent Reinforcement Learning for Power Grid Topology Optimizationcited by 0
12 most cited of 17 All 17 (JSON)
- 2026A Comparative Study of Graph Representations for GNN-Based Power Grid Control in L2RPN2 Sep 2026
- 2026Learning to Run Power Networks: Effective AlphaZero-inspired Topological Control14 Aug 2026
- 2026Physics Informed Reinforcement Learning with Gibbs Priors for Topology Control in Power Grids2 Apr 2026
- 2025Transferable Graph Learning for Transmission Congestion Management via Busbar Splitting23 Oct 2025
- 2025Power Grid Control with Graph-Based Distributed Reinforcement Learning2 Sep 2025
- 2025Graph-Enhanced Model-Free Reinforcement Learning Agents for Efficient Power Grid Topological Control26 Mar 2025
- 2025Centrally Coordinated Multi-Agent Reinforcement Learning for Power Grid Topology Control12 Feb 2025
- 2025Multi-Objective Reinforcement Learning for Power Grid Topology Control27 Jan 2025
- 2024Opportunities of Reinforcement Learning in South Africa's Just Transition6 Nov 2024
- 2024State and Action Factorization in Power Grids3 Sep 2024
- 2024Fault Detection for agents on power grid topology optimization: A Comprehensive analysis24 Jun 2024
- 2024HUGO -- Highlighting Unseen Grid Options: Combining Deep Reinforcement Learning with a Heuristic Target Topology Approach1 May 2024
12 newest of 17 All 17 (JSON)