Exploring grid topology reconfiguration using a simple deep reinforcement learning approach
Not on the map. Why?
Abstract (arXiv)
System operators are faced with increasingly volatile operating conditions. In order to manage system reliability in a cost-effective manner, control room operators are turning to computerised decision support tools based on AI and machine learning. Specifically, Reinforcement Learning (RL) is a promising technique to train agents that suggest grid control actions to operators. In this paper, a simple baseline approach is presented using RL to represent an artificial control room operator that can operate a IEEE 14-bus test case for a duration of 1 week. This agent takes topological switching actions to control power flows on the grid, and is trained on only a single well-chosen scenario. The behaviour of this agent is tested on different time-series of generation and demand, demonstrating its ability to operate the grid successfully in 965 out of 1000 scenarios. The type and variability of topologies suggested by the agent are analysed across the test scenarios, demonstrating efficient and diverse agent behaviour.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). First posted on arXiv 26 Nov 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 2; 2022: 2; 2023: 3; 2024: 3; 2025: 2; 2026: 3.
15 papers.
Sort:
By area:
- 2021Learning to run a Power Network Challenge: a Retrospective Analysiscited by 52
- 2022Power Grid Congestion Management via Topology Optimization with AlphaZerocited by 20
- 2023Managing power grids through topology actions: A comparative study between advanced rule-based and reinforcement learning agentscited by 15
- 2023Hierarchical Reinforcement Learning for Power Network Topology Controlcited by 11
- 2024HUGO -- Highlighting Unseen Grid Options: Combining Deep Reinforcement Learning with a Heuristic Target Topology Approachcited by 10
- 2021Curriculum Based Reinforcement Learning of Grid Topology Controllers to Prevent Thermal Cascadingcited by 8
- 2024Imitation Learning for Intra-Day Power Grid Operation through Topology Actionscited by 3
- 2024Fault Detection for agents on power grid topology optimization: A Comprehensive analysiscited by 2
- 2025Graph Neural Networks for Transmission Grid Topology Control: Busbar Information Asymmetry and Heterogeneous Representationscited by 2
- 2022Grid-SiPhyR: An end-to-end learning to optimize framework for combinatorial problems in power systemscited by 1
- 2025Multi-Objective Reinforcement Learning for Power Grid Topology Controlcited by 1
- 2026Learning to Run Power Networks: Effective AlphaZero-inspired Topological Controlcited by 1
- 2026A Comparative Study of Graph Representations for GNN-Based Power Grid Control in L2RPN2 Sep 2026
- 2026Learning to Run Power Networks: Effective AlphaZero-inspired Topological Control14 Aug 2026
- 2026Physics Informed Reinforcement Learning with Gibbs Priors for Topology Control in Power Grids2 Apr 2026
- 2025Multi-Objective Reinforcement Learning for Power Grid Topology Control27 Jan 2025
- 2025Graph Neural Networks for Transmission Grid Topology Control: Busbar Information Asymmetry and Heterogeneous Representations13 Jan 2025
- 2024Imitation Learning for Intra-Day Power Grid Operation through Topology Actions29 Jul 2024
- 2024Fault Detection for agents on power grid topology optimization: A Comprehensive analysis24 Jun 2024
- 2024HUGO -- Highlighting Unseen Grid Options: Combining Deep Reinforcement Learning with a Heuristic Target Topology Approach1 May 2024
- 2023Hierarchical Reinforcement Learning for Power Network Topology Control3 Nov 2023
- 2023Multi-Agent Reinforcement Learning for Power Grid Topology Optimization4 Oct 2023
- 2023Managing power grids through topology actions: A comparative study between advanced rule-based and reinforcement learning agents3 Apr 2023
- 2022Power Grid Congestion Management via Topology Optimization with AlphaZero10 Nov 2022
3 more
- 2022Grid-SiPhyR: An end-to-end learning to optimize framework for combinatorial problems in power systems11 Jun 2022
- 2021Curriculum Based Reinforcement Learning of Grid Topology Controllers to Prevent Thermal Cascading18 Dec 2021
- 2021Learning to run a Power Network Challenge: a Retrospective Analysis2 Mar 2021
- 2021Learning to run a Power Network Challenge: a Retrospective Analysiscited by 52
- 2022Power Grid Congestion Management via Topology Optimization with AlphaZerocited by 20
- 2023Managing power grids through topology actions: A comparative study between advanced rule-based and reinforcement learning agentscited by 15
- 2023Hierarchical Reinforcement Learning for Power Network Topology Controlcited by 11
- 2024HUGO -- Highlighting Unseen Grid Options: Combining Deep Reinforcement Learning with a Heuristic Target Topology Approachcited by 10
- 2021Curriculum Based Reinforcement Learning of Grid Topology Controllers to Prevent Thermal Cascadingcited by 8
- 2024Fault Detection for agents on power grid topology optimization: A Comprehensive analysiscited by 2
- 2025Graph Neural Networks for Transmission Grid Topology Control: Busbar Information Asymmetry and Heterogeneous Representationscited by 2
- 2022Grid-SiPhyR: An end-to-end learning to optimize framework for combinatorial problems in power systemscited by 1
- 2025Multi-Objective Reinforcement Learning for Power Grid Topology Controlcited by 1
- 2026Learning to Run Power Networks: Effective AlphaZero-inspired Topological Controlcited by 1
- 2023Multi-Agent Reinforcement Learning for Power Grid Topology Optimizationcited by 0
12 most cited of 14 All 14 (JSON)
- 2026A Comparative Study of Graph Representations for GNN-Based Power Grid Control in L2RPN2 Sep 2026
- 2026Learning to Run Power Networks: Effective AlphaZero-inspired Topological Control14 Aug 2026
- 2026Physics Informed Reinforcement Learning with Gibbs Priors for Topology Control in Power Grids2 Apr 2026
- 2025Multi-Objective Reinforcement Learning for Power Grid Topology Control27 Jan 2025
- 2025Graph Neural Networks for Transmission Grid Topology Control: Busbar Information Asymmetry and Heterogeneous Representations13 Jan 2025
- 2024Fault Detection for agents on power grid topology optimization: A Comprehensive analysis24 Jun 2024
- 2024HUGO -- Highlighting Unseen Grid Options: Combining Deep Reinforcement Learning with a Heuristic Target Topology Approach1 May 2024
- 2023Hierarchical Reinforcement Learning for Power Network Topology Control3 Nov 2023
- 2023Multi-Agent Reinforcement Learning for Power Grid Topology Optimization4 Oct 2023
- 2023Managing power grids through topology actions: A comparative study between advanced rule-based and reinforcement learning agents3 Apr 2023
- 2022Power Grid Congestion Management via Topology Optimization with AlphaZero10 Nov 2022
- 2022Grid-SiPhyR: An end-to-end learning to optimize framework for combinatorial problems in power systems11 Jun 2022
12 newest of 14 All 14 (JSON)