mlsanityData to 14 Oct 2026

Learning Topology Actions for Power Grid Control: A Graph-Based Soft-Label Imitation Learning Approach

arXiv 2503.15190 ↗First posted 19 Mar 2025cs.LGcited by 2

On the map: Offline RL and imitation learning from data → Decision transformers and sequence modeling

Abstract (arXiv)

The rising proportion of renewable energy in the electricity mix introduces significant operational challenges for power grid operators. Effective power grid management demands adaptive decision-making strategies capable of handling dynamic conditions. With the increase in complexity, more and more Deep Learning (DL) approaches have been proposed to find suitable grid topologies for congestion management. In this work, we contribute to this research by introducing a novel Imitation Learning (IL) approach that leverages soft labels derived from simulated topological action outcomes, thereby capturing multiple viable actions per state. Unlike traditional IL methods that rely on hard labels to enforce a single optimal action, our method constructs soft labels that capture the effectiveness of actions that prove suitable in resolving grid congestion. To further enhance decision-making, we integrate Graph Neural Networks (GNNs) to encode the structural properties of power grids, ensuring that the topology-aware representations contribute to better agent performance. Our approach significantly outperforms its hard-label counterparts as well as state-of-the-art Deep Reinforcement Learning (DRL) baseline agents. Most notably, it achieves a 17% better performance compared to the greedy expert agent from which the imitation targets were derived.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Decision transformers and sequence modeling, one of 13 directions in Offline RL and imitation learning from data. Builds on 18 of its 32 references that are in the map. First posted on arXiv 19 Mar 2025.

Builds on

18 of 32 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024Imitation Learning for Intra-Day Power Grid Operation through Topology Actions29 Jul

Other references · 17

  1. 2017Graph Attention Networkscited by 8,923
  2. 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,501
  3. 2023Tree-Structured Parzen Estimator: Understanding Its Algorithm Components and Their Roles for Better Empirical Performancecited by 147
  4. 2019Imitation Learning from Imperfect Demonstrationcited by 114
  5. 2019Learning to run a power network challenge for training topology controllerscited by 34
  6. 2021Action Set Based Policy Optimization for Safe Power Grid Managementcited by 21
  7. 2022Power Grid Congestion Management via Topology Optimization with AlphaZerocited by 20
  8. 2022PowRL: A Reinforcement Learning Framework for Robust Management of Power Networkscited by 18
  9. 2021Learning to run a power network with trustcited by 17
  10. 2023Managing power grids through topology actions: A comparative study between advanced rule-based and reinforcement learning agentscited by 16
  11. 2023Hierarchical Reinforcement Learning for Power Network Topology Controlcited by 11
  12. 2024HUGO -- Highlighting Unseen Grid Options: Combining Deep Reinforcement Learning with a Heuristic Target Topology Approachcited by 10
5 more
  1. 2022Reinforcement learning for Energies of the future and carbon neutrality: a Challenge Designcited by 8
  2. 2024Graph Reinforcement Learning for Power Grids: A Comprehensive Surveycited by 7
  3. 2025Centrally Coordinated Multi-Agent Reinforcement Learning for Power Grid Topology Controlcited by 5
  4. 2024Fault Detection for agents on power grid topology optimization: A Comprehensive analysiscited by 2
  5. 2025Graph Neural Networks for Transmission Grid Topology Control: Busbar Information Asymmetry and Heterogeneous Representationscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Graph-Enhanced Model-Free Reinforcement Learning Agents for Efficient Power Grid Topological Control
  2. 2025Power Grid Control with Graph-Based Distributed Reinforcement Learning
  3. 2026Interpretable Policy Distillation for Power Grid Topology Control
  4. 2026A Comparative Study of Graph Representations for GNN-Based Power Grid Control in L2RPN
  5. 2026Learning to Run Power Networks: Effective AlphaZero-inspired Topological Control
  6. 2020Rethink AI-based Power Grid Control: Diving Into Algorithm Design
  7. 2025Optimizing Power Grid Topologies with Reinforcement Learning: A Survey of Methods and Challenges
  8. 2024State and Action Factorization in Power Grids