Uncertainty-Aware Transient Stability-Constrained Preventive Redispatch: A Distributional Reinforcement Learning Approach
On the map: Deep reinforcement learning methods → RL for energy, networks and operations
Abstract (arXiv)
Transient stability-constrained preventive redispatch plays a crucial role in ensuring power system security and stability. Since redispatch strategies need to simultaneously satisfy complex transient constraints and the economic need, model-based formulation and optimization become extremely challenging. In addition, the increasing uncertainty and variability introduced by renewable sources start to drive the system stability consideration from deterministic to probabilistic, which further exaggerates the complexity. In this paper, a Graph neural network guided Distributional Deep Reinforcement Learning (GD2RL) method is proposed, for the first time, to solve the uncertainty-aware transient stability-constrained preventive redispatch problem. First, a graph neural network-based transient simulator is trained by supervised learning to efficiently generate post-contingency rotor angle curves with the steady-state and contingency as inputs, which serves as a feature extractor for operating states and a surrogate time-domain simulator during the environment interaction for reinforcement learning. Distributional deep reinforcement learning with explicit uncertainty distribution of system operational conditions is then applied to generate the redispatch strategy to balance the user-specified probabilistic stability performance and economy preferences. The full distribution of the post-redispatch transient stability index is directly provided as the output. Case studies on the modified New England 39-bus system validate the proposed method.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in RL for energy, networks and operations, one of 15 directions in Deep reinforcement learning methods. Builds on 6 of its 32 references that are in the map. First posted on arXiv 14 Feb 2024.
Builds on
6 of 32 references.
References · 6
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2017Neural Message Passing for Quantum Chemistrycited by 3,487
- 2018Addressing Function Approximation Error in Actor-Critic Methodscited by 2,417
- 2017A Distributional Perspective on Reinforcement Learningcited by 765
- 2018Distributed Distributional Deterministic Policy Gradientscited by 199
- 2020Sample-based Distributional Policy Gradientcited by 14
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Probabilistic Reachability Analysis of Multi-scale Voltage Dynamics Using Reinforcement Learning ↗
- 2024A Review of Safe Reinforcement Learning Methods for Modern Power Systems
- 2024Make Safe Decisions in Power System: Safe Reinforcement Learning Based Pre-decision Making for Voltage Stability Emergency Control
- 2025Optimizing Power Grid Topologies with Reinforcement Learning: A Survey of Methods and Challenges
- 2024Implementing Deep Reinforcement Learning-Based Grid Voltage Control in Real-World Power Systems: Challenges and Insights
- 2025Fast Searching of Extreme Operating Conditions for Relay Protection Setting Calculation Based on Graph Neural Network and Reinforcement Learning
- 2026Multi-Objective Deep Reinforcement Learning for Secure and Stable Power System Operation
- 2024Graph Reinforcement Learning for Power Grids: A Comprehensive Survey