mlsanityData to 14 Oct 2026

Distributed Reinforcement Learning using Local Smart Meter Data for Voltage Regulation in Distribution Networks

arXiv 2512.12803 ↗First posted 14 Dec 2025eess.SY cs.SYcited by 0

On the map: Deep reinforcement learning methods → RL for energy, networks and operations

Abstract (arXiv)

Centralised reinforcement learning (RL) for voltage magnitude regulation in distribution networks typically involves numerous agent-environment interactions and power flow (PF) calculations, inducing computational overhead and privacy concerns over shared data. Thus, we propose a distributed RL algorithm to regulate voltage magnitude. First, a dynamic Thevenin equivalent model is integrated within smart meters (SM), enabling local voltage magnitude estimation using local SM data for RL agent training, and mitigating the dependency of synchronised data collection and centralised PF calculations. To mitigate estimation errors induced by Thevenin model inaccuracies, a voltage magnitude correction strategy that combines piecewise functions and neural networks is introduced. The piecewise function corrects the large errors of estimated voltage magnitude, while a neural network mimics the grid's sensitivity to control actions, improving action adjustment precision. Second, a coordination strategy is proposed to refine local RL agent actions online, preventing voltage magnitude violations induced by excessive actions from multiple independently trained agents. Case studies on energy storage systems validate the feasibility and effectiveness of the proposed approach, demonstrating its potential to improve voltage regulation in distribution networks.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in RL for energy, networks and operations, one of 15 directions in Deep reinforcement learning methods. Builds on 3 of its 35 references that are in the map. First posted on arXiv 14 Dec 2025.

Builds on

3 of 35 references.

References · 3

  1. 2023Smart Home Energy Management: VAE-GAN synthetic dataset generator and Q-learningcited by 9
  2. 2025Safe Bottom-Up Flexibility Provision from Distributed Energy Resourcescited by 2
  3. 2025Model-Free Privacy Preserving Power Flow Analysis in Distribution Networkscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026A Human-AI Teaming Framework for Deep Reinforcement Learning-Based Voltage Regulation in Distribution Networks
  2. 2024Implementing Deep Reinforcement Learning-Based Grid Voltage Control in Real-World Power Systems: Challenges and Insights
  3. 2026Utilizing Adversarial Training for Robust Voltage Control: An Adaptive Deep Reinforcement Learning Method
  4. 2024CommonPower: A Framework for Safe Data-Driven Smart Grid Control
  5. 2026Two-Stage Active Distribution Network Voltage Control via LLM-RL Collaboration: A Hybrid Knowledge-Data-Driven Approach
  6. 2025Partially Observable Residual Reinforcement Learning for PV-Inverter-Based Voltage Control in Distribution Grids
  7. 2018Optimal Tap Setting of Voltage Regulation Transformers Using Batch Reinforcement Learning
  8. 2025Optimizing Energy Management of Smart Grid using Reinforcement Learning aided by Surrogate models built using Physics-informed Neural Networks