mlsanityData to 14 Oct 2026

A New Error Temporal Difference Algorithm for Deep Reinforcement Learning in Microgrid Optimization

arXiv 2511.18093 ↗First posted 22 Nov 2025cs.LG cs.AIcited by 0

On the map: Deep reinforcement learning methods → RL for energy, networks and operations

Abstract (arXiv)

Predictive control approaches based on deep reinforcement learning (DRL) have gained significant attention in microgrid energy optimization. However, existing research often overlooks the issue of uncertainty stemming from imperfect prediction models, which can lead to suboptimal control strategies. This paper presents a new error temporal difference (ETD) algorithm for DRL to address the uncertainty in predictions,aiming to improve the performance of microgrid operations. First,a microgrid system integrated with renewable energy sources (RES) and energy storage systems (ESS), along with its Markov decision process (MDP), is modelled. Second, a predictive control approach based on a deep Q network (DQN) is presented, in which a weighted average algorithm and a new ETD algorithm are designed to quantify and address the prediction uncertainty, respectively. Finally, simulations on a realworld US dataset suggest that the developed ETD effectively improves the performance of DRL in optimizing microgrid operations.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in RL for energy, networks and operations, one of 15 directions in Deep reinforcement learning methods. Builds on 3 of its 23 references that are in the map. First posted on arXiv 22 Nov 2025.

Builds on

3 of 23 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024A Holistic Power Optimization Approach for Microgrid Control Based on Deep Reinforcement Learning1 Mar

Other references · 2

  1. 2021Renewable energy integration and microgrid energy trading using multi-agent deep reinforcement learningcited by 8
  2. 2022Deep Reinforcement Learning based Model-free On-line Dynamic Multi-Microgrid Formation to Enhance Resiliencecited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Integrating Reinforcement Learning and Model Predictive Control with Applications to Microgrids
  2. 2025AutoGrid AI: Deep Reinforcement Learning Framework for Autonomous Microgrid Management
  3. 2025Diffusion-Modeled Reinforcement Learning for Carbon and Risk-Aware Microgrid Optimization
  4. 2025A Reinforcement Learning Approach for Optimal Control in Microgrids
  5. 2025Real-Time Energy Management Strategies for Community Microgrids ↗
  6. 2024Physical Informed-Inspired Deep Reinforcement Learning Based Bi-Level Programming for Microgrid Scheduling
  7. 2025Independent policy gradient-based reinforcement learning for economic and reliable energy management of multi-microgrid systems
  8. 2024Methods for Mitigating Uncertainty in Real-Time Operations of a Connected Microgrid ↗