Optimal Scheduling in IoT-Driven Smart Isolated Microgrids Based on Deep Reinforcement Learning
Not on the map. Why?
Abstract (arXiv)
In this paper, we investigate the scheduling issue of diesel generators (DGs) in an Internet of Things (IoT)-Driven isolated microgrid (MG) by deep reinforcement learning (DRL). The renewable energy is fully exploited under the uncertainty of renewable generation and load demand. The DRL agent learns an optimal policy from history renewable and load data of previous days, where the policy can generate real-time decisions based on observations of past renewable and load data of previous hours collected by connected sensors. The goal is to reduce operating cost on the premise of ensuring supply-demand balance. In specific, a novel finite-horizon partial observable Markov decision process (POMDP) model is conceived considering the spinning reserve. In order to overcome the challenge of discrete-continuous hybrid action space due to the binary DG switching decision and continuous energy dispatch (ED) decision, a DRL algorithm, namely the hybrid action finite-horizon RDPG (HAFH-RDPG), is proposed. HAFH-RDPG seamlessly integrates two classical DRL algorithms, i.e., deep Q-network (DQN) and recurrent deterministic policy gradient (RDPG), based on a finite-horizon dynamic programming (DP) framework. Extensive experiments are performed with real-world data in an IoT-driven MG to evaluate the capability of the proposed algorithm in handling the uncertainty due to inter-hour and inter-day power fluctuation and to compare its performance with those of the benchmark algorithms.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 13 of its 48 references that are in the map. First posted on arXiv 28 Apr 2023.
Builds on
13 of 48 references.
References · 13
- 2015Continuous control with deep reinforcement learningcited by 3,407
- 2015Deep Recurrent Q-Learning for Partially Observable MDPscited by 465
- 2017The Uncertainty Bellman Equation and Explorationcited by 82
- 2015Memory-based control with recurrent neural networkscited by 78
- 2018Parametrized Deep Q-Networks Learning: Reinforcement Learning with Discrete-Continuous Hybrid Action Spacecited by 58
- 2019Deep Reinforcement Learning for Autonomous Internet of Things: Model, Applications and Challengescited by 37
- 2017On-line Building Energy Optimization using Deep Reinforcement Learningcited by 27
- 2021Optimal Scheduling of Isolated Microgrids Using Automated Reinforcement Learning-based Multi-period Forecastingcited by 14
- 2020Dynamic Energy Dispatch Based on Deep Reinforcement Learning in IoT-Driven Smart Isolated Microgridscited by 13
- 2020Online Scheduling of a Residential Microgrid via Monte-Carlo Tree Search and a Learned Modelcited by 8
- 2018Optimal Scheduling of an Isolated Microgrid with Battery Storage Considering Load and Renewable Generation Uncertaintiescited by 7
- 2021Multi-agent Bayesian Deep Reinforcement Learning for Microgrid Energy Management under Communication Failurescited by 5
1 more
Built on by
Citing papers per year: 2025: 2.
2 papers.