Comparing Traditional and Reinforcement-Learning Methods for Energy Storage Control
On the map: Deep reinforcement learning methods → RL for energy, networks and operations
Abstract (arXiv)
We aim to better understand the tradeoffs between traditional and reinforcement learning (RL) approaches for energy storage management. More specifically, we wish to better understand the performance loss incurred when using a generative RL policy instead of using a traditional approach to find optimal control policies for specific instances. Our comparison is based on a simplified micro-grid model, that includes a load component, a photovoltaic source, and a storage device. Based on this model, we examine three use cases of increasing complexity: ideal storage with convex cost functions, lossy storage devices, and lossy storage devices with convex transmission losses. With the aim of promoting the principled use RL based methods in this challenging and important domain, we provide a detailed formulation of each use case and a detailed description of the optimization challenges. We then compare the performance of traditional and RL methods, discuss settings in which it is beneficial to use each method, and suggest avenues for future investigation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in RL for energy, networks and operations, one of 15 directions in Deep reinforcement learning methods. Builds on 3 of its 23 references that are in the map. First posted on arXiv 31 May 2025.
Builds on
3 of 23 references.
References · 3
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,885
- 2018Addressing Function Approximation Error in Actor-Critic Methodscited by 2,417
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025A Reinforcement Learning Approach for Optimal Control in Microgrids
- 2024Learning a local trading strategy: deep reinforcement learning for grid-scale renewable energy integration
- 2024Should we use model-free or model-based control? A case study of battery management systems
- 2025The Economic Dispatch of Power-to-Gas Systems with Deep Reinforcement Learning:Tackling the Challenge of Delayed Rewards with Long-Term Energy Storage
- 2024Reinforcement Learning for Sustainable Energy: A Survey
- 2024Time-Varying Constraint-Aware Reinforcement Learning for Energy Storage Control
- 2025Optimizing Power Grid Topologies with Reinforcement Learning: A Survey of Methods and Challenges
- 2025RL2Grid: Benchmarking Reinforcement Learning in Power Grid Operations