Representation Learning Enhanced Deep Reinforcement Learning for Optimal Operation of Hydrogen-based Multi-Energy Systems
On the map: Deep reinforcement learning methods → RL for energy, networks and operations
Abstract (arXiv)
Hydrogen-based multi-energy systems (HMES) have emerged as a promising low-carbon and energy-efficient solution, as it can enable the coordinated operation of electricity, heating and cooling supply and demand to enhance operational flexibility, improve overall energy efficiency, and increase the share of renewable integration. However, the optimal operation of HMES remains challenging due to the nonlinear and multi-physics coupled dynamics of hydrogen energy storage systems (HESS) (consisting of electrolyters, fuel cells and hydrogen tanks) as well as the presence of multiple uncertainties from supply and demand. To address these challenges, this paper develops a comprehensive operational model for HMES that fully captures the nonlinear dynamics and multi-physics process of HESS. Moreover, we propose an enhanced deep reinforcement learning (DRL) framework by integrating the emerging representation learning techniques, enabling substantially accelerated and improved policy optimization for spatially and temporally coupled complex networked systems, which is not provided by conventional DRL. Experimental studies based on real-world datasets show that the comprehensive model is crucial to ensure the safe and reliable of HESS. In addition, the proposed SR-DRL approaches demonstrate superior convergence rate and performance over conventional DRL counterparts in terms of reducing the operation cost of HMES and handling the system operating constraints. Finally, we provide some insights into the role of representation learning in DRL, speculating that it can reorganize the original state space into a well-structured and cluster-aware geometric representation, thereby smoothing and facilitating the learning process of DRL.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in RL for energy, networks and operations, one of 15 directions in Deep reinforcement learning methods. Builds on 8 of its 22 references that are in the map. First posted on arXiv 17 Jan 2026.
Builds on
8 of 22 references.
Closest ancestors · 1
Same direction, newest first
Other references · 7
- 2018Addressing Function Approximation Error in Actor-Critic Methodscited by 2,417
- 2020Learning Invariant Representations for Reinforcement Learning without Reconstructioncited by 436
- 2016Target-driven Visual Navigation in Indoor Scenes using Deep Reinforcement Learningcited by 366
- 2019Stochastic Latent Actor-Critic: Deep Reinforcement Learning with a Latent Variable Modelcited by 231
- 2015Deep Spatial Autoencoders for Visuomotor Learningcited by 153
- 2023For SALE: State-Action Representation Learning for Deep Reinforcement Learningcited by 75
- 2024Long-Term Energy Management for Microgrid with Hybrid Hydrogen-Battery Energy Storage: A Prediction-Free Coordinated Optimization Frameworkcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Towards Sustainable Hydrogen Systems: Supply Chain Optimization with Model Predictive Control and Reinforcement Learning
- 2025The Economic Dispatch of Power-to-Gas Systems with Deep Reinforcement Learning:Tackling the Challenge of Delayed Rewards with Long-Term Energy Storage
- 2026A Hierarchical Optimisation Framework for Integrated Electric-Hydrogen-Transport Systems ↗
- 2025Green Energy Management for Sustainable Data Centers Using Deep Reinforcement Learning
- 2025Constrained Reinforcement Learning for the Dynamic Inventory Routing Problem under Stochastic Supply and Demand
- 2026A Statistical and Machine Learning Framework for Operational Threshold Detection and Deployable Dispatch Controller Development in Hydrogen Multi-Energy Systems
- 2024A Holistic Power Optimization Approach for Microgrid Control Based on Deep Reinforcement Learning
- 2024Attentive Convolutional Deep Reinforcement Learning for Optimizing Solar-Storage Systems in Real-Time Electricity Markets