Deep Reinforcement Learning for Smart Home Energy Management
Not on the map. Why?
Abstract (arXiv)
In this paper, we investigate an energy cost minimization problem for a smart home in the absence of a building thermal dynamics model with the consideration of a comfortable temperature range. Due to the existence of model uncertainty, parameter uncertainty (e.g., renewable generation output, non-shiftable power demand, outdoor temperature, and electricity price) and temporally-coupled operational constraints, it is very challenging to determine the optimal energy management strategy for scheduling Heating, Ventilation, and Air Conditioning (HVAC) systems and energy storage systems in the smart home. To address the challenge, we first formulate the above problem as a Markov decision process, and then propose an energy management strategy based on Deep Deterministic Policy Gradients (DDPG). It is worth mentioning that the proposed strategy does not require the prior knowledge of uncertain parameters and building thermal dynamics model. Simulation results based on real-world traces demonstrate the effectiveness and robustness of the proposed strategy.
Key facts. Cited by 28 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Sep 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 5; 2023: 6; 2024: 4; 2025: 4; 2026: 4.
28 papers.
Sort:
By area:
- 2021Reinforcement Learning for Selective Key Applications in Power Systems: Recent Advances and Future Challengescited by 40
- 2021Physically Consistent Neural Networks for building thermal modeling: theory and analysiscited by 16
- 2022Contingency-constrained economic dispatch with safe reinforcement learningcited by 5
- 2023Katakomba: Tools and Benchmarks for Data-Driven NetHackcited by 5
- 2024Knowledge Transfer from Simple to Complex: A Safe and Efficient Reinforcement Learning Framework for Autonomous Driving Decision-Makingcited by 5
- 2024Go-Explore for Residential Energy Managementcited by 3
- 2024A Reinforcement Learning Approach to Dairy Farm Battery Management using Q Learningcited by 3
- 2021Correlated Deep Q-learning based Microgrid Energy Managementcited by 2
- 2022AutoFR: Automated Filter Rule Generation for Adblockingcited by 2
- 2022PBRE: A Rule Extraction Method from Trained Neural Networks Designed for Smart Home Servicescited by 2
- 2022Machine Learning for Smart and Energy-Efficient Buildingscited by 1
- 2023Renewable energy management in smart home environment via forecast embedded scheduling based on Recurrent Trend Predictive Neural Networkcited by 1
16 more
- 2023Edge AI for Internet of Energy: Challenges and Perspectivescited by 1
- 2025Data-Driven Policy Mapping for Safe RL-based Energy Management Systemscited by 1
- 2021Does Explicit Prediction Matter in Deep Reinforcement Learning-Based Energy Management?cited by 0
- 2021Scalable Multi-Agent Reinforcement Learning for Residential Load Scheduling under Data Governancecited by 0
- 2022Joint Energy Dispatch and Unit Commitment in Microgrids Based on Deep Reinforcement Learningcited by 0
- 2023TreeC: a method to generate interpretable energy management systems using a metaheuristic algorithmcited by 0
- 2023Deep Reinforcement Learning for Artificial Upwelling Energy Managementcited by 0
- 2023Learning a Reward Function for User-Preferred Appliance Schedulingcited by 0
- 2024A Deep Reinforcement Learning Approach to Battery Management in Dairy Farming via Proximal Policy Optimizationcited by 0
- 2025Integration of Multi-Mode Preference into Home Energy Management System Using Deep Reinforcement Learningcited by 0
- 2025HMPC-assisted Adversarial Inverse Reinforcement Learning for Smart Home Energy Managementcited by 0
- 2025BitRL-Light: 1-bit LLM Agents with Deep Reinforcement Learning for Energy-Efficient Smart Home Lighting Optimizationcited by 0
- 2026Forecast Aware Deep Reinforcement Learning for Efficient Electricity Load Scheduling in Dairy Farmscited by 0
- 2026Supervised Reinforcement Learning for the Coordination of Distributed Energy Resourcescited by 0
- 2026Measure the Sim-to-Real Gap: Designing an Affordable Real-World Benchmark Platform for Reinforcement Learning in AIoT Systemscited by 0
- 2026From Thermal Preference Prediction to Adaptive Thermal Intervention: A Reinforcement Learning Approach Using Physiological and Environmental Sensingcited by 0
- 2026From Thermal Preference Prediction to Adaptive Thermal Intervention: A Reinforcement Learning Approach Using Physiological and Environmental Sensing19 Aug 2026
- 2026Measure the Sim-to-Real Gap: Designing an Affordable Real-World Benchmark Platform for Reinforcement Learning in AIoT Systems11 Jul 2026
- 2026Supervised Reinforcement Learning for the Coordination of Distributed Energy Resources23 Jun 2026
- 2026Forecast Aware Deep Reinforcement Learning for Efficient Electricity Load Scheduling in Dairy Farms12 Jan 2026
- 2025BitRL-Light: 1-bit LLM Agents with Deep Reinforcement Learning for Energy-Efficient Smart Home Lighting Optimization23 Nov 2025
- 2025Data-Driven Policy Mapping for Safe RL-based Energy Management Systems19 Jun 2025
- 2025HMPC-assisted Adversarial Inverse Reinforcement Learning for Smart Home Energy Management1 Jun 2025
- 2025Integration of Multi-Mode Preference into Home Energy Management System Using Deep Reinforcement Learning2 May 2025
- 2024Knowledge Transfer from Simple to Complex: A Safe and Efficient Reinforcement Learning Framework for Autonomous Driving Decision-Making18 Oct 2024
- 2024A Deep Reinforcement Learning Approach to Battery Management in Dairy Farming via Proximal Policy Optimization1 Jul 2024
- 2024A Reinforcement Learning Approach to Dairy Farm Battery Management using Q Learning14 Mar 2024
- 2024Go-Explore for Residential Energy Management15 Jan 2024
16 more
- 2023Edge AI for Internet of Energy: Challenges and Perspectives28 Nov 2023
- 2023Learning a Reward Function for User-Preferred Appliance Scheduling11 Oct 2023
- 2023Deep Reinforcement Learning for Artificial Upwelling Energy Management20 Aug 2023
- 2023Renewable energy management in smart home environment via forecast embedded scheduling based on Recurrent Trend Predictive Neural Network4 Jul 2023
- 2023Katakomba: Tools and Benchmarks for Data-Driven NetHack14 Jun 2023
- 2023TreeC: a method to generate interpretable energy management systems using a metaheuristic algorithm17 Apr 2023
- 2022Machine Learning for Smart and Energy-Efficient Buildings27 Nov 2022
- 2022PBRE: A Rule Extraction Method from Trained Neural Networks Designed for Smart Home Services18 Jul 2022
- 2022Joint Energy Dispatch and Unit Commitment in Microgrids Based on Deep Reinforcement Learning3 Jun 2022
- 2022Contingency-constrained economic dispatch with safe reinforcement learning12 May 2022
- 2022AutoFR: Automated Filter Rule Generation for Adblocking25 Feb 2022
- 2021Physically Consistent Neural Networks for building thermal modeling: theory and analysis6 Dec 2021
- 2021Scalable Multi-Agent Reinforcement Learning for Residential Load Scheduling under Data Governance6 Oct 2021
- 2021Does Explicit Prediction Matter in Deep Reinforcement Learning-Based Energy Management?11 Aug 2021
- 2021Correlated Deep Q-learning based Microgrid Energy Management6 Mar 2021
- 2021Reinforcement Learning for Selective Key Applications in Power Systems: Recent Advances and Future Challenges27 Jan 2021
- 2021Reinforcement Learning for Selective Key Applications in Power Systems: Recent Advances and Future Challengescited by 40
- 2021Physically Consistent Neural Networks for building thermal modeling: theory and analysiscited by 16
- 2022Contingency-constrained economic dispatch with safe reinforcement learningcited by 5
- 2024Go-Explore for Residential Energy Managementcited by 3
- 2024A Reinforcement Learning Approach to Dairy Farm Battery Management using Q Learningcited by 3
- 2021Correlated Deep Q-learning based Microgrid Energy Managementcited by 2
- 2022AutoFR: Automated Filter Rule Generation for Adblockingcited by 2
- 2022PBRE: A Rule Extraction Method from Trained Neural Networks Designed for Smart Home Servicescited by 2
- 2022Machine Learning for Smart and Energy-Efficient Buildingscited by 1
- 2023Renewable energy management in smart home environment via forecast embedded scheduling based on Recurrent Trend Predictive Neural Networkcited by 1
- 2023Edge AI for Internet of Energy: Challenges and Perspectivescited by 1
- 2025Data-Driven Policy Mapping for Safe RL-based Energy Management Systemscited by 1
12 most cited of 25 All 25 (JSON)
- 2026From Thermal Preference Prediction to Adaptive Thermal Intervention: A Reinforcement Learning Approach Using Physiological and Environmental Sensing19 Aug 2026
- 2026Measure the Sim-to-Real Gap: Designing an Affordable Real-World Benchmark Platform for Reinforcement Learning in AIoT Systems11 Jul 2026
- 2026Supervised Reinforcement Learning for the Coordination of Distributed Energy Resources23 Jun 2026
- 2026Forecast Aware Deep Reinforcement Learning for Efficient Electricity Load Scheduling in Dairy Farms12 Jan 2026
- 2025BitRL-Light: 1-bit LLM Agents with Deep Reinforcement Learning for Energy-Efficient Smart Home Lighting Optimization23 Nov 2025
- 2025Data-Driven Policy Mapping for Safe RL-based Energy Management Systems19 Jun 2025
- 2025Integration of Multi-Mode Preference into Home Energy Management System Using Deep Reinforcement Learning2 May 2025
- 2024A Deep Reinforcement Learning Approach to Battery Management in Dairy Farming via Proximal Policy Optimization1 Jul 2024
- 2024A Reinforcement Learning Approach to Dairy Farm Battery Management using Q Learning14 Mar 2024
- 2024Go-Explore for Residential Energy Management15 Jan 2024
- 2023Edge AI for Internet of Energy: Challenges and Perspectives28 Nov 2023
- 2023Learning a Reward Function for User-Preferred Appliance Scheduling11 Oct 2023
12 newest of 25 All 25 (JSON)