# Using Deep Q-learning To Prolong the Lifetime of Correlated Internet of Things Devices

arXiv: https://arxiv.org/abs/1902.02850 · HTML: https://mlsanity.com/paper/1902.02850/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 7 Feb 2019.

## Built on by (most cited first, 1 of 1)

- [A reinforcement learning approach to improve communication performance and energy utilization in fog-based IoT](https://mlsanity.com/paper/2106.00654/) (2021)

## Abstract (arXiv)

Battery-powered sensors deployed in the Internet of Things (IoT) require energy-efficient solutions to prolong their lifetime. When these sensors observe a physical phenomenon distributed in space and evolving in time, the collected observations are expected to be correlated. We take advantage of the exhibited correlation and propose an updating mechanism that employs deep Q-learning. Our mechanism is capable of determining the frequency with which sensors should transmit their updates while taking into the consideration an ever-changing environment. We evaluate our solution using observations obtained in a real deployment, and show that our proposed mechanism is capable of significantly extending battery-powered sensors' lifetime without compromising the accuracy of the observations provided to the IoT service.