Age of Information: Whittle Index for Scheduling Stochastic Arrivals
Not on the map. Why?
Abstract (arXiv)
Age of information is a new concept that characterizes the freshness of information at end devices. This paper studies the age of information from a scheduling perspective. We consider a wireless broadcast network where a base-station updates many users on stochastic information arrivals. Suppose that only one user can be updated for each time. In this context, we aim at developing a transmission scheduling algorithm for minimizing the long-run average age. To develop a low-complexity transmission scheduling algorithm, we apply the Whittle's framework for restless bandits. We successfully derive the Whittle index in a closed form and establish the indexability. Based on the Whittle index, we propose a scheduling algorithm, while experimentally showing that it closely approximates an age-optimal scheduling algorithm.
Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). First posted on arXiv 10 Jan 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 2; 2022: 2; 2023: 3; 2024: 4; 2025: 3; 2026: 6.
20 papers.
Sort:
- 2021Learn to Intervene: An Adaptive Learning Policy for Restless Bandits in Application to Preventive Healthcarecited by 34
- 2022Optimistic Whittle Index Policy: Online Learning for Restless Banditscited by 18
- 2022Networked Restless Multi-Armed Bandits for Mobile Interventionscited by 7
- 2021Efficient Algorithms for Finite Horizon and Streaming Restless Multi-Armed Bandit Problemscited by 6
- 2023Weakly Coupled Deep Q-Networkscited by 6
- 2024Timely Communications for Remote Inferencecited by 5
- 2023Limited Resource Allocation in a Non-Markovian World: The Case of Maternal and Child Healthcarecited by 4
- 2024Tabular and Deep Learning for the Whittle Indexcited by 3
- 2024Improving Health Information Access in the World's Largest Maternal Mobile Health Program via Bandit Algorithmscited by 2
- 2024Lagrangian Index Policy for Restless Bandits with Average Rewardcited by 2
- 2026MA-HEAD-Net: Adaptive Rule-Guided Multi-Agent DRL for AoI Minimization in UAV-Assisted Emergency Networkscited by 1
- 2023Minimizing Age of Information for Mobile Edge Computing Systems: A Nested Index Approachcited by 0
8 more
- 2025On the Regularity and Fairness of Combinatorial Multi-Armed Banditcited by 0
- 2025Online Learning for Optimizing AoI-Energy Tradeoff under Unknown Channel Statisticscited by 0
- 2025MARBLE: Multi-Armed Restless Bandits in Latent Markovian Environmentcited by 0
- 2026Adaptive Requesting in Decentralized Edge Networks via Non-Stationary Banditscited by 0
- 2026Restless Bandits with Individual Penalty Constraints: Near-Optimal Indices and Deep Reinforcement Learningcited by 0
- 2026A Modularized Framework for Piecewise-Stationary Restless Banditscited by 0
- 2026Real-Time Hard Peak Age-of-Information Safety with No-Regret Learningcited by 0
- 2026Threshold Structure of Optimal Policies in Restart POMDPscited by 0
- 2026Threshold Structure of Optimal Policies in Restart POMDPs11 Aug 2026
- 2026MA-HEAD-Net: Adaptive Rule-Guided Multi-Agent DRL for AoI Minimization in UAV-Assisted Emergency Networks2 Aug 2026
- 2026Real-Time Hard Peak Age-of-Information Safety with No-Regret Learning30 Jul 2026
- 2026A Modularized Framework for Piecewise-Stationary Restless Bandits11 Apr 2026
- 2026Restless Bandits with Individual Penalty Constraints: Near-Optimal Indices and Deep Reinforcement Learning5 Apr 2026
- 2026Adaptive Requesting in Decentralized Edge Networks via Non-Stationary Bandits13 Jan 2026
- 2025MARBLE: Multi-Armed Restless Bandits in Latent Markovian Environment12 Nov 2025
- 2025Online Learning for Optimizing AoI-Energy Tradeoff under Unknown Channel Statistics23 Sep 2025
- 2025On the Regularity and Fairness of Combinatorial Multi-Armed Bandit15 Sep 2025
- 2024Lagrangian Index Policy for Restless Bandits with Average Reward17 Dec 2024
- 2024Tabular and Deep Learning for the Whittle Index4 Jun 2024
- 2024Improving Health Information Access in the World's Largest Maternal Mobile Health Program via Bandit Algorithms14 May 2024
8 more
- 2024Timely Communications for Remote Inference25 Apr 2024
- 2023Weakly Coupled Deep Q-Networks28 Oct 2023
- 2023Minimizing Age of Information for Mobile Edge Computing Systems: A Nested Index Approach3 Jul 2023
- 2023Limited Resource Allocation in a Non-Markovian World: The Case of Maternal and Child Healthcare22 May 2023
- 2022Optimistic Whittle Index Policy: Online Learning for Restless Bandits30 May 2022
- 2022Networked Restless Multi-Armed Bandits for Mobile Interventions28 Jan 2022
- 2021Learn to Intervene: An Adaptive Learning Policy for Restless Bandits in Application to Preventive Healthcare17 May 2021
- 2021Efficient Algorithms for Finite Horizon and Streaming Restless Multi-Armed Bandit Problems8 Mar 2021
- 2021Learn to Intervene: An Adaptive Learning Policy for Restless Bandits in Application to Preventive Healthcarecited by 34
- 2022Optimistic Whittle Index Policy: Online Learning for Restless Banditscited by 18
- 2022Networked Restless Multi-Armed Bandits for Mobile Interventionscited by 7
- 2021Efficient Algorithms for Finite Horizon and Streaming Restless Multi-Armed Bandit Problemscited by 6
- 2023Weakly Coupled Deep Q-Networkscited by 6
- 2024Timely Communications for Remote Inferencecited by 5
- 2023Limited Resource Allocation in a Non-Markovian World: The Case of Maternal and Child Healthcarecited by 4
- 2024Tabular and Deep Learning for the Whittle Indexcited by 3
- 2024Improving Health Information Access in the World's Largest Maternal Mobile Health Program via Bandit Algorithmscited by 2
- 2024Lagrangian Index Policy for Restless Bandits with Average Rewardcited by 2
- 2026MA-HEAD-Net: Adaptive Rule-Guided Multi-Agent DRL for AoI Minimization in UAV-Assisted Emergency Networkscited by 1
- 2023Minimizing Age of Information for Mobile Edge Computing Systems: A Nested Index Approachcited by 0
12 most cited of 20 All 20 (JSON)
- 2026Threshold Structure of Optimal Policies in Restart POMDPs11 Aug 2026
- 2026MA-HEAD-Net: Adaptive Rule-Guided Multi-Agent DRL for AoI Minimization in UAV-Assisted Emergency Networks2 Aug 2026
- 2026Real-Time Hard Peak Age-of-Information Safety with No-Regret Learning30 Jul 2026
- 2026A Modularized Framework for Piecewise-Stationary Restless Bandits11 Apr 2026
- 2026Restless Bandits with Individual Penalty Constraints: Near-Optimal Indices and Deep Reinforcement Learning5 Apr 2026
- 2026Adaptive Requesting in Decentralized Edge Networks via Non-Stationary Bandits13 Jan 2026
- 2025MARBLE: Multi-Armed Restless Bandits in Latent Markovian Environment12 Nov 2025
- 2025Online Learning for Optimizing AoI-Energy Tradeoff under Unknown Channel Statistics23 Sep 2025
- 2025On the Regularity and Fairness of Combinatorial Multi-Armed Bandit15 Sep 2025
- 2024Lagrangian Index Policy for Restless Bandits with Average Reward17 Dec 2024
- 2024Tabular and Deep Learning for the Whittle Index4 Jun 2024
- 2024Improving Health Information Access in the World's Largest Maternal Mobile Health Program via Bandit Algorithms14 May 2024
12 newest of 20 All 20 (JSON)