mlsanityData to 7 Oct 2026

Age of Information: Whittle Index for Scheduling Stochastic Arrivals

arXiv 1801.03422 ↗First posted 10 Jan 2018math.OC cs.IT cs.NIcited by 20

Not on the map. Why?

Abstract (arXiv)

Age of information is a new concept that characterizes the freshness of information at end devices. This paper studies the age of information from a scheduling perspective. We consider a wireless broadcast network where a base-station updates many users on stochastic information arrivals. Suppose that only one user can be updated for each time. In this context, we aim at developing a transmission scheduling algorithm for minimizing the long-run average age. To develop a low-complexity transmission scheduling algorithm, we apply the Whittle's framework for restless bandits. We successfully derive the Whittle index in a closed form and establish the indexability. Based on the Whittle index, we propose a scheduling algorithm, while experimentally showing that it closely approximates an age-optimal scheduling algorithm.

Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). First posted on arXiv 10 Jan 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 2; 2022: 2; 2023: 3; 2024: 4; 2025: 3; 2026: 6.

20 papers.

Sort:

  1. 2021Learn to Intervene: An Adaptive Learning Policy for Restless Bandits in Application to Preventive Healthcarecited by 34
  2. 2022Optimistic Whittle Index Policy: Online Learning for Restless Banditscited by 18
  3. 2022Networked Restless Multi-Armed Bandits for Mobile Interventionscited by 7
  4. 2021Efficient Algorithms for Finite Horizon and Streaming Restless Multi-Armed Bandit Problemscited by 6
  5. 2023Weakly Coupled Deep Q-Networkscited by 6
  6. 2024Timely Communications for Remote Inferencecited by 5
  7. 2023Limited Resource Allocation in a Non-Markovian World: The Case of Maternal and Child Healthcarecited by 4
  8. 2024Tabular and Deep Learning for the Whittle Indexcited by 3
  9. 2024Improving Health Information Access in the World's Largest Maternal Mobile Health Program via Bandit Algorithmscited by 2
  10. 2024Lagrangian Index Policy for Restless Bandits with Average Rewardcited by 2
  11. 2026MA-HEAD-Net: Adaptive Rule-Guided Multi-Agent DRL for AoI Minimization in UAV-Assisted Emergency Networkscited by 1
  12. 2023Minimizing Age of Information for Mobile Edge Computing Systems: A Nested Index Approachcited by 0
8 more
  1. 2025On the Regularity and Fairness of Combinatorial Multi-Armed Banditcited by 0
  2. 2025Online Learning for Optimizing AoI-Energy Tradeoff under Unknown Channel Statisticscited by 0
  3. 2025MARBLE: Multi-Armed Restless Bandits in Latent Markovian Environmentcited by 0
  4. 2026Adaptive Requesting in Decentralized Edge Networks via Non-Stationary Banditscited by 0
  5. 2026Restless Bandits with Individual Penalty Constraints: Near-Optimal Indices and Deep Reinforcement Learningcited by 0
  6. 2026A Modularized Framework for Piecewise-Stationary Restless Banditscited by 0
  7. 2026Real-Time Hard Peak Age-of-Information Safety with No-Regret Learningcited by 0
  8. 2026Threshold Structure of Optimal Policies in Restart POMDPscited by 0