mlsanityData to 7 Oct 2026

Online Caching with Optimistic Learning

arXiv 2202.10590 ↗First posted 22 Feb 2022cs.NI cs.LGcited by 7

Not on the map. Why?

Abstract (arXiv)

The design of effective online caching policies is an increasingly important problem for content distribution networks, online social networks and edge computing services, among other areas. This paper proposes a new algorithmic toolbox for tackling this problem through the lens of optimistic online learning. We build upon the Follow-the-Regularized-Leader (FTRL) framework which is developed further here to include predictions for the file requests, and we design online caching algorithms for bipartite networks with fixed-size caches or elastic leased caches subject to time-average budget constraints. The predictions are provided by a content recommendation system that influences the users viewing activity, and hence can naturally reduce the caching network's uncertainty about future requests. We prove that the proposed optimistic learning caching policies can achieve sub-zero performance loss (regret) for perfect predictions, and maintain the best achievable regret bound O(√ T) even for arbitrary-bad predictions. The performance of the proposed algorithms is evaluated with detailed trace-driven numerical tests.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 23 of its 60 references that are in the map. First posted on arXiv 22 Feb 2022.

Builds on

23 of 60 references.

References · 23

  1. 2019Introduction to Online Convex Optimizationcited by 793
  2. 2019Online Learning: A Modern Introduction Using Convex Optimizationcited by 407
  3. 2018Competitive caching with machine learned advicecited by 194
  4. 2013Optimization, Learning, and Games with Predictable Sequencescited by 187
  5. 2017An Online Convex Optimization Approach to Dynamic Network Resource Allocationcited by 42
  6. 2020How to Retrain Recommender System? A Sequential Meta-Learning Methodcited by 42
  7. 2020Online Learning with Imperfect Hintscited by 37
  8. 2019Distributed Online Convex Optimization with Time-Varying Coupled Inequality Constraintscited by 28
  9. 2017Optimal and Scalable Caching for 5G Using Reinforcement Learning of Space-time Popularitiescited by 15
  10. 2019Learning to Cache With No Regretscited by 15
  11. 2017A Reinforcement-Learning Approach to Proactive Caching in Wireless Networkscited by 14
  12. 2013Temporal Locality in Today's Content Caching: Why it Matters and How to Model itcited by 13
11 more
  1. 2019Online Convex Optimization with Perturbed Constraintscited by 12
  2. 2021No-Regret Caching via Online Mirror Descentcited by 12
  3. 2018The Role of Caching in Future Communication Systems and Networkscited by 9
  4. 2018Reinforcement Learning for Adaptive Caching with Dynamic Storage Pricingcited by 8
  5. 2016Spatial multi-LRU Caching for Wireless Networks with Coverage Overlapscited by 7
  6. 2020Online Convex Optimization for Caching Networkscited by 7
  7. 2019Cache Optimization Models and Algorithmscited by 6
  8. 2016Placing Dynamic Content in Caches with Small Populationcited by 5
  9. 2018Implicit Coordination of Caches in Small Cell Networks under Unknown Popularity Profilescited by 5
  10. 2014Catalog Dynamics: Impact of Content Publishing and Perishing on the Performance of a LRU Cachecited by 3
  11. 2016Spatial multi-LRU: Distributed Caching for Wireless Networks with Coverage Overlapscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 2; 2023: 1; 2024: 1; 2025: 2; 2026: 1.

7 papers.