Online Caching with Optimistic Learning
Not on the map. Why?
Abstract (arXiv)
The design of effective online caching policies is an increasingly important problem for content distribution networks, online social networks and edge computing services, among other areas. This paper proposes a new algorithmic toolbox for tackling this problem through the lens of optimistic online learning. We build upon the Follow-the-Regularized-Leader (FTRL) framework which is developed further here to include predictions for the file requests, and we design online caching algorithms for bipartite networks with fixed-size caches or elastic leased caches subject to time-average budget constraints. The predictions are provided by a content recommendation system that influences the users viewing activity, and hence can naturally reduce the caching network's uncertainty about future requests. We prove that the proposed optimistic learning caching policies can achieve sub-zero performance loss (regret) for perfect predictions, and maintain the best achievable regret bound O(√ T) even for arbitrary-bad predictions. The performance of the proposed algorithms is evaluated with detailed trace-driven numerical tests.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 23 of its 60 references that are in the map. First posted on arXiv 22 Feb 2022.
Builds on
23 of 60 references.
References · 23
- 2019Introduction to Online Convex Optimizationcited by 793
- 2019Online Learning: A Modern Introduction Using Convex Optimizationcited by 407
- 2018Competitive caching with machine learned advicecited by 194
- 2013Optimization, Learning, and Games with Predictable Sequencescited by 187
- 2017An Online Convex Optimization Approach to Dynamic Network Resource Allocationcited by 42
- 2020How to Retrain Recommender System? A Sequential Meta-Learning Methodcited by 42
- 2020Online Learning with Imperfect Hintscited by 37
- 2019Distributed Online Convex Optimization with Time-Varying Coupled Inequality Constraintscited by 28
- 2017Optimal and Scalable Caching for 5G Using Reinforcement Learning of Space-time Popularitiescited by 15
- 2019Learning to Cache With No Regretscited by 15
- 2017A Reinforcement-Learning Approach to Proactive Caching in Wireless Networkscited by 14
- 2013Temporal Locality in Today's Content Caching: Why it Matters and How to Model itcited by 13
11 more
- 2019Online Convex Optimization with Perturbed Constraintscited by 12
- 2021No-Regret Caching via Online Mirror Descentcited by 12
- 2018The Role of Caching in Future Communication Systems and Networkscited by 9
- 2018Reinforcement Learning for Adaptive Caching with Dynamic Storage Pricingcited by 8
- 2016Spatial multi-LRU Caching for Wireless Networks with Coverage Overlapscited by 7
- 2020Online Convex Optimization for Caching Networkscited by 7
- 2019Cache Optimization Models and Algorithmscited by 6
- 2016Placing Dynamic Content in Caches with Small Populationcited by 5
- 2018Implicit Coordination of Caches in Small Cell Networks under Unknown Popularity Profilescited by 5
- 2014Catalog Dynamics: Impact of Content Publishing and Perishing on the Performance of a LRU Cachecited by 3
- 2016Spatial multi-LRU: Distributed Caching for Wireless Networks with Coverage Overlapscited by 2
Built on by
Citing papers per year: 2022: 2; 2023: 1; 2024: 1; 2025: 2; 2026: 1.
7 papers.
- 2022Optimistic No-regret Algorithms for Discrete Cachingcited by 10
- 2022Online Caching with no Regret: Optimistic Learning via Recommendationscited by 4
- 2023No-Regret Caching with Noisy Request Estimatescited by 1
- 2024An Online Gradient-Based Caching Policy with Logarithmic Complexity and Regret Guaranteescited by 1
- 2025Efficient and Optimal No-Regret Caching under Partial Observationcited by 1
- 2025Optimistic Learning for Communication Networkscited by 0
- 2026SEArch: Optimistic Policy Selection Between Scene Noise and Drift for UAV Radar Searchcited by 0
- 2026SEArch: Optimistic Policy Selection Between Scene Noise and Drift for UAV Radar Search31 May 2026
- 2025Optimistic Learning for Communication Networks4 Apr 2025
- 2025Efficient and Optimal No-Regret Caching under Partial Observation4 Mar 2025
- 2024An Online Gradient-Based Caching Policy with Logarithmic Complexity and Regret Guarantees2 May 2024
- 2023No-Regret Caching with Noisy Request Estimates5 Sep 2023
- 2022Optimistic No-regret Algorithms for Discrete Caching15 Aug 2022
- 2022Online Caching with no Regret: Optimistic Learning via Recommendations20 Apr 2022