Optimistic No-regret Algorithms for Discrete Caching
Not on the map. Why?
Abstract (arXiv)
We take a systematic look at the problem of storing whole files in a cache with limited capacity in the context of optimistic learning, where the caching policy has access to a prediction oracle (provided by, e.g., a Neural Network). The successive file requests are assumed to be generated by an adversary, and no assumption is made on the accuracy of the oracle. In this setting, we provide a universal lower bound for prediction-assisted online caching and proceed to design a suite of policies with a range of performance-complexity trade-offs. All proposed policies offer sublinear regret bounds commensurate with the accuracy of the oracle. Our results substantially improve upon all recently-proposed online caching policies, which, being unable to exploit the oracle predictions, offer only O(√T) regret. In this pursuit, we design, to the best of our knowledge, the first comprehensive optimistic Follow-the-Perturbed leader policy, which generalizes beyond the caching problem. We also study the problem of caching files with different sizes and the bipartite network caching problem. Finally, we evaluate the efficacy of the proposed policies through extensive numerical experiments using real-world traces.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 36 of its 72 references that are in the map. First posted on arXiv 15 Aug 2022.
Builds on
36 of 72 references.
References · 36
- 2019Introduction to Online Convex Optimizationcited by 803
- 2019Online Learning: A Modern Introduction Using Convex Optimizationcited by 417
- 2018Competitive caching with machine learned advicecited by 195
- 2013Optimization, Learning, and Games with Predictable Sequencescited by 188
- 2020Online metric algorithms with untrusted predictionscited by 75
- 2019Near-Optimal Bounds for Online Caching with Machine Learned Advicecited by 73
- 2013Follow the Leader If You Can, Hedge If You Mustcited by 70
- 2020Online Learning with Imperfect Hintscited by 37
- 2019Online Non-Convex Learning: Following the Perturbed Leader is Optimalcited by 32
- 2014An Improved Approximation for k-median, and Positive Correlation in Budgeted Optimizationcited by 26
- 2014Online Linear Optimization via Smoothingcited by 24
- 2022Between Stochastic and Adversarial Online Convex Optimization: Improved Regret Bounds via Smoothnesscited by 21
24 more
- 2015A Tale of Two Metrics: Simultaneous Bounds on Competitiveness and Regretcited by 18
- 2015Projection onto the capped simplexcited by 15
- 2017Optimal and Scalable Caching for 5G Using Reinforcement Learning of Space-time Popularitiescited by 15
- 2017A Reinforcement-Learning Approach to Proactive Caching in Wireless Networkscited by 14
- 2020LeadCache: Regret-Optimal Caching in Networkscited by 14
- 2013Temporal Locality in Today's Content Caching: Why it Matters and How to Model itcited by 13
- 2021No-Regret Caching via Online Mirror Descentcited by 12
- 2020Follow the Perturbed Leader: Optimism and Fast Parallel Algorithms for Smooth Minimax Gamescited by 10
- 2018The Role of Caching in Future Communication Systems and Networkscited by 9
- 2018Reinforcement Learning for Adaptive Caching with Dynamic Storage Pricingcited by 8
- 2021ktexttt-experts -- Online Policies and Fundamental Limitscited by 8
- 2016Spatial multi-LRU Caching for Wireless Networks with Coverage Overlapscited by 7
- 2020Online Convex Optimization for Caching Networkscited by 7
- 2022Online Caching with Optimistic Learningcited by 7
- 2019Cache Optimization Models and Algorithmscited by 6
- 2016Placing Dynamic Content in Caches with Small Populationcited by 5
- 2018Implicit Coordination of Caches in Small Cell Networks under Unknown Popularity Profilescited by 5
- 2017Timely-Throughput Optimal Scheduling with Predictioncited by 4
- 2022Lazy Lagrangians with Predictions for Online Learningcited by 4
- 2014Catalog Dynamics: Impact of Content Publishing and Perishing on the Performance of a LRU Cachecited by 3
- 2016Spatial multi-LRU: Distributed Caching for Wireless Networks with Coverage Overlapscited by 2
- 2021Network Friendly Recommendations: Optimizing for Long Viewing Sessionscited by 2
- 2022Universal Cachingcited by 2
- 2020Online VNF Chaining and Predictive Scheduling: Optimality and Trade-offscited by 1
Built on by
Citing papers per year: 2022: 1; 2023: 3; 2024: 3; 2025: 3.
10 papers.
- 2023No-regret Algorithms for Fair Resource Allocationcited by 9
- 2025On the Dynamic Regret of Following the Regularized Leader: Optimism with History Pruningcited by 5
- 2024Fair Resource Allocation in Virtualized O-RAN Platformscited by 4
- 2023Adaptive Online Non-stochastic Controlcited by 3
- 2024Optimistic Online Non-stochastic Control via FTRLcited by 3
- 2023No-Regret Caching with Noisy Request Estimatescited by 1
- 2024An Online Gradient-Based Caching Policy with Logarithmic Complexity and Regret Guaranteescited by 1
- 2025Efficient and Optimal No-Regret Caching under Partial Observationcited by 1
- 2022Online Subset Selection using α-Core with no Augmented Regretcited by 0
- 2025Optimistic Learning for Communication Networkscited by 0
- 2025On the Dynamic Regret of Following the Regularized Leader: Optimism with History Pruning28 May 2025
- 2025Optimistic Learning for Communication Networks4 Apr 2025
- 2025Efficient and Optimal No-Regret Caching under Partial Observation4 Mar 2025
- 2024An Online Gradient-Based Caching Policy with Logarithmic Complexity and Regret Guarantees2 May 2024
- 2024Optimistic Online Non-stochastic Control via FTRL4 Apr 2024
- 2024Fair Resource Allocation in Virtualized O-RAN Platforms17 Feb 2024
- 2023Adaptive Online Non-stochastic Control2 Oct 2023
- 2023No-Regret Caching with Noisy Request Estimates5 Sep 2023
- 2023No-regret Algorithms for Fair Resource Allocation11 Mar 2023
- 2022Online Subset Selection using α-Core with no Augmented Regret28 Sep 2022