mlsanityData to 7 Oct 2026

Pythia: A Customizable Hardware Prefetching Framework Using Online Reinforcement Learning

arXiv 2109.12021 ↗First posted 24 Sep 2021cs.AR cs.LGcited by 17

Not on the map. Why?

Abstract (arXiv)

Past research has proposed numerous hardware prefetching techniques, most of which rely on exploiting one specific type of program context information (e.g., program counter, cacheline address) to predict future memory accesses. These techniques either completely neglect a prefetcher's undesirable effects (e.g., memory bandwidth usage) on the overall system, or incorporate system-level feedback as an afterthought to a system-unaware prefetch algorithm. We show that prior prefetchers often lose their performance benefit over a wide range of workloads and system configurations due to their inherent inability to take multiple different types of program context and system-level feedback information into account while prefetching. In this paper, we make a case for designing a holistic prefetch algorithm that learns to prefetch using multiple different types of program context and system-level feedback information inherent to its design. To this end, we propose Pythia, which formulates the prefetcher as a reinforcement learning agent. For every demand request, Pythia observes multiple different types of program context information to make a prefetch decision. For every prefetch decision, Pythia receives a numerical reward that evaluates prefetch quality under the current memory bandwidth usage. Pythia uses this reward to reinforce the correlation between program context information and prefetch decision to generate highly accurate, timely, and system-aware prefetch requests in the future. Our extensive evaluations using simulation and hardware synthesis show that Pythia outperforms multiple state-of-the-art prefetchers over a wide range of workloads and system configurations, while incurring only 1.03% area overhead over a desktop-class processor and no software changes in workloads. The source code of Pythia can be freely downloaded from https://github.com/CMU-SAFARI/Pythia.

Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Builds on 8 of its 145 references that are in the map. First posted on arXiv 24 Sep 2021.

Builds on

8 of 145 references.

References · 8

  1. 2020ConfuciuX: Autonomous Hardware Resource Assignment for DNN Accelerators using Reinforcement Learningcited by 35
  2. 2018Learning Memory Access Patternscited by 28
  3. 2020An Imitation Learning Approach for Cache Replacementcited by 24
  4. 2019Learning Execution through Neural Code Fusioncited by 13
  5. 2021Accelerating Deep Learning Inference via Learned Cachescited by 8
  6. 2019Improving Branch Prediction By Modeling Global History with Convolutional Neural Networkscited by 4
  7. 2019DSPatch: Dual Spatial Pattern Prefetchercited by 4
  8. 2021Branch Prediction as a Reinforcement Learning Problem: Why, How and Case Studiescited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 5; 2023: 1; 2024: 1; 2025: 4; 2026: 6.

17 papers.

Sort:

By area:

  1. 2022Sibyl: Adaptive and Extensible Data Placement in Hybrid Storage Systems Using Online Reinforcement Learningcited by 8
  2. 2022Hermes: Accelerating Long-Latency Load Requests via Perceptron-Based Off-Chip Load Predictioncited by 3
  3. 2022Puppeteer: A Random Forest-based Manager for Hardware Prefetchers across the Memory Hierarchycited by 2
  4. 2022DeepSketch: A New Machine Learning-Based Reference Search Technique for Post-Deduplication Delta Compressioncited by 1
  5. 2024SwiftRL: Towards Efficient Reinforcement Learning on Real Processing-In-Memory Systemscited by 1
  6. 2025Harmonia: Enhancing Data Placement and Migration in Hybrid Storage Systems via Multi-Agent Reinforcement Learningcited by 1
  7. 2025Coordinated Reinforcement Learning Prefetching Architecture for Multicore Systemscited by 1
  8. 2025A Joint Learning Approach to Hardware Caching and Prefetchingcited by 1
  9. 2026Athena: Synergizing Data Prefetching and Off-Chip Prediction via Online Reinforcement Learningcited by 1
  10. 2026Agentic Architect: An Agentic AI Framework for Architecture Design Exploration and Optimizationcited by 1
  11. 2022Cello: Efficient Computer Systems Optimization with Predictive Early Termination and Censored Regressioncited by 0
  12. 2023DeePref: Deep Reinforcement Learning For Video Prefetching In Content Delivery Networkscited by 0
5 more
  1. 2025Artificial Intelligence-Driven Network-on-Chip Design Space Exploration: Neural Network Architectures for Designcited by 0
  2. 2026Rudder: Steering Prefetching in Distributed GNN Training using LLM Agentscited by 0
  3. 2026Machine Learning-Driven Intelligent Memory System Design: From On-Chip Caches to Storagecited by 0
  4. 2026ReLMXEL: Adaptive RL-Based Memory Controller with Explainable Energy and Latency Optimizationcited by 0
  5. 2026ArchAgent v2: A Case Study with the Data Prefetching Championshipcited by 0