mlsanityData to 7 Oct 2026

Phases, Modalities, Temporal and Spatial Locality: Domain Specific ML Prefetcher for Accelerating Graph Analytics

arXiv 2212.05250 ↗First posted 10 Dec 2022cs.LG cs.ARcited by 1

Not on the map. Why?

Abstract (arXiv)

Memory performance is a bottleneck in graph analytics acceleration. Existing Machine Learning (ML) prefetchers struggle with phase transitions and irregular memory accesses in graph processing. We propose MPGraph, an ML-based Prefetcher for Graph analytics using domain specific models. MPGraph introduces three novel optimizations: soft detection for phase transitions, phase-specific multi-modality models for access delta and page predictions, and chain spatio-temporal prefetching (CSTP) for prefetch control. Our transition detector achieves 34.17-82.15% higher precision compared with Kolmogorov-Smirnov Windowing and decision tree. Our predictors achieve 6.80-16.02% higher F1-score for delta and 11.68-15.41% higher accuracy-at-10 for page prediction compared with LSTM and vanilla attention models. Using CSTP, MPGraph achieves 12.52-21.23% IPC improvement, outperforming state-of-the-art non-ML prefetcher BO by 7.58-12.03% and ML-based prefetchers Voyager and TransFetch by 3.27-4.58%. For practical implementation, we demonstrate MPGraph using compressed models with reduced latency shows significantly superior accuracy and coverage compared with BO, leading to 3.58% higher IPC improvement.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 21 of its 94 references that are in the map. First posted on arXiv 10 Dec 2022.

Builds on

21 of 94 references.

References · 21

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  3. 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
  4. 2020Knowledge Distillation: A Surveycited by 1,578
  5. 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,004
  6. 2020Learning under Concept Drift: A Reviewcited by 470
  7. 2020Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlationcited by 420
  8. 2021Attention Bottlenecks for Multimodal Fusioncited by 361
  9. 2018Model compression via distillation and quantizationcited by 287
  10. 2019Informed Machine Learning -- A Taxonomy and Survey of Integrating Knowledge into Learning Systemscited by 203
  11. 2016Theory-guided Data Science: A New Paradigm for Scientific Discovery from Datacited by 169
  12. 2021Graph Learning: A Surveycited by 140
9 more
  1. 2021Incorporating Domain Knowledge into Deep Neural Networkscited by 56
  2. 2020Reactive Soft Prototype Computing for Concept Drift Streamscited by 39
  3. 2018Learning Memory Access Patternscited by 28
  4. 2021SISA: Set-Centric Instruction Set Architecture for Graph Mining on Processing-in-Memory Systemscited by 17
  5. 2014GraphLab: A New Framework For Parallel Machine Learningcited by 8
  6. 2019An Empirical Guide to the Behavior and Use of Scalable Persistent Memorycited by 5
  7. 2022Fine-Grained Address Segmentation for Attention-Based Variable-Degree Prefetchingcited by 5
  8. 2015GraphMat: High performance graph analytics made productivecited by 3
  9. 2017Accelerating PageRank using Partition-Centric Processingcited by 2

Built on by

Cited by year

Citing papers per year: 2023: 1.

1 paper.