Phases, Modalities, Temporal and Spatial Locality: Domain Specific ML Prefetcher for Accelerating Graph Analytics
Not on the map. Why?
Abstract (arXiv)
Memory performance is a bottleneck in graph analytics acceleration. Existing Machine Learning (ML) prefetchers struggle with phase transitions and irregular memory accesses in graph processing. We propose MPGraph, an ML-based Prefetcher for Graph analytics using domain specific models. MPGraph introduces three novel optimizations: soft detection for phase transitions, phase-specific multi-modality models for access delta and page predictions, and chain spatio-temporal prefetching (CSTP) for prefetch control. Our transition detector achieves 34.17-82.15% higher precision compared with Kolmogorov-Smirnov Windowing and decision tree. Our predictors achieve 6.80-16.02% higher F1-score for delta and 11.68-15.41% higher accuracy-at-10 for page prediction compared with LSTM and vanilla attention models. Using CSTP, MPGraph achieves 12.52-21.23% IPC improvement, outperforming state-of-the-art non-ML prefetcher BO by 7.58-12.03% and ML-based prefetchers Voyager and TransFetch by 3.27-4.58%. For practical implementation, we demonstrate MPGraph using compressed models with reduced latency shows significantly superior accuracy and coverage compared with BO, leading to 3.58% higher IPC improvement.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 21 of its 94 references that are in the map. First posted on arXiv 10 Dec 2022.
Builds on
21 of 94 references.
References · 21
- 2017Attention Is All You Needcited by 59,932
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
- 2020Knowledge Distillation: A Surveycited by 1,578
- 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,004
- 2020Learning under Concept Drift: A Reviewcited by 470
- 2020Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlationcited by 420
- 2021Attention Bottlenecks for Multimodal Fusioncited by 361
- 2018Model compression via distillation and quantizationcited by 287
- 2019Informed Machine Learning -- A Taxonomy and Survey of Integrating Knowledge into Learning Systemscited by 203
- 2016Theory-guided Data Science: A New Paradigm for Scientific Discovery from Datacited by 169
- 2021Graph Learning: A Surveycited by 140
9 more
- 2021Incorporating Domain Knowledge into Deep Neural Networkscited by 56
- 2020Reactive Soft Prototype Computing for Concept Drift Streamscited by 39
- 2018Learning Memory Access Patternscited by 28
- 2021SISA: Set-Centric Instruction Set Architecture for Graph Mining on Processing-in-Memory Systemscited by 17
- 2014GraphLab: A New Framework For Parallel Machine Learningcited by 8
- 2019An Empirical Guide to the Behavior and Use of Scalable Persistent Memorycited by 5
- 2022Fine-Grained Address Segmentation for Attention-Based Variable-Degree Prefetchingcited by 5
- 2015GraphMat: High performance graph analytics made productivecited by 3
- 2017Accelerating PageRank using Partition-Centric Processingcited by 2
Built on by
Citing papers per year: 2023: 1.
1 paper.