Phases, Modalities, Temporal and Spatial Locality: Domain Specific ML Prefetcher for Accelerating Graph Analytics
Zhang, Pengmiao, Kannan, Rajgopal, Prasanna, Viktor K.
–arXiv.org Artificial Intelligence
Memory performance is a bottleneck in graph analytics acceleration. Existing Machine Learning (ML) prefetchers struggle with phase transitions and irregular memory accesses in graph processing. We propose MPGraph, an ML-based Prefetcher for Graph analytics using domain specific models. MPGraph introduces three novel optimizations: soft detection for phase transitions, phase-specific multi-modality models for access delta and page predictions, and chain spatio-temporal prefetching (CSTP) for prefetch control. Our transition detector achieves 34.17-82.15% higher precision compared with Kolmogorov-Smirnov Windowing and decision tree. Our predictors achieve 6.80-16.02% higher F1-score for delta and 11.68-15.41% higher accuracy-at-10 for page prediction compared with LSTM and vanilla attention models. Using CSTP, MPGraph achieves 12.52-21.23% IPC improvement, outperforming state-of-the-art non-ML prefetcher BO by 7.58-12.03% and ML-based prefetchers Voyager and TransFetch by 3.27-4.58%. For practical implementation, we demonstrate MPGraph using compressed models with reduced latency shows significantly superior accuracy and coverage compared with BO, leading to 3.58% higher IPC improvement.
arXiv.org Artificial Intelligence
Sep-24-2023
- Country:
- Europe (0.04)
- North America > United States
- California
- Los Angeles County > Los Angeles (0.28)
- Santa Clara County > Palo Alto (0.04)
- Colorado > Denver County
- Denver (0.05)
- New York > New York County
- New York City (0.04)
- California
- Genre:
- Research Report (0.64)
- Industry:
- Education (0.46)
- Technology: