# A Systematic Survey of General Sparse Matrix-Matrix Multiplication

arXiv: https://arxiv.org/abs/2002.11273 · HTML: https://mlsanity.com/paper/2002.11273/

## Key facts

- Cited by 10 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 26 Feb 2020.

## Built on by (most cited first, 10 of 10)

- [A Survey on Deep Learning Hardware Accelerators for Heterogeneous HPC Platforms](https://mlsanity.com/paper/2306.15552/) (2023)
- [SPLAT: A framework for optimised GPU code-generation for SParse reguLar ATtention](https://mlsanity.com/paper/2407.16847/) (2024)
- [Cross-Task Affinity Learning for Multitask Dense Scene Predictions](https://mlsanity.com/paper/2401.11124/) (2024)
- [BLaST: High Performance Inference and Pretraining using BLock Sparse Transformers](https://mlsanity.com/paper/2507.03117/) (2025)
- [Global Clipper: Enhancing Safety and Reliability of Transformer-based Object Detection Models](https://mlsanity.com/paper/2406.03229/) (2024)
- [Federated learning with distributed fixed design quantum chips and quantum channels](https://mlsanity.com/paper/2401.13421/) (2024)
- [Prediction by Machine Learning Analysis of Genomic Data Phenotypic Frost Tolerance in Perccottus glenii](https://mlsanity.com/paper/2410.08867/) (2024)
- [AIRES: Accelerating Out-of-Core GCNs via Algorithm-System Co-Design](https://mlsanity.com/paper/2507.02006/) (2025)
- [Can Large Language Models Recover Semantic Optimization Opportunities That Compilers Miss?](https://mlsanity.com/paper/2608.03983/) (2026)
- [Removing the Compute Bottleneck for Event-based Visual Place Recognition with Spiking Neural Networks](https://mlsanity.com/paper/2610.16022/) (2026)

## Abstract (arXiv)

General Sparse Matrix-Matrix Multiplication (SpGEMM) has attracted much attention from researchers in graph analyzing, scientific computing, and deep learning. Many optimization techniques have been developed for different applications and computing architectures over the past decades. The objective of this paper is to provide a structured and comprehensive overview of the researches on SpGEMM. Existing researches have been grouped into different categories based on target architectures and design choices. Covered topics include typical applications, compression formats, general formulations, key problems and techniques, architecture-oriented optimizations, and programming models. The rationales of different algorithms are analyzed and summarized. This survey sufficiently reveals the latest progress of SpGEMM research to 2021. Moreover, a thorough performance comparison of existing implementations is presented. Based on our findings, we highlight future research directions, which encourage better design and implementations in later studies.