mlsanityData to 7 Oct 2026

BitGNN: Unleashing the Performance Potential of Binary Graph Neural Networks on GPUs

arXiv 2305.02522 ↗First posted 4 May 2023cs.DC cs.LGcited by 4

Not on the map. Why?

Abstract (arXiv)

Recent studies have shown that Binary Graph Neural Networks (GNNs) are promising for saving computations of GNNs through binarized tensors. Prior work, however, mainly focused on algorithm designs or training techniques, leaving it open to how to materialize the performance potential on accelerator hardware fully. This work redesigns the binary GNN inference backend from the efficiency perspective. It fills the gap by proposing a series of abstractions and techniques to map binary GNNs and their computations best to fit the nature of bit manipulations on GPUs. Results on real-world graphs with GCNs, GraphSAGE, and GraphSAINT show that the proposed techniques outperform state-of-the-art binary GNN implementations by 8-22X with the same accuracy maintained. BitGNN code is publicly available.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 37 of its 63 references that are in the map. First posted on arXiv 4 May 2023.

Builds on

37 of 63 references.

References · 37

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  2. 2017Graph Attention Networkscited by 8,854
  3. 2017Inductive Representation Learning on Large Graphscited by 6,284
  4. 2017Neural Message Passing for Quantum Chemistrycited by 3,460
  5. 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
  6. 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
  7. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
  8. 2018Pitfalls of Graph Neural Network Evaluationcited by 994
  9. 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 970
  10. 2018Weisfeiler and Leman Go Neural: Higher-order Graph Neural Networkscited by 878
  11. 2016XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networkscited by 829
  12. 2019Graph Neural Networks for Social Recommendationcited by 711
25 more
  1. 2019GraphSAINT: Graph Sampling Based Inductive Learning Methodcited by 618
  2. 2018Graph Convolutional Networks for Text Classificationcited by 345
  3. 2018Adaptive Sampling Towards Fast Graph Representation Learningcited by 180
  4. 2017Predicting multicellular function through multi-layer tissue networkscited by 138
  5. 2016Binarized Neural Networks: Training Deep Neural Networks with Weights and Activations Constrained to +1 or -1cited by 102
  6. 2019XNOR-Net++: Improved Binary Neural Networkscited by 94
  7. 2021PokeBNN: A Binary Pursuit of Lightweight Accuracycited by 48
  8. 2020GE-SpMM: General-purpose Sparse Matrix-Matrix Multiplication on GPUs for Graph Neural Networkscited by 42
  9. 2018Accurate, Efficient and Scalable Graph Embeddingcited by 35
  10. 2020Binary Graph Neural Networkscited by 32
  11. 2018Efficient Super Resolution Using Binarized Neural Networkcited by 29
  12. 2017Attacking Binarized Neural Networkscited by 28
  13. 2020Bi-GCN: Binary Graph Convolutional Networkcited by 27
  14. 2020FusedMM: A Unified SDDMM-SpMM Kernel for Graph Embedding and Graph Neural Networkscited by 26
  15. 2021Meta-Aggregator: Learning to Aggregate for 1-bit Graph Neural Networkscited by 24
  16. 2019Hyperspectral Image Classification With Context-Aware Dynamic Graph Convolutional Networkcited by 20
  17. 2018Design Principles for Sparse Matrix Multiplication on the GPUcited by 18
  18. 2020Binarized Graph Neural Networkcited by 12
  19. 2020Accelerating Binarized Neural Networks via Bit-Tensor-Cores in Turing GPUscited by 12
  20. 2021APNN-TC: Accelerating Arbitrary Precision Neural Networks on Ampere GPU Tensor Corescited by 12
  21. 2021Predicting Basin Stability of Power Grids using Graph Neural Networkscited by 10
  22. 2021BinaryCoP: Binary Neural Network-based COVID-19 Face-Mask Wear and Positioning Predictor on Edge Devicescited by 7
  23. 2022Extreme Acceleration of Graph Neural Network-based Prediction Models for Quantum Chemistrycited by 3
  24. 2022Bit-GraphBLAS: Bit-Level Optimizations of Matrix-Centric Graph Processing on GPUcited by 2
  25. 2018Binarized Convolutional Neural Networks for Efficient Inference on GPUscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 1; 2026: 2.

4 papers.

  1. 2025Deal: Distributed End-to-End GNN Inference for All Nodescited by 1
  2. 2024Acceleration Algorithms in GNNs: A Surveycited by 0
  3. 2026Zeros can be Informative: Masked Binary U-Net for Image Segmentation on Tensor Corescited by 0
  4. 2026GraphLeap: Decoupling Graph Construction and Convolution for Vision GNN Acceleration on FPGAcited by 0