HyGCN: A GCN Accelerator with Hybrid Architecture
Not on the map. Why?
Abstract (arXiv)
In this work, we first characterize the hybrid execution patterns of GCNs on Intel Xeon CPU. Guided by the characterization, we design a GCN accelerator, HyGCN, using a hybrid architecture to efficiently perform GCNs. Specifically, first, we build a new programming model to exploit the fine-grained parallelism for our hardware design. Second, we propose a hardware design with two efficient processing engines to alleviate the irregularity of Aggregation phase and leverage the regularity of Combination phase. Besides, these engines can exploit various parallelism and reuse highly reusable data efficiently. Third, we optimize the overall system via inter-engine pipeline for inter-phase fusion and priority-based off-chip memory access coordination to improve off-chip bandwidth utilization. Compared to the state-of-the-art software framework running on Intel Xeon CPU and NVIDIA V100 GPU, our work achieves on average 1509× speedup with 2500× energy reduction and average 6.5× speedup with 10× energy reduction, respectively.
Key facts. Cited by 73 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Jan 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 17; 2022: 24; 2023: 17; 2024: 9; 2025: 5; 2026: 1.
73 papers.
Sort:
By area:
- 2021A Unified Lottery Ticket Hypothesis for Graph Neural Networkscited by 118
- 2022Trustworthy Graph Neural Networks: Aspects, Methods and Trendscited by 88
- 2021Accelerating Large Scale Real-Time GNN Inference using Channel Pruningcited by 41
- 2021Sampling methods for efficient training of graph convolutional networks: A surveycited by 40
- 2021FLAT: An Optimized Dataflow for Mitigating Attention Bottleneckscited by 38
- 2022Parallel and Distributed Graph Neural Networks: An In-Depth Concurrency Analysiscited by 29
- 2021Understanding GNN Computational Graph: A Coordinated Computation, IO, and Memory Perspectivecited by 28
- 2021Early-Bird GCNs: Graph-Network Co-Optimization Towards More Efficient GCN Training and Inference via Drawing Early-Bird Lottery Ticketscited by 27
- 2022Survey on Graph Neural Network Acceleration: An Algorithmic Perspectivecited by 26
- 2023MaxK-GNN: Extremely Fast GPU Kernel Design for Accelerating Graph Neural Networks Trainingcited by 25
- 2022I-GCN: A Graph Convolutional Network Accelerator with Runtime Locality Enhancement through Islandizationcited by 21
- 2021Do We Need Anisotropic Graph Neural Networks?cited by 18
38 more
- 2023A Survey on Graph Neural Network Acceleration: Algorithms, Systems, and Customized Hardwarecited by 18
- 2021Graph Neural Networks for Charged Particle Tracking on FPGAscited by 17
- 2022MGG: Accelerating Graph Neural Networks with Fine-grained intra-kernel Communication-Computation Pipelining on Multi-GPU Platformscited by 16
- 2021G-CoS: GNN-Accelerator Co-Search Towards Both Better Accuracy and Efficiencycited by 15
- 2022A Comprehensive Survey on Distributed Training of Graph Neural Networkscited by 15
- 2021GCoD: Graph Convolutional Network Acceleration via Dedicated Algorithm and Accelerator Co-Designcited by 12
- 2022Model-Architecture Co-Design for High Performance Temporal GNN Inference on FPGAcited by 12
- 2022Graph Neural Networks in Particle Physics: Implementations, Innovations, and Challengescited by 12
- 2022SmartSAGE: Training Large-scale Graph Neural Networks using In-Storage Processing Architecturescited by 12
- 2022LL-GNN: Low Latency Graph Neural Networks on FPGAs for High Energy Physicscited by 12
- 2021BlockGNN: Towards Efficient GNN Acceleration Using Block-Circulant Weight Matricescited by 11
- 2022Neural Graph Databasescited by 11
- 2022GNN at the Edge: Cost-Efficient Graph Neural Network Processing over Distributed Edge Serverscited by 11
- 2022FlowGNN: A Dataflow Architecture for Real-Time Workload-Agnostic Graph Neural Network Inferencecited by 10
- 2023Accurate, Low-latency, Efficient SAR Automatic Target Recognition on FPGAcited by 10
- 2023HOT: Higher-Order Dynamic Graph Representation Learning with Efficient Transformerscited by 10
- 2022GenGNN: A Generic FPGA Framework for Graph Neural Network Accelerationcited by 9
- 2023MaGNAS: A Mapping-Aware Graph Neural Architecture Search Framework for Heterogeneous MPSoC Deploymentcited by 9
- 2022Characterizing and Understanding Distributed GNN Training on GPUscited by 7
- 2023GHOST: A Graph Neural Network Accelerator using Silicon Photonicscited by 7
- 2021GNNSampler: Bridging the Gap between Sampling Algorithms of GNN and Hardwarecited by 6
- 2021GNNear: Accelerating Full-Batch Training of Graph Neural Networks with Near-Memory Processingcited by 6
- 2022SUGAR: Efficient Subgraph-level Training via Resource-aware Graph Partitioningcited by 6
- 2023Semi-decentralized Inference in Heterogeneous Graph Neural Networks for Traffic Demand Forecasting: An Edge-Computing Approachcited by 5
- 2022GROW: A Row-Stationary Sparse-Dense GEMM Accelerator for Memory-Efficient Graph Convolutional Neural Networkscited by 4
- 2023SGCN: Exploiting Compressed-Sparse Features in Deep Graph Convolutional Network Acceleratorscited by 4
- 2021VersaGNN: a Versatile accelerator for Graph neural networkscited by 3
- 2021GNNIE: GNN Inference Engine with Load-balancing and Graph-Specific Cachingcited by 3
- 2024HDReason: Algorithm-Hardware Codesign for Hyperdimensional Knowledge Graph Reasoningcited by 3
- 2021LW-GCN: A Lightweight FPGA-based Graph Convolutional Network Acceleratorcited by 2
- 2022Bottleneck Analysis of Dynamic Graph Neural Network Inference on CPU and GPUcited by 2
- 2023Exploiting On-chip Heterogeneity of Versal Architecture for GNN Inference Accelerationcited by 2
- 2023InkStream: Real-time GNN Inference on Streaming Graphs via Incremental Updatecited by 2
- 2023Architectural Implications of GNN Aggregation Programming Abstractionscited by 2
- 2023GraNNDis: Efficient Unified Distributed Training Framework for Deep GNNs on Large Clusterscited by 2
- 2023Multicoated and Folded Graph Neural Networks with Strong Lottery Ticketscited by 2
- 2024GCV-Turbo: End-to-end Acceleration of GNN-based Computer Vision Tasks on FPGAcited by 2
- 2024Edge Graph Intelligence: Reciprocally Empowering Edge Networks with Graph Intelligencecited by 2
50 most cited of 73 All 73 (JSON)
- 2026GraphLeap: Decoupling Graph Construction and Convolution for Vision GNN Acceleration on FPGA23 Apr 2026
- 2025HePGA: A Heterogeneous Processing-in-Memory based GNN Training Accelerator22 Aug 2025
- 2025Bit-Flip Fault Attack: Crushing Graph Neural Networks via Gradual Bit Search7 Jul 2025
- 2025Efficient GNN Training Through Structure-Aware Randomized Mini-Batching25 Apr 2025
- 2025AMPLE: Event-Driven Accelerator for Mixed-Precision Inference of Graph Neural Networks28 Feb 2025
- 2025MixGCN: Scalable GCN Training by Mixture of Parallelism and Mixture of Accelerators3 Jan 2025
- 2024Accelerating Sparse Graph Neural Networks with Tensor Core Optimization16 Dec 2024
- 2024A Data-Driven Approach to Dataflow-Aware Online Scheduling for Graph Neural Network Inference25 Nov 2024
- 2024SiHGNN: Leveraging Properties of Semantic Graphs for Efficient HGNN Acceleration27 Aug 2024
- 2024Edge Graph Intelligence: Reciprocally Empowering Edge Networks with Graph Intelligence7 Jul 2024
- 2024NeuraChip: Accelerating GNN Computations with a Hash-based Decoupled Spatial Accelerator23 Apr 2024
- 2024GCV-Turbo: End-to-end Acceleration of GNN-based Computer Vision Tasks on FPGA10 Apr 2024
38 more
- 2024HDReason: Algorithm-Hardware Codesign for Hyperdimensional Knowledge Graph Reasoning9 Mar 2024
- 2024Single-GPU GNN Systems: Traps and Pitfalls5 Feb 2024
- 2024Accelerating Neural Networks for Large Language Models and Graph Processing with Silicon Photonics12 Jan 2024
- 2023MaxK-GNN: Extremely Fast GPU Kernel Design for Accelerating Graph Neural Networks Training14 Dec 2023
- 2023Multicoated and Folded Graph Neural Networks with Strong Lottery Tickets6 Dec 2023
- 2023HOT: Higher-Order Dynamic Graph Representation Learning with Efficient Transformers30 Nov 2023
- 2023GraNNDis: Efficient Unified Distributed Training Framework for Deep GNNs on Large Clusters12 Nov 2023
- 2023Architectural Implications of GNN Aggregation Programming Abstractions18 Oct 2023
- 2023InkStream: Real-time GNN Inference on Streaming Graphs via Incremental Update20 Sep 2023
- 2023Accelerating Generic Graph Neural Networks via Architecture, Compiler, Partition Method Co-Design16 Aug 2023
- 2023Exploiting On-chip Heterogeneity of Versal Architecture for GNN Inference Acceleration4 Aug 2023
- 2023MaGNAS: A Mapping-Aware Graph Neural Architecture Search Framework for Heterogeneous MPSoC Deployment16 Jul 2023
- 2023GHOST: A Graph Neural Network Accelerator using Silicon Photonics4 Jul 2023
- 2023A Survey on Graph Neural Network Acceleration: Algorithms, Systems, and Customized Hardware24 Jun 2023
- 2023Low Latency Edge Classification GNN for Particle Trajectory Tracking on FPGAs20 Jun 2023
- 2023GNNBuilder: An Automated Framework for Generic Graph Neural Network Accelerator Generation, Simulation, and Optimization29 Mar 2023
- 2023Semi-decentralized Inference in Heterogeneous Graph Neural Networks for Traffic Demand Forecasting: An Edge-Computing Approach28 Feb 2023
- 2023SGCN: Exploiting Compressed-Sparse Features in Deep Graph Convolutional Network Accelerators25 Jan 2023
- 2023Slice-and-Forge: Making Better Use of Caches for Graph Convolutional Network Accelerators24 Jan 2023
- 2023Accurate, Low-latency, Efficient SAR Automatic Target Recognition on FPGA4 Jan 2023
- 2022A Comprehensive Survey on Distributed Training of Graph Neural Networks10 Nov 2022
- 2022GNN at the Edge: Cost-Efficient Graph Neural Network Processing over Distributed Edge Servers31 Oct 2022
- 2022gSuite: A Flexible and Framework Independent Benchmark Suite for Graph Neural Network Inference on GPUs20 Oct 2022
- 2022Bottleneck Analysis of Dynamic Graph Neural Network Inference on CPU and GPU8 Oct 2022
- 2022LL-GNN: Low Latency Graph Neural Networks on FPGAs for High Energy Physics28 Sep 2022
- 2022Neural Graph Databases20 Sep 2022
- 2022MGG: Accelerating Graph Neural Networks with Fine-grained intra-kernel Communication-Computation Pipelining on Multi-GPU Platforms14 Sep 2022
- 2022Hardware Acceleration of Sampling Algorithms in Sample and Aggregate Graph Neural Networks7 Sep 2022
- 2022Analysis and Optimization of GNN-Based Recommender Systems on Persistent Memory25 Jul 2022
- 2022H-GCN: A Graph Convolutional Network Accelerator on Versal ACAP Architecture28 Jun 2022
- 2022Parallel and Distributed Graph Neural Networks: An In-Depth Concurrency Analysis19 May 2022
- 2022Trustworthy Graph Neural Networks: Aspects, Methods and Trends16 May 2022
- 2022COIN: Communication-Aware In-Memory Acceleration for Graph Convolutional Networks15 May 2022
- 2022SmartSAGE: Training Large-scale Graph Neural Networks using In-Storage Processing Architectures10 May 2022
- 2022FlowGNN: A Dataflow Architecture for Real-Time Workload-Agnostic Graph Neural Network Inference27 Apr 2022
- 2022Characterizing and Understanding Distributed GNN Training on GPUs18 Apr 2022
- 2022Graph Neural Networks in Particle Physics: Implementations, Innovations, and Challenges23 Mar 2022
- 2022Model-Architecture Co-Design for High Performance Temporal GNN Inference on FPGA10 Mar 2022
50 newest of 73 All 73 (JSON)
- 2021A Unified Lottery Ticket Hypothesis for Graph Neural Networkscited by 118
- 2022Trustworthy Graph Neural Networks: Aspects, Methods and Trendscited by 88
- 2021Accelerating Large Scale Real-Time GNN Inference using Channel Pruningcited by 41
- 2021Sampling methods for efficient training of graph convolutional networks: A surveycited by 40
- 2021FLAT: An Optimized Dataflow for Mitigating Attention Bottleneckscited by 38
- 2022Parallel and Distributed Graph Neural Networks: An In-Depth Concurrency Analysiscited by 29
- 2021Understanding GNN Computational Graph: A Coordinated Computation, IO, and Memory Perspectivecited by 28
- 2021Early-Bird GCNs: Graph-Network Co-Optimization Towards More Efficient GCN Training and Inference via Drawing Early-Bird Lottery Ticketscited by 27
- 2022Survey on Graph Neural Network Acceleration: An Algorithmic Perspectivecited by 26
- 2023MaxK-GNN: Extremely Fast GPU Kernel Design for Accelerating Graph Neural Networks Trainingcited by 25
- 2022I-GCN: A Graph Convolutional Network Accelerator with Runtime Locality Enhancement through Islandizationcited by 21
- 2021Do We Need Anisotropic Graph Neural Networks?cited by 18
12 most cited of 72 All 72 (JSON)
- 2026GraphLeap: Decoupling Graph Construction and Convolution for Vision GNN Acceleration on FPGA23 Apr 2026
- 2025HePGA: A Heterogeneous Processing-in-Memory based GNN Training Accelerator22 Aug 2025
- 2025Bit-Flip Fault Attack: Crushing Graph Neural Networks via Gradual Bit Search7 Jul 2025
- 2025Efficient GNN Training Through Structure-Aware Randomized Mini-Batching25 Apr 2025
- 2025AMPLE: Event-Driven Accelerator for Mixed-Precision Inference of Graph Neural Networks28 Feb 2025
- 2025MixGCN: Scalable GCN Training by Mixture of Parallelism and Mixture of Accelerators3 Jan 2025
- 2024Accelerating Sparse Graph Neural Networks with Tensor Core Optimization16 Dec 2024
- 2024A Data-Driven Approach to Dataflow-Aware Online Scheduling for Graph Neural Network Inference25 Nov 2024
- 2024SiHGNN: Leveraging Properties of Semantic Graphs for Efficient HGNN Acceleration27 Aug 2024
- 2024Edge Graph Intelligence: Reciprocally Empowering Edge Networks with Graph Intelligence7 Jul 2024
- 2024NeuraChip: Accelerating GNN Computations with a Hash-based Decoupled Spatial Accelerator23 Apr 2024
- 2024GCV-Turbo: End-to-end Acceleration of GNN-based Computer Vision Tasks on FPGA10 Apr 2024
12 newest of 72 All 72 (JSON)