SIGMA: An Efficient Heterophilous Graph Neural Network with Fast Global Aggregation
Not on the map. Why?
Abstract (arXiv)
Graph neural networks (GNNs) realize great success in graph learning but suffer from performance loss when meeting heterophily, i.e. neighboring nodes are dissimilar, due to their local and uniform aggregation. Existing attempts of heterophilous GNNs incorporate long-range or global aggregations to distinguish nodes in the graph. However, these aggregations usually require iteratively maintaining and updating full-graph information, which limits their efficiency when applying to large-scale graphs. In this paper, we propose SIGMA, an efficient global heterophilous GNN aggregation integrating the structural similarity measurement SimRank. Our theoretical analysis illustrates that SIGMA inherently captures distant global similarity even under heterophily, that conventional approaches can only achieve after iterative aggregations. Furthermore, it enjoys efficient one-time computation with a complexity only linear to the node set size O(n). Comprehensive evaluation demonstrates that SIGMA achieves state-of-the-art performance with superior aggregation and overall efficiency. Notably, it obtains 5× acceleration on the large-scale heterophily dataset pokec with over 30 million edges compared to the best baseline aggregation.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 31 of its 53 references that are in the map. First posted on arXiv 17 May 2023.
Builds on
31 of 53 references.
References · 31
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2019Simplifying Graph Convolutional Networkscited by 1,477
- 2018Predict then Propagate: Graph Neural Networks meet Personalized PageRankcited by 993
- 2018Representation Learning on Graphs with Jumping Knowledge Networkscited by 877
- 2020Simple and Deep Graph Convolutional Networkscited by 860
- 2020Geom-GCN: Geometric Graph Convolutional Networkscited by 826
- 2020Adaptive Universal Generalized PageRank Graph Neural Networkcited by 595
- 2019Multi-scale Attributed Node Embeddingcited by 548
- 2019Cluster-GCN: An Efficient Algorithm for Training Deep and Large Graph Convolutional Networkscited by 541
- 2019MixHop: Higher-Order Graph Convolutional Architectures via Sparsified Neighborhood Mixingcited by 443
19 more
- 2019Diffusion Improves Graph Learningcited by 414
- 2017Deep Gaussian Embedding of Graphs: Unsupervised Inductive Learning via Rankingcited by 335
- 2021Large Scale Learning on Non-Homophilous Graphs: New Benchmarks and Strong Simple Methodscited by 311
- 2022Finding Global Homophily in Graph Neural Networks When Meeting Heterophilycited by 179
- 2020Scaling Graph Neural Networks with Approximate PageRankcited by 174
- 2019On the Use of ArXiv as a Datasetcited by 103
- 2021Breaking the Limit of Graph Neural Networks by Improving the Assortativity of Graphs with Local Mixing Patternscited by 95
- 2020Non-Local Graph Neural Networkscited by 91
- 2020Scalable Graph Neural Networks via Bidirectional Propagationcited by 87
- 2021GBK-GNN: Gated Bi-Kernel Graph Neural Networks for Modeling Both Homophily and Heterophilycited by 84
- 2021Is Heterophily A Real Nightmare For Graph Neural Networks To Do Node Classification?cited by 82
- 2021Graph Pointer Neural Networkscited by 27
- 2022Spiking Graph Convolutional Networkscited by 27
- 2021Approximate Graph Propagationcited by 21
- 2022SCARA: Scalable Graph Neural Networks with Feature-Oriented Optimizationcited by 19
- 2020CAST: A Correlation-based Adaptive Spectral Clustering Algorithm on Multi-scale Datacited by 7
- 2022GSim: A Graph Neural Network based Relevance Measure for Heterogeneous Graphscited by 2
- 2020Exact Single-Source SimRank Computation on Large Graphscited by 1
- 2023Massively Parallel Single-Source SimRanks in o(log n) Roundscited by 1
Built on by
Citing papers per year: 2023: 1; 2024: 5; 2025: 2; 2026: 2.
10 papers.
- 2024Position: Graph Foundation Models are Already Herecited by 86
- 2023Revisiting Link Prediction: A Data Perspectivecited by 29
- 2024LLM as Prompter: Low-resource Inductive Reasoning on Arbitrary Knowledge Graphscited by 13
- 2024A Comprehensive Benchmark on Spectral GNNs: The Impact on Efficiency, Memory, and Effectivenesscited by 6
- 2024Towards Graph Foundation Models: Training on Knowledge Graphs Enables Transferability to General Graphscited by 6
- 2025MoSE: Unveiling Structural Patterns in Graphs via Mixture of Subgraph Expertscited by 3
- 2024Unifews: You Need Fewer Operations for Efficient Graph Neural Networkscited by 2
- 2026LION: A Clifford Neural Paradigm for Multimodal-Attributed Graph Learningcited by 2
- 2025When Deepfake Detection Meets Graph Neural Network:a Unified and Lightweight Learning Frameworkcited by 1
- 2026LION: A Clifford Neural Paradigm for Multimodal-Attributed Graph Learningcited by 0
- 2026LION: A Clifford Neural Paradigm for Multimodal-Attributed Graph Learning25 Aug 2026
- 2026LION: A Clifford Neural Paradigm for Multimodal-Attributed Graph Learning29 Jan 2026
- 2025MoSE: Unveiling Structural Patterns in Graphs via Mixture of Subgraph Experts11 Sep 2025
- 2025When Deepfake Detection Meets Graph Neural Network:a Unified and Lightweight Learning Framework7 Aug 2025
- 2024Towards Graph Foundation Models: Training on Knowledge Graphs Enables Transferability to General Graphs16 Oct 2024
- 2024A Comprehensive Benchmark on Spectral GNNs: The Impact on Efficiency, Memory, and Effectiveness14 Jun 2024
- 2024Unifews: You Need Fewer Operations for Efficient Graph Neural Networks20 Mar 2024
- 2024LLM as Prompter: Low-resource Inductive Reasoning on Arbitrary Knowledge Graphs19 Feb 2024
- 2024Position: Graph Foundation Models are Already Here3 Feb 2024
- 2023Revisiting Link Prediction: A Data Perspective1 Oct 2023