Rethinking Spectral Graph Neural Networks with Spatially Adaptive Filtering
Not on the map. Why?
Abstract (arXiv)
Whilst spectral Graph Neural Networks (GNNs) are theoretically well-founded in the spectral domain, their practical reliance on polynomial approximation implies a profound linkage to the spatial domain. As previous studies rarely examine spectral GNNs from the spatial perspective, their spatial-domain interpretability remains elusive, e.g., what information is essentially encoded by spectral GNNs in the spatial domain? In this paper, to answer this question, we establish a theoretical connection between spectral filtering and spatial aggregation, unveiling an intrinsic interaction that spectral filtering implicitly leads the original graph to an adapted new graph, explicitly computed for spatial aggregation. Both theoretical and empirical investigations reveal that the adapted new graph not only exhibits non-locality but also accommodates signed edge weights to reflect label consistency among nodes. These findings thus highlight the interpretable role of spectral GNNs in the spatial domain and inspire us to rethink graph spectral filters beyond the fixed-order polynomials, which neglect global information. Built upon the theoretical findings, we revisit the state-of-the-art spectral GNNs and propose a novel Spatially Adaptive Filtering (SAF) framework, which leverages the adapted new graph by spectral filtering for an auxiliary non-local aggregation. Notably, our proposed SAF comprehensively models both node similarity and dissimilarity from a global perspective, therefore alleviating persistent deficiencies of GNNs related to long-range dependencies and graph heterophily. Extensive experiments over 13 node classification benchmarks demonstrate the superiority of our proposed framework to the state-of-the-art models.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 67 of its 110 references that are in the map. First posted on arXiv 17 Jan 2024.
Builds on
67 of 110 references.
References · 67
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2017Neural Message Passing for Quantum Chemistrycited by 3,460
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
- 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
- 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
- 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,571
- 2018Predict then Propagate: Graph Neural Networks meet Personalized PageRankcited by 987
- 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 970
38 more
- 2020Simple and Deep Graph Convolutional Networkscited by 857
- 2020Geom-GCN: Geometric Graph Convolutional Networkscited by 821
- 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 702
- 2020Benchmarking Graph Neural Networkscited by 672
- 2020A Survey on Knowledge Graphs: Representation, Acquisition and Applicationscited by 643
- 2020Adaptive Universal Generalized PageRank Graph Neural Networkcited by 592
- 2019Multi-scale Attributed Node Embeddingcited by 543
- 2021Rethinking Graph Transformers with Spectral Attentioncited by 468
- 2021Beyond Low-frequency Information in Graph Convolutional Networkscited by 361
- 2023A critical look at the evaluation of GNNs under heterophily: Are we really making progress?cited by 332
- 2021Large Scale Learning on Non-Homophilous Graphs: New Benchmarks and Strong Simple Methodscited by 309
- 2023NodeFormer: A Scalable Graph Structure Learning Transformer for Node Classificationcited by 207
- 2017CayleyNets: Graph Convolutional Neural Networks with Complex Rational Spectral Filterscited by 203
- 2021BernNet: Learning Arbitrary Graph Spectral Filters via Bernstein Approximationcited by 195
- 2022Pure Transformers are Powerful Graph Learnerscited by 188
- 2019Graph Neural Networks with convolutional ARMA filterscited by 185
- 2022Finding Global Homophily in Graph Neural Networks When Meeting Heterophilycited by 179
- 2022Sign and Basis Invariant Networks for Spectral Graph Representation Learningcited by 176
- 2022Graph Neural Networks for Graphs with Heterophily: A Surveycited by 175
- 2022How Powerful are Spectral Graph Neural Networkscited by 169
- 2020Machine Learning on Graphs: A Model and Comprehensive Taxonomycited by 156
- 2021A Survey of Graph Neural Networks for Recommender Systems: Challenges, Methods, and Directionscited by 144
- 2021Interpreting and Unifying Graph Neural Networks with An Optimization Frameworkcited by 131
- 2020AM-GCN: Adaptive Multi-channel Graph Convolutional Networkscited by 121
- 2020A Unified View on Graph Neural Networks as Graph Signal Denoisingcited by 110
- 2021PDE-GCN: Novel Architectures for Graph Neural Networks Motivated by Partial Differential Equationscited by 106
- 2023Specformer: Spectral Graph Neural Networks Meet Transformerscited by 102
- 2022Equivariant and Stable Positional Encoding for More Powerful Graph Neural Networkscited by 94
- 2020Non-Local Graph Neural Networkscited by 91
- 2022Convolutional Neural Networks on Graphs with Chebyshev Approximation, Revisitedcited by 87
- 2021New Benchmarks for Learning on Non-Homophilous Graphscited by 81
- 2019LanczosNet: Multi-Scale Deep Graph Convolutional Networkscited by 73
- 2022Characterizing Graph Datasets for Node Classification: Homophily-Heterophily Dichotomy and Beyondcited by 60
- 2020Graph Geometry Interaction Learningcited by 55
- 2021How Framelets Enhance Graph Neural Networkscited by 46
- 2023A Fractional Graph Laplacian Approach to Oversmoothingcited by 45
- 2021AdaGNN: Graph Neural Networks with Adaptive Frequency Response Filtercited by 43
- 2023Graph Neural Networks with Learnable and Optimal Polynomial Basescited by 36
50 most cited of 67 All 67 (JSON)
Built on by
Citing papers per year: 2024: 2; 2025: 1.
3 papers.
- 2024Infinite-Horizon Graph Filters: Leveraging Power Series to Enhance Sparse Information Aggregationcited by 2
- 2024GSpect: Spectral Filtering for Cross-Scale Graph Classificationcited by 0
- 2025Graph Neural Network-based Spectral Filtering Mechanism for Imbalance Classification in Network Digital Twincited by 0
- 2025Graph Neural Network-based Spectral Filtering Mechanism for Imbalance Classification in Network Digital Twin17 Feb 2025
- 2024GSpect: Spectral Filtering for Cross-Scale Graph Classification31 Aug 2024
- 2024Infinite-Horizon Graph Filters: Leveraging Power Series to Enhance Sparse Information Aggregation18 Jan 2024