mlsanityData to 7 Oct 2026

Rethinking Spectral Graph Neural Networks with Spatially Adaptive Filtering

arXiv 2401.09071 ↗First posted 17 Jan 2024cs.LG cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

Whilst spectral Graph Neural Networks (GNNs) are theoretically well-founded in the spectral domain, their practical reliance on polynomial approximation implies a profound linkage to the spatial domain. As previous studies rarely examine spectral GNNs from the spatial perspective, their spatial-domain interpretability remains elusive, e.g., what information is essentially encoded by spectral GNNs in the spatial domain? In this paper, to answer this question, we establish a theoretical connection between spectral filtering and spatial aggregation, unveiling an intrinsic interaction that spectral filtering implicitly leads the original graph to an adapted new graph, explicitly computed for spatial aggregation. Both theoretical and empirical investigations reveal that the adapted new graph not only exhibits non-locality but also accommodates signed edge weights to reflect label consistency among nodes. These findings thus highlight the interpretable role of spectral GNNs in the spatial domain and inspire us to rethink graph spectral filters beyond the fixed-order polynomials, which neglect global information. Built upon the theoretical findings, we revisit the state-of-the-art spectral GNNs and propose a novel Spatially Adaptive Filtering (SAF) framework, which leverages the adapted new graph by spectral filtering for an auxiliary non-local aggregation. Notably, our proposed SAF comprehensively models both node similarity and dissimilarity from a global perspective, therefore alleviating persistent deficiencies of GNNs related to long-range dependencies and graph heterophily. Extensive experiments over 13 node classification benchmarks demonstrate the superiority of our proposed framework to the state-of-the-art models.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 67 of its 110 references that are in the map. First posted on arXiv 17 Jan 2024.

Builds on

67 of 110 references.

References · 67

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  4. 2017Inductive Representation Learning on Large Graphscited by 6,284
  5. 2017Neural Message Passing for Quantum Chemistrycited by 3,460
  6. 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
  7. 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
  8. 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
  9. 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
  10. 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,571
  11. 2018Predict then Propagate: Graph Neural Networks meet Personalized PageRankcited by 987
  12. 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 970
38 more
  1. 2020Simple and Deep Graph Convolutional Networkscited by 857
  2. 2020Geom-GCN: Geometric Graph Convolutional Networkscited by 821
  3. 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 702
  4. 2020Benchmarking Graph Neural Networkscited by 672
  5. 2020A Survey on Knowledge Graphs: Representation, Acquisition and Applicationscited by 643
  6. 2020Adaptive Universal Generalized PageRank Graph Neural Networkcited by 592
  7. 2019Multi-scale Attributed Node Embeddingcited by 543
  8. 2021Rethinking Graph Transformers with Spectral Attentioncited by 468
  9. 2021Beyond Low-frequency Information in Graph Convolutional Networkscited by 361
  10. 2023A critical look at the evaluation of GNNs under heterophily: Are we really making progress?cited by 332
  11. 2021Large Scale Learning on Non-Homophilous Graphs: New Benchmarks and Strong Simple Methodscited by 309
  12. 2023NodeFormer: A Scalable Graph Structure Learning Transformer for Node Classificationcited by 207
  13. 2017CayleyNets: Graph Convolutional Neural Networks with Complex Rational Spectral Filterscited by 203
  14. 2021BernNet: Learning Arbitrary Graph Spectral Filters via Bernstein Approximationcited by 195
  15. 2022Pure Transformers are Powerful Graph Learnerscited by 188
  16. 2019Graph Neural Networks with convolutional ARMA filterscited by 185
  17. 2022Finding Global Homophily in Graph Neural Networks When Meeting Heterophilycited by 179
  18. 2022Sign and Basis Invariant Networks for Spectral Graph Representation Learningcited by 176
  19. 2022Graph Neural Networks for Graphs with Heterophily: A Surveycited by 175
  20. 2022How Powerful are Spectral Graph Neural Networkscited by 169
  21. 2020Machine Learning on Graphs: A Model and Comprehensive Taxonomycited by 156
  22. 2021A Survey of Graph Neural Networks for Recommender Systems: Challenges, Methods, and Directionscited by 144
  23. 2021Interpreting and Unifying Graph Neural Networks with An Optimization Frameworkcited by 131
  24. 2020AM-GCN: Adaptive Multi-channel Graph Convolutional Networkscited by 121
  25. 2020A Unified View on Graph Neural Networks as Graph Signal Denoisingcited by 110
  26. 2021PDE-GCN: Novel Architectures for Graph Neural Networks Motivated by Partial Differential Equationscited by 106
  27. 2023Specformer: Spectral Graph Neural Networks Meet Transformerscited by 102
  28. 2022Equivariant and Stable Positional Encoding for More Powerful Graph Neural Networkscited by 94
  29. 2020Non-Local Graph Neural Networkscited by 91
  30. 2022Convolutional Neural Networks on Graphs with Chebyshev Approximation, Revisitedcited by 87
  31. 2021New Benchmarks for Learning on Non-Homophilous Graphscited by 81
  32. 2019LanczosNet: Multi-Scale Deep Graph Convolutional Networkscited by 73
  33. 2022Characterizing Graph Datasets for Node Classification: Homophily-Heterophily Dichotomy and Beyondcited by 60
  34. 2020Graph Geometry Interaction Learningcited by 55
  35. 2021How Framelets Enhance Graph Neural Networkscited by 46
  36. 2023A Fractional Graph Laplacian Approach to Oversmoothingcited by 45
  37. 2021AdaGNN: Graph Neural Networks with Adaptive Frequency Response Filtercited by 43
  38. 2023Graph Neural Networks with Learnable and Optimal Polynomial Basescited by 36

50 most cited of 67 All 67 (JSON)

Built on by

Cited by year

Citing papers per year: 2024: 2; 2025: 1.

3 papers.