mlsanityData to 7 Oct 2026

Graph Learning Should Move Beyond Restrictive Views of Spectral and Message-Passing GNNs

arXiv 2602.10031 ↗First posted 10 Feb 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Graph neural networks (GNNs) are commonly divided into message-passing neural networks (MPNNs) and spectral GNNs, reflecting two largely separate research traditions in machine learning and signal processing. While MPNNs have a precise definition, there is no widely accepted criterion for what makes a mapping a spectral GNN. Most existing work restricts spectral GNNs to layered architectures based on linear spectral filters. Under this restriction, we show that spectral and spatial GNNs have largely equivalent expressive power. To promote progress in the field, we propose a precise definition of spectral GNNs based on eigenbasis symmetries, in contrast to the definition of MPNNs via neighborhood permutation symmetries. We further argue that the two perspectives offer complementary strengths. MPNNs provide a natural language for discrete structure and expressivity analysis through tools from logic and graph isomorphism, while the spectral perspective offers principled tools for understanding smoothing, bottlenecks, stability, and community structure. Overall, we argue that progress in graph learning will be accelerated by clarifying the similarities and differences between these perspectives and by moving toward a unified theoretical framework.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 97 of its 122 references that are in the map. First posted on arXiv 10 Feb 2026.

Builds on

97 of 122 references.

References · 97

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  2. 2017Graph Attention Networkscited by 8,854
  3. 2017Inductive Representation Learning on Large Graphscited by 6,284
  4. 2018How Powerful are Graph Neural Networks?cited by 4,355
  5. 2017Neural Message Passing for Quantum Chemistrycited by 3,460
  6. 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
  7. 2017Deep Setscited by 1,394
  8. 2018Graph Convolutional Neural Networks for Web-Scale Recommender Systemscited by 1,133
  9. 2013Spectral Networks and Locally Connected Networks on Graphscited by 1,097
  10. 2016Geometric deep learning: going beyond Euclidean datacited by 1,042
  11. 2018Weisfeiler and Leman Go Neural: Higher-order Graph Neural Networkscited by 878
  12. 2015Convolutional Networks on Graphs for Learning Molecular Fingerprintscited by 751
38 more
  1. 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 702
  2. 2020A Generalization of Transformer Networks to Graphscited by 653
  3. 2020On the Bottleneck of Graph Neural Networks and its Practical Implicationscited by 624
  4. 2019DeepGCNs: Can GCNs Go as Deep as CNNs?cited by 527
  5. 2021Understanding over-squashing and bottlenecks on graphs via curvaturecited by 471
  6. 2016Geometric deep learning on graphs and manifolds using mixture model CNNscited by 468
  7. 2017Graph Signal Processing: Overview, Challenges and Applicationscited by 409
  8. 2019Provably Powerful Graph Networkscited by 385
  9. 2020Improving Graph Neural Network Expressivity via Subgraph Isomorphism Countingcited by 312
  10. 2021Combinatorial optimization and reasoning with graph neural networkscited by 267
  11. 2023A Survey on Oversmoothing in Graph Neural Networkscited by 246
  12. 2020A Note on Over-Smoothing for Graph Neural Networkscited by 245
  13. 2020Generalization and Representational Limits of Graph Neural Networkscited by 217
  14. 2017CayleyNets: Graph Convolutional Neural Networks with Complex Rational Spectral Filterscited by 203
  15. 2019What graph neural networks cannot learn: depth vs widthcited by 195
  16. 2020The Surprising Power of Graph Neural Networks with Random Node Initializationcited by 190
  17. 2020Random Features Strengthen Graph Neural Networkscited by 184
  18. 2022Sign and Basis Invariant Networks for Spectral Graph Representation Learningcited by 176
  19. 2022How Powerful are Spectral Graph Neural Networkscited by 169
  20. 2021Frame Averaging for Invariant and Equivariant Network Designcited by 166
  21. 2023On Over-Squashing in Message Passing Neural Networks: The Impact of Width, Depth, and Topologycited by 163
  22. 2019What Can Neural Networks Reason About?cited by 155
  23. 2019AliGraph: A Comprehensive Graph Neural Network Platformcited by 152
  24. 2020DistDGL: Distributed Graph Neural Network Training for Billion-Scale Graphscited by 139
  25. 2019Stability Properties of Graph Neural Networkscited by 125
  26. 2021Weisfeiler and Leman go Machine Learning: The Story so farcited by 121
  27. 2020From Local Structures to Size Generalization in Graph Neural Networkscited by 119
  28. 2023Artificial Intelligence for Science in Quantum, Atomistic, and Continuum Systemscited by 118
  29. 2020Graphon Neural Networks and the Transferability of Graph Neural Networkscited by 117
  30. 2022Understanding and Extending Subgraph GNNs by Rethinking Their Symmetriescited by 112
  31. 2022Equivariance with Learned Canonicalization Functionscited by 106
  32. 2018Convolutional Neural Network Architectures for Signals Supported on Graphscited by 94
  33. 2023Understanding Oversquashing in GNNs through the Lens of Effective Resistancecited by 94
  34. 2021Neural Algorithmic Reasoningcited by 92
  35. 2019Transferability of Spectral Graph Convolutional Neural Networkscited by 90
  36. 2024RelBench: A Benchmark for Deep Learning on Relational Databasescited by 90
  37. 2023Edge Directionality Improves Learning on Heterophilic Graphscited by 88
  38. 2021The Logic of Graph Neural Networkscited by 84

50 most cited of 97 All 97 (JSON)

Built on by

Not cited yet.