mlsanityData to 14 Oct 2026

A Complete Expressiveness Hierarchy for Subgraph GNNs via Subgraph Weisfeiler-Lehman Tests

arXiv 2302.07090 ↗First posted 14 Feb 2023cs.LG cs.CC cs.GTcited by 64

Not on the map. Why?

Abstract (arXiv)

Recently, subgraph GNNs have emerged as an important direction for developing expressive graph neural networks (GNNs). While numerous architectures have been proposed, so far there is still a limited understanding of how various design paradigms differ in terms of expressive power, nor is it clear what design principle achieves maximal expressiveness with minimal architectural complexity. To address these fundamental questions, this paper conducts a systematic study of general node-based subgraph GNNs through the lens of Subgraph Weisfeiler-Lehman Tests (SWL). Our central result is to build a complete hierarchy of SWL with strictly growing expressivity. Concretely, we prove that any node-based subgraph GNN falls into one of the six SWL equivalence classes, among which mathsfSSWL achieves the maximal expressive power. We also study how these equivalence classes differ in terms of their practical expressiveness such as encoding graph distance and biconnectivity. Furthermore, we give a tight expressivity upper bound of all SWL algorithms by establishing a close relation with localized versions of WL and Folklore WL (FWL) tests. Our results provide insights into the power of existing subgraph GNNs, guide the design of new architectures, and point out their limitations by revealing an inherent gap with the 2-FWL test. Finally, experiments demonstrate that mathsfSSWL-inspired subgraph GNNs can significantly outperform prior architectures on multiple benchmarks despite great simplicity.

Key facts. Cited by 64 papers in the map (data through 14 Oct 2026). Builds on 41 of its 59 references that are in the map. First posted on arXiv 14 Feb 2023.

Builds on

41 of 59 references.

References · 41

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  3. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  4. 2017Graph Attention Networkscited by 8,923
  5. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
  6. 2017Inductive Representation Learning on Large Graphscited by 6,320
  7. 2018How Powerful are Graph Neural Networks?cited by 4,393
  8. 2017Neural Message Passing for Quantum Chemistrycited by 3,487
  9. 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,434
  10. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
  11. 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 713
  12. 2020Benchmarking Graph Neural Networkscited by 680
29 more
  1. 2020Principal Neighbourhood Aggregation for Graph Netscited by 478
  2. 2021Rethinking Graph Transformers with Spectral Attentioncited by 473
  3. 2021ASAM: Adaptive Sharpness-Aware Minimization for Scale-Invariant Learning of Deep Neural Networkscited by 293
  4. 2020Can Graph Neural Networks Count Substructures?cited by 236
  5. 2021Weisfeiler and Lehman Go Topological: Message Passing Simplicial Networkscited by 221
  6. 2021Weisfeiler and Lehman Go Cellular: CW Networkscited by 218
  7. 2019Position-aware Graph Neural Networkscited by 203
  8. 2022Structure-Aware Transformer for Graph Representation Learningcited by 194
  9. 2022Sign and Basis Invariant Networks for Spectral Graph Representation Learningcited by 179
  10. 2021From Stars to Subgraphs: Uplifting Any GNN with Local Structure Awarenesscited by 155
  11. 2021Equivariant Subgraph Aggregation Networkscited by 154
  12. 2021Nested Graph Neural Networkscited by 137
  13. 2023Rethinking the Expressive Power of GNNs via Graph Biconnectivitycited by 119
  14. 2021DropGNN: Random Dropouts Increase the Expressiveness of Graph Neural Networkscited by 118
  15. 2022Understanding and Extending Subgraph GNNs by Rethinking Their Symmetriescited by 112
  16. 2021Breaking the Limits of Message Passing Graph Neural Networkscited by 101
  17. 2020Expressive Power of Invariant and Equivariant Graph Neural Networkscited by 100
  18. 2020Building powerful and equivariant graph neural networks with structural message-passingcited by 97
  19. 2021Reconstruction for Powerful Graph Representationscited by 65
  20. 2022Expressiveness and Approximation Properties of Graph Neural Networkscited by 64
  21. 2022Ordered Subgraph Aggregation Networkscited by 57
  22. 2022Boosting the Cycle Counting Power of Graph Neural Networks with I2-GNNscited by 56
  23. 2022Your Transformer May Not be as Powerful as You Expectcited by 55
  24. 2021Graph Neural Networks with Local Graph Parameterscited by 52
  25. 2022A Theoretical Comparison of Graph Neural Network Extensionscited by 48
  26. 2022SpeqNets: Sparsity-aware Permutation-equivariant Graph Networkscited by 37
  27. 2022A Practical, Progressively-Expressive GNNcited by 20
  28. 2019Weisfeiler and Leman go sparse: Towards scalable higher-order graph embeddingscited by 9
  29. 2020Distance Encoding: Design Provably More Powerful Neural Networks for Graph Representation Learningcited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 15; 2024: 23; 2025: 20; 2026: 6.

64 papers.

Sort:

By area:

  1. 2023One for All: Towards Training One Graph Model for All Classification Taskscited by 243
  2. 2024Graph Mamba: Towards Learning on Graphs with State Space Modelscited by 86
  3. 2024GOFA: A Generative One-For-All Model for Joint Graph Language Modelingcited by 57
  4. 2023Rethinking Tokenizer and Decoder in Masked Graph Modeling for Moleculescited by 49
  5. 2024Beyond Weisfeiler-Lehman: A Quantitative Framework for GNN Expressivenesscited by 39
  6. 2023An Empirical Study of Realized GNN Expressivenesscited by 33
  7. 2024How Do Large Language Models Understand Graph Patterns? A Benchmark for Graph Pattern Comprehensioncited by 30
  8. 2024A Canonicalization Perspective on Invariant and Equivariant Learningcited by 27
  9. 2024Unifying Generation and Prediction on Graphs with Latent Graph Diffusioncited by 25
  10. 2023Embedding in Recommender Systems: A Surveycited by 20
  11. 2023From Relational Pooling to Subgraph GNNs: A Universal Framework for More Expressive Graph Neural Networkscited by 17
  12. 2023Efficient Subgraph GNNs by Learning Effective Selection Policiescited by 17
38 more
  1. 2023Approximately Equivariant Graph Networkscited by 16
  2. 2024Homomorphism Counts for Graph Neural Networks: All About That Basiscited by 16
  3. 2024On the Expressive Power of Spectral Invariant Graph Neural Networkscited by 15
  4. 2023Facilitating Graph Neural Networks with Random Walk on Simplicial Complexescited by 14
  5. 2023Extending the Design Space of Graph Neural Networks by Rethinking Folklore Weisfeiler-Lehmancited by 13
  6. 2024Weisfeiler-Leman at the margin: When more expressivity matterscited by 13
  7. 2023Distance-Restricted Folklore Weisfeiler-Leman GNNs with Provable Cycle Counting Powercited by 12
  8. 2023MAG-GNN: Reinforcement Learning Boosted Graph Neural Networkcited by 11
  9. 2024On the Completeness of Invariant Geometric Deep Learning Modelscited by 11
  10. 2025Flock: A Knowledge Graph Foundation Model via Learning on Random Walkscited by 9
  11. 2024Subgraphormer: Unifying Subgraph GNNs and Graph Transformers via Graph Productscited by 8
  12. 2024A Flexible, Equivariant Framework for Subgraph GNNs via Graph Products and Graph Coarseningcited by 8
  13. 2024GRANOLA: Adaptive Normalization for Graph Neural Networkscited by 7
  14. 2024Future Directions in the Theory of Graph Machine Learningcited by 6
  15. 2025Balancing Efficiency and Expressiveness: Subgraph GNNs with Walk-Based Centralitycited by 5
  16. 2023Improving Graph Neural Networks on Multi-node Tasks with the Labeling Trickcited by 4
  17. 2023PyTorch Geometric High Order: A Unified Library for High Order Graph Neural Networkcited by 4
  18. 2024Graph as Point Setcited by 4
  19. 2024Demystifying Higher-Order Graph Neural Networkscited by 4
  20. 2025Homomorphism Expressivity of Spectral Invariant Graph Neural Networkscited by 4
  21. 2024SpikeGraphormer: A High-Performance Graph Transformer with Spiking Graph Attentioncited by 3
  22. 2024Foundations and Frontiers of Graph Learning Theorycited by 3
  23. 2025Do Graph Diffusion Models Accurately Capture and Generate Substructure Distributions?cited by 3
  24. 2025Plain Transformers Can be Powerful Graph Learnerscited by 3
  25. 2025Spectral Graph Neural Networks are Incomplete on Graphs with a Simple Spectrumcited by 3
  26. 2025Logical Expressiveness of Graph Neural Networks with Hierarchical Node Individualizationcited by 3
  27. 2025MoSE: Unveiling Structural Patterns in Graphs via Mixture of Subgraph Expertscited by 3
  28. 2025Are Graph Transformers Necessary? Efficient Long-Range Message Passing with Fractal Nodes in MPNNscited by 3
  29. 2023Flood and Echo Net: Algorithmically Aligned GNNs that Generalizecited by 2
  30. 2024DiGRAF: Diffeomorphic Graph-Adaptive Activation Functioncited by 2
  31. 2024Towards Stable, Globally Expressive Graph Representations with Laplacian Eigenvectorscited by 2
  32. 2025Using Random Noise Equivariantly to Boost Graph Neural Networks Universallycited by 2
  33. 2025On the Interplay between Graph Structure and Learning Algorithms in Graph Neural Networkscited by 2
  34. 2025Relieving the Over-Aggregating Effect in Graph Transformerscited by 2
  35. 2024Generalization of Graph Neural Networks through the Lens of Homomorphismcited by 1
  36. 2024Fine-Grained Expressive Power of Weisfeiler-Leman: A Homomorphism Counting Perspectivecited by 1
  37. 2025Wide & Deep Learning for Node Classificationcited by 1
  38. 2025Studying and Improving Graph Neural Network-based Motif Estimationcited by 1

50 most cited of 64 All 64 (JSON)