A Complete Expressiveness Hierarchy for Subgraph GNNs via Subgraph Weisfeiler-Lehman Tests
Not on the map. Why?
Abstract (arXiv)
Recently, subgraph GNNs have emerged as an important direction for developing expressive graph neural networks (GNNs). While numerous architectures have been proposed, so far there is still a limited understanding of how various design paradigms differ in terms of expressive power, nor is it clear what design principle achieves maximal expressiveness with minimal architectural complexity. To address these fundamental questions, this paper conducts a systematic study of general node-based subgraph GNNs through the lens of Subgraph Weisfeiler-Lehman Tests (SWL). Our central result is to build a complete hierarchy of SWL with strictly growing expressivity. Concretely, we prove that any node-based subgraph GNN falls into one of the six SWL equivalence classes, among which mathsfSSWL achieves the maximal expressive power. We also study how these equivalence classes differ in terms of their practical expressiveness such as encoding graph distance and biconnectivity. Furthermore, we give a tight expressivity upper bound of all SWL algorithms by establishing a close relation with localized versions of WL and Folklore WL (FWL) tests. Our results provide insights into the power of existing subgraph GNNs, guide the design of new architectures, and point out their limitations by revealing an inherent gap with the 2-FWL test. Finally, experiments demonstrate that mathsfSSWL-inspired subgraph GNNs can significantly outperform prior architectures on multiple benchmarks despite great simplicity.
Key facts. Cited by 64 papers in the map (data through 14 Oct 2026). Builds on 41 of its 59 references that are in the map. First posted on arXiv 14 Feb 2023.
Builds on
41 of 59 references.
References · 41
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2017Neural Message Passing for Quantum Chemistrycited by 3,487
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,434
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
- 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 713
- 2020Benchmarking Graph Neural Networkscited by 680
29 more
- 2020Principal Neighbourhood Aggregation for Graph Netscited by 478
- 2021Rethinking Graph Transformers with Spectral Attentioncited by 473
- 2021ASAM: Adaptive Sharpness-Aware Minimization for Scale-Invariant Learning of Deep Neural Networkscited by 293
- 2020Can Graph Neural Networks Count Substructures?cited by 236
- 2021Weisfeiler and Lehman Go Topological: Message Passing Simplicial Networkscited by 221
- 2021Weisfeiler and Lehman Go Cellular: CW Networkscited by 218
- 2019Position-aware Graph Neural Networkscited by 203
- 2022Structure-Aware Transformer for Graph Representation Learningcited by 194
- 2022Sign and Basis Invariant Networks for Spectral Graph Representation Learningcited by 179
- 2021From Stars to Subgraphs: Uplifting Any GNN with Local Structure Awarenesscited by 155
- 2021Equivariant Subgraph Aggregation Networkscited by 154
- 2021Nested Graph Neural Networkscited by 137
- 2023Rethinking the Expressive Power of GNNs via Graph Biconnectivitycited by 119
- 2021DropGNN: Random Dropouts Increase the Expressiveness of Graph Neural Networkscited by 118
- 2022Understanding and Extending Subgraph GNNs by Rethinking Their Symmetriescited by 112
- 2021Breaking the Limits of Message Passing Graph Neural Networkscited by 101
- 2020Expressive Power of Invariant and Equivariant Graph Neural Networkscited by 100
- 2020Building powerful and equivariant graph neural networks with structural message-passingcited by 97
- 2021Reconstruction for Powerful Graph Representationscited by 65
- 2022Expressiveness and Approximation Properties of Graph Neural Networkscited by 64
- 2022Ordered Subgraph Aggregation Networkscited by 57
- 2022Boosting the Cycle Counting Power of Graph Neural Networks with I2-GNNscited by 56
- 2022Your Transformer May Not be as Powerful as You Expectcited by 55
- 2021Graph Neural Networks with Local Graph Parameterscited by 52
- 2022A Theoretical Comparison of Graph Neural Network Extensionscited by 48
- 2022SpeqNets: Sparsity-aware Permutation-equivariant Graph Networkscited by 37
- 2022A Practical, Progressively-Expressive GNNcited by 20
- 2019Weisfeiler and Leman go sparse: Towards scalable higher-order graph embeddingscited by 9
- 2020Distance Encoding: Design Provably More Powerful Neural Networks for Graph Representation Learningcited by 9
Built on by
Citing papers per year: 2023: 15; 2024: 23; 2025: 20; 2026: 6.
64 papers.
Sort:
By area:
- 2023One for All: Towards Training One Graph Model for All Classification Taskscited by 243
- 2024Graph Mamba: Towards Learning on Graphs with State Space Modelscited by 86
- 2024GOFA: A Generative One-For-All Model for Joint Graph Language Modelingcited by 57
- 2023Rethinking Tokenizer and Decoder in Masked Graph Modeling for Moleculescited by 49
- 2024Beyond Weisfeiler-Lehman: A Quantitative Framework for GNN Expressivenesscited by 39
- 2023An Empirical Study of Realized GNN Expressivenesscited by 33
- 2024How Do Large Language Models Understand Graph Patterns? A Benchmark for Graph Pattern Comprehensioncited by 30
- 2024A Canonicalization Perspective on Invariant and Equivariant Learningcited by 27
- 2024Unifying Generation and Prediction on Graphs with Latent Graph Diffusioncited by 25
- 2023Embedding in Recommender Systems: A Surveycited by 20
- 2023From Relational Pooling to Subgraph GNNs: A Universal Framework for More Expressive Graph Neural Networkscited by 17
- 2023Efficient Subgraph GNNs by Learning Effective Selection Policiescited by 17
38 more
- 2023Approximately Equivariant Graph Networkscited by 16
- 2024Homomorphism Counts for Graph Neural Networks: All About That Basiscited by 16
- 2024On the Expressive Power of Spectral Invariant Graph Neural Networkscited by 15
- 2023Facilitating Graph Neural Networks with Random Walk on Simplicial Complexescited by 14
- 2023Extending the Design Space of Graph Neural Networks by Rethinking Folklore Weisfeiler-Lehmancited by 13
- 2024Weisfeiler-Leman at the margin: When more expressivity matterscited by 13
- 2023Distance-Restricted Folklore Weisfeiler-Leman GNNs with Provable Cycle Counting Powercited by 12
- 2023MAG-GNN: Reinforcement Learning Boosted Graph Neural Networkcited by 11
- 2024On the Completeness of Invariant Geometric Deep Learning Modelscited by 11
- 2025Flock: A Knowledge Graph Foundation Model via Learning on Random Walkscited by 9
- 2024Subgraphormer: Unifying Subgraph GNNs and Graph Transformers via Graph Productscited by 8
- 2024A Flexible, Equivariant Framework for Subgraph GNNs via Graph Products and Graph Coarseningcited by 8
- 2024GRANOLA: Adaptive Normalization for Graph Neural Networkscited by 7
- 2024Future Directions in the Theory of Graph Machine Learningcited by 6
- 2025Balancing Efficiency and Expressiveness: Subgraph GNNs with Walk-Based Centralitycited by 5
- 2023Improving Graph Neural Networks on Multi-node Tasks with the Labeling Trickcited by 4
- 2023PyTorch Geometric High Order: A Unified Library for High Order Graph Neural Networkcited by 4
- 2024Graph as Point Setcited by 4
- 2024Demystifying Higher-Order Graph Neural Networkscited by 4
- 2025Homomorphism Expressivity of Spectral Invariant Graph Neural Networkscited by 4
- 2024SpikeGraphormer: A High-Performance Graph Transformer with Spiking Graph Attentioncited by 3
- 2024Foundations and Frontiers of Graph Learning Theorycited by 3
- 2025Do Graph Diffusion Models Accurately Capture and Generate Substructure Distributions?cited by 3
- 2025Plain Transformers Can be Powerful Graph Learnerscited by 3
- 2025Spectral Graph Neural Networks are Incomplete on Graphs with a Simple Spectrumcited by 3
- 2025Logical Expressiveness of Graph Neural Networks with Hierarchical Node Individualizationcited by 3
- 2025MoSE: Unveiling Structural Patterns in Graphs via Mixture of Subgraph Expertscited by 3
- 2025Are Graph Transformers Necessary? Efficient Long-Range Message Passing with Fractal Nodes in MPNNscited by 3
- 2023Flood and Echo Net: Algorithmically Aligned GNNs that Generalizecited by 2
- 2024DiGRAF: Diffeomorphic Graph-Adaptive Activation Functioncited by 2
- 2024Towards Stable, Globally Expressive Graph Representations with Laplacian Eigenvectorscited by 2
- 2025Using Random Noise Equivariantly to Boost Graph Neural Networks Universallycited by 2
- 2025On the Interplay between Graph Structure and Learning Algorithms in Graph Neural Networkscited by 2
- 2025Relieving the Over-Aggregating Effect in Graph Transformerscited by 2
- 2024Generalization of Graph Neural Networks through the Lens of Homomorphismcited by 1
- 2024Fine-Grained Expressive Power of Weisfeiler-Leman: A Homomorphism Counting Perspectivecited by 1
- 2025Wide & Deep Learning for Node Classificationcited by 1
- 2025Studying and Improving Graph Neural Network-based Motif Estimationcited by 1
50 most cited of 64 All 64 (JSON)
- 2026Edge-Level Automorphism in GNNs: A Quantitative Framework and Effective Designs For Link Prediction28 Sep 2026
- 2026Invariant-Based Weight Sharing for Message Passing25 May 2026
- 2026Weisfeiler Lehman Test on Combinatorial Complexes: Generalized Expressive Power of Topological Neural Networks1 May 2026
- 2026On the Expressive Power of GNNs to Solve Linear SDPs30 Apr 2026
- 2026A Boolean Function-Theoretic Framework for Expressivity in GNNs with Applications to Fair Graph Mining19 Jan 2026
- 2026Learning from Historical Activations in Graph Neural Networks3 Jan 2026
- 2025Branching Strategies Based on Subgraph GNNs: A Study on Theoretical Promise versus Practical Reality10 Dec 2025
- 2025Are Graph Transformers Necessary? Efficient Long-Range Message Passing with Fractal Nodes in MPNNs17 Nov 2025
- 2025Connectivity-Guided Sparsification of 2-FWL GNNs: Preserving Full Expressivity with Improved Efficiency16 Nov 2025
- 2025Relieving the Over-Aggregating Effect in Graph Transformers24 Oct 2025
- 2025On The Expressive Power of GNN Derivatives2 Oct 2025
- 2025Flock: A Knowledge Graph Foundation Model via Learning on Random Walks1 Oct 2025
38 more
- 2025MoSE: Unveiling Structural Patterns in Graphs via Mixture of Subgraph Experts11 Sep 2025
- 2025On the Interplay between Graph Structure and Learning Algorithms in Graph Neural Networks20 Aug 2025
- 2025Heat Kernel Goes Topological16 Jul 2025
- 2025Logical Expressiveness of Graph Neural Networks with Hierarchical Node Individualization16 Jun 2025
- 2025Caterpillar GNN: Replacing Message Passing with Efficient Aggregation7 Jun 2025
- 2025Spectral Graph Neural Networks are Incomplete on Graphs with a Simple Spectrum5 Jun 2025
- 2025Studying and Improving Graph Neural Network-based Motif Estimation30 May 2025
- 2025Chordless Structure: A Pathway to Simple and Expressive GNNs25 May 2025
- 2025Wide & Deep Learning for Node Classification4 May 2025
- 2025Plain Transformers Can be Powerful Graph Learners17 Apr 2025
- 2025Homomorphism Expressivity of Spectral Invariant Graph Neural Networks1 Mar 2025
- 2025Do Graph Diffusion Models Accurately Capture and Generate Substructure Distributions?4 Feb 2025
- 2025Using Random Noise Equivariantly to Boost Graph Neural Networks Universally4 Feb 2025
- 2025Balancing Efficiency and Expressiveness: Subgraph GNNs with Walk-Based Centrality6 Jan 2025
- 2024Towards Stable, Globally Expressive Graph Representations with Laplacian Eigenvectors13 Oct 2024
- 2024How Do Large Language Models Understand Graph Patterns? A Benchmark for Graph Pattern Comprehension4 Oct 2024
- 2024Fine-Grained Expressive Power of Weisfeiler-Leman: A Homomorphism Counting Perspective4 Oct 2024
- 2024GOFA: A Generative One-For-All Model for Joint Graph Language Modeling12 Jul 2024
- 2024Foundations and Frontiers of Graph Learning Theory3 Jul 2024
- 2024DiGRAF: Diffeomorphic Graph-Adaptive Activation Function2 Jul 2024
- 2024Demystifying Higher-Order Graph Neural Networks18 Jun 2024
- 2024A Flexible, Equivariant Framework for Subgraph GNNs via Graph Products and Graph Coarsening13 Jun 2024
- 2024On the Expressive Power of Spectral Invariant Graph Neural Networks6 Jun 2024
- 2024A Canonicalization Perspective on Invariant and Equivariant Learning28 May 2024
- 2024Graph as Point Set5 May 2024
- 2024GRANOLA: Adaptive Normalization for Graph Neural Networks20 Apr 2024
- 2024Graph Convolutional Network For Semi-supervised Node Classification With Subgraph Sketching19 Apr 2024
- 2024SpikeGraphormer: A High-Performance Graph Transformer with Spiking Graph Attention21 Mar 2024
- 2024Generalization of Graph Neural Networks through the Lens of Homomorphism10 Mar 2024
- 2024Graph Mamba: Towards Learning on Graphs with State Space Models13 Feb 2024
- 2024Homomorphism Counts for Graph Neural Networks: All About That Basis13 Feb 2024
- 2024Subgraphormer: Unifying Subgraph GNNs and Graph Transformers via Graph Products13 Feb 2024
- 2024Weisfeiler-Leman at the margin: When more expressivity matters12 Feb 2024
- 2024On the Completeness of Invariant Geometric Deep Learning Models7 Feb 2024
- 2024Unifying Generation and Prediction on Graphs with Latent Graph Diffusion4 Feb 2024
- 2024Future Directions in the Theory of Graph Machine Learning3 Feb 2024
- 2024Beyond Weisfeiler-Lehman: A Quantitative Framework for GNN Expressiveness16 Jan 2024
- 2023PyTorch Geometric High Order: A Unified Library for High Order Graph Neural Network28 Nov 2023
50 newest of 64 All 64 (JSON)
- 2023One for All: Towards Training One Graph Model for All Classification Taskscited by 243
- 2024GOFA: A Generative One-For-All Model for Joint Graph Language Modelingcited by 57
- 2023Rethinking Tokenizer and Decoder in Masked Graph Modeling for Moleculescited by 49
- 2024Beyond Weisfeiler-Lehman: A Quantitative Framework for GNN Expressivenesscited by 39
- 2023An Empirical Study of Realized GNN Expressivenesscited by 33
- 2024How Do Large Language Models Understand Graph Patterns? A Benchmark for Graph Pattern Comprehensioncited by 30
- 2024A Canonicalization Perspective on Invariant and Equivariant Learningcited by 27
- 2023Embedding in Recommender Systems: A Surveycited by 20
- 2023From Relational Pooling to Subgraph GNNs: A Universal Framework for More Expressive Graph Neural Networkscited by 17
- 2023Efficient Subgraph GNNs by Learning Effective Selection Policiescited by 17
- 2023Approximately Equivariant Graph Networkscited by 16
- 2024Homomorphism Counts for Graph Neural Networks: All About That Basiscited by 16
12 most cited of 61 All 61 (JSON)
- 2026Edge-Level Automorphism in GNNs: A Quantitative Framework and Effective Designs For Link Prediction28 Sep 2026
- 2026Invariant-Based Weight Sharing for Message Passing25 May 2026
- 2026Weisfeiler Lehman Test on Combinatorial Complexes: Generalized Expressive Power of Topological Neural Networks1 May 2026
- 2026On the Expressive Power of GNNs to Solve Linear SDPs30 Apr 2026
- 2026A Boolean Function-Theoretic Framework for Expressivity in GNNs with Applications to Fair Graph Mining19 Jan 2026
- 2026Learning from Historical Activations in Graph Neural Networks3 Jan 2026
- 2025Branching Strategies Based on Subgraph GNNs: A Study on Theoretical Promise versus Practical Reality10 Dec 2025
- 2025Are Graph Transformers Necessary? Efficient Long-Range Message Passing with Fractal Nodes in MPNNs17 Nov 2025
- 2025Connectivity-Guided Sparsification of 2-FWL GNNs: Preserving Full Expressivity with Improved Efficiency16 Nov 2025
- 2025Relieving the Over-Aggregating Effect in Graph Transformers24 Oct 2025
- 2025On The Expressive Power of GNN Derivatives2 Oct 2025
- 2025Flock: A Knowledge Graph Foundation Model via Learning on Random Walks1 Oct 2025
12 newest of 61 All 61 (JSON)