Beyond Weisfeiler-Lehman: A Quantitative Framework for GNN Expressiveness
Not on the map. Why?
Abstract (arXiv)
Designing expressive Graph Neural Networks (GNNs) is a fundamental topic in the graph learning community. So far, GNN expressiveness has been primarily assessed via the Weisfeiler-Lehman (WL) hierarchy. However, such an expressivity measure has notable limitations: it is inherently coarse, qualitative, and may not well reflect practical requirements (e.g., the ability to encode substructures). In this paper, we introduce a unified framework for quantitatively studying the expressiveness of GNN architectures, addressing all the above limitations. Specifically, we identify a fundamental expressivity measure termed homomorphism expressivity, which quantifies the ability of GNN models to count graphs under homomorphism. Homomorphism expressivity offers a complete and practical assessment tool: the completeness enables direct expressivity comparisons between GNN models, while the practicality allows for understanding concrete GNN abilities such as subgraph counting. By examining four classes of prominent GNNs as case studies, we derive simple, unified, and elegant descriptions of their homomorphism expressivity for both invariant and equivariant settings. Our results provide novel insights into a series of previous work, unify the landscape of different subareas in the community, and settle several open questions. Empirically, extensive experiments on both synthetic and real-world tasks verify our theory, showing that the practical performance of GNN models aligns well with the proposed metric.
Key facts. Cited by 38 papers in the map (data through 7 Oct 2026). Builds on 58 of its 96 references that are in the map. First posted on arXiv 16 Jan 2024.
Builds on
58 of 96 references.
References · 58
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2018How Powerful are Graph Neural Networks?cited by 4,355
- 2017Neural Message Passing for Quantum Chemistrycited by 3,460
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
- 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
- 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 702
- 2020Benchmarking Graph Neural Networkscited by 672
- 2020A Generalization of Transformer Networks to Graphscited by 653
38 more
- 2020Principal Neighbourhood Aggregation for Graph Netscited by 477
- 2021Rethinking Graph Transformers with Spectral Attentioncited by 468
- 2017Residual Gated Graph ConvNetscited by 341
- 2021Graph Neural Networks with Learnable Structural and Positional Representationscited by 326
- 2020Can Graph Neural Networks Count Substructures?cited by 235
- 2021Weisfeiler and Lehman Go Topological: Message Passing Simplicial Networkscited by 219
- 2021Weisfeiler and Lehman Go Cellular: CW Networkscited by 218
- 2022Structure-Aware Transformer for Graph Representation Learningcited by 191
- 2019Universal Invariant and Equivariant Graph Neural Networkscited by 182
- 2022Sign and Basis Invariant Networks for Spectral Graph Representation Learningcited by 176
- 2019On the equivalence between graph isomorphism testing and function approximation with GNNscited by 172
- 2021Equivariant Subgraph Aggregation Networkscited by 154
- 2021From Stars to Subgraphs: Uplifting Any GNN with Local Structure Awarenesscited by 154
- 2021Nested Graph Neural Networkscited by 136
- 2021Weisfeiler and Leman go Machine Learning: The Story so farcited by 121
- 2023Rethinking the Expressive Power of GNNs via Graph Biconnectivitycited by 119
- 2021DropGNN: Random Dropouts Increase the Expressiveness of Graph Neural Networkscited by 117
- 2022Understanding and Extending Subgraph GNNs by Rethinking Their Symmetriescited by 112
- 2021Breaking the Limits of Message Passing Graph Neural Networkscited by 101
- 2020Expressive Power of Invariant and Equivariant Graph Neural Networkscited by 100
- 2020Building powerful and equivariant graph neural networks with structural message-passingcited by 95
- 2022How Powerful are K-hop Message Passing Graph Neural Networkscited by 90
- 2021Topological Graph Neural Networkscited by 86
- 2021Reconstruction for Powerful Graph Representationscited by 65
- 2023A Complete Expressiveness Hierarchy for Subgraph GNNs via Subgraph Weisfeiler-Lehman Testscited by 64
- 2022Expressiveness and Approximation Properties of Graph Neural Networkscited by 63
- 2022Ordered Subgraph Aggregation Networkscited by 57
- 2022Your Transformer May Not be as Powerful as You Expectcited by 55
- 2021Graph Neural Networks with Local Graph Parameterscited by 51
- 2022A Theoretical Comparison of Graph Neural Network Extensionscited by 47
- 2022Message passing all the way upcited by 47
- 2022Shortest Path Networks for Graph Property Predictioncited by 46
- 2021Autobahn: Automorphism-based Graph Neural Netscited by 39
- 2023Equivariant Polynomials for Graph Neural Networkscited by 38
- 2022SpeqNets: Sparsity-aware Permutation-equivariant Graph Networkscited by 37
- 2019Alchemy: A Quantum Chemistry Dataset for Benchmarking AI Modelscited by 36
- 2023Path Neural Networks: Expressive and Accurate Graph Neural Networkscited by 32
- 2022A Practical, Progressively-Expressive GNNcited by 20
50 most cited of 58 All 58 (JSON)
Built on by
Citing papers per year: 2024: 19; 2025: 11; 2026: 8.
38 papers.
Sort:
- 2024Position: Graph Foundation Models are Already Herecited by 84
- 2024GFT: Graph Foundation Model with Transferable Tree Vocabularycited by 82
- 2024GraphArena: Evaluating and Exploring Large Language Models on Graph Computationcited by 48
- 2024Towards Graph Foundation Models: Learning Generalities Across Graphs via Task-Treescited by 30
- 2024A Canonicalization Perspective on Invariant and Equivariant Learningcited by 25
- 2025Beyond Message Passing: Neural Graph Pattern Machinecited by 17
- 2024Homomorphism Counts for Graph Neural Networks: All About That Basiscited by 16
- 2024On the Expressive Power of Spectral Invariant Graph Neural Networkscited by 15
- 2024Revisiting Random Walks for Learning on Graphscited by 13
- 2024Towards Bridging Generalization and Expressivity of Graph Neural Networkscited by 12
- 2025Generative Graph Pattern Machinecited by 11
- 2024Homomorphism Counts as Structural Encodings for Graph Learningcited by 6
26 more
- 2025Semantic Refinement with LLMs for Graph Representationscited by 6
- 2024Higher-Order Topological Directionality and Directed Simplicial Neural Networkscited by 5
- 2024Demystifying Higher-Order Graph Neural Networkscited by 4
- 2024Towards Graph Foundation Models: A Study on the Generalization of Positional and Structural Encodingscited by 4
- 2025Homomorphism Expressivity of Spectral Invariant Graph Neural Networkscited by 4
- 2025Graph Representational Learning: When Does More Expressivity Hurt Generalization?cited by 4
- 2025On Universality Classes of Equivariant Networkscited by 4
- 2026Multi-Domain Riemannian Graph Gluing for Building Graph Foundation Modelscited by 4
- 2024Foundations and Frontiers of Graph Learning Theorycited by 3
- 2024Weisfeiler and Leman Go Loopy: A New Hierarchy for Graph Representational Learningcited by 2
- 2024Separation Power of Equivariant Neural Networkscited by 2
- 2025Generalization Performance of Hypergraph Neural Networkscited by 2
- 2025Plain Transformers Can be Powerful Graph Learnerscited by 2
- 2024Enhancing Graph Neural Networks in Large-scale Traffic Incident Analysis with Concurrency Hypothesiscited by 1
- 2025What Expressivity Theory Misses: Message Passing Complexity for GNNscited by 1
- 2026Position: Don't be Afraid of Over-Smoothing And Over-Squashingcited by 1
- 2026FloydNet: A Learning Paradigm for Global Relational Reasoningcited by 1
- 2024Towards Dynamic Graph Neural Networks with Provably High-Order Expressive Powercited by 0
- 2024Fine-Grained Expressive Power of Weisfeiler-Leman: A Homomorphism Counting Perspectivecited by 0
- 2025On The Expressive Power of GNN Derivativescited by 0
- 2025Connectivity-Guided Sparsification of 2-FWL GNNs: Preserving Full Expressivity with Improved Efficiencycited by 0
- 2026A Boolean Function-Theoretic Framework for Expressivity in GNNs with Applications to Fair Graph Miningcited by 0
- 2026Unifying approach to uniform expressivity of graph neural networkscited by 0
- 2026Weisfeiler Lehman Test on Combinatorial Complexes: Generalized Expressive Power of Topological Neural Networkscited by 0
- 2026Full-Spectrum Graph Neural Networks: Expressive and Scalablecited by 0
- 2026Edge-Level Automorphism in GNNs: A Quantitative Framework and Effective Designs For Link Predictioncited by 0
- 2026Edge-Level Automorphism in GNNs: A Quantitative Framework and Effective Designs For Link Prediction28 Sep 2026
- 2026Full-Spectrum Graph Neural Networks: Expressive and Scalable7 May 2026
- 2026Weisfeiler Lehman Test on Combinatorial Complexes: Generalized Expressive Power of Topological Neural Networks1 May 2026
- 2026Multi-Domain Riemannian Graph Gluing for Building Graph Foundation Models28 Feb 2026
- 2026Unifying approach to uniform expressivity of graph neural networks20 Feb 2026
- 2026FloydNet: A Learning Paradigm for Global Relational Reasoning27 Jan 2026
- 2026A Boolean Function-Theoretic Framework for Expressivity in GNNs with Applications to Fair Graph Mining19 Jan 2026
- 2026Position: Don't be Afraid of Over-Smoothing And Over-Squashing12 Jan 2026
- 2025Semantic Refinement with LLMs for Graph Representations24 Dec 2025
- 2025Connectivity-Guided Sparsification of 2-FWL GNNs: Preserving Full Expressivity with Improved Efficiency16 Nov 2025
- 2025On The Expressive Power of GNN Derivatives2 Oct 2025
- 2025What Expressivity Theory Misses: Message Passing Complexity for GNNs1 Sep 2025
26 more
- 2025On Universality Classes of Equivariant Networks2 Jun 2025
- 2025Generative Graph Pattern Machine22 May 2025
- 2025Graph Representational Learning: When Does More Expressivity Hurt Generalization?16 May 2025
- 2025Plain Transformers Can be Powerful Graph Learners17 Apr 2025
- 2025Homomorphism Expressivity of Spectral Invariant Graph Neural Networks1 Mar 2025
- 2025Beyond Message Passing: Neural Graph Pattern Machine30 Jan 2025
- 2025Generalization Performance of Hypergraph Neural Networks22 Jan 2025
- 2024Towards Graph Foundation Models: Learning Generalities Across Graphs via Task-Trees21 Dec 2024
- 2024Towards Graph Foundation Models: A Study on the Generalization of Positional and Structural Encodings10 Dec 2024
- 2024GFT: Graph Foundation Model with Transferable Tree Vocabulary9 Nov 2024
- 2024Enhancing Graph Neural Networks in Large-scale Traffic Incident Analysis with Concurrency Hypothesis4 Nov 2024
- 2024Homomorphism Counts as Structural Encodings for Graph Learning24 Oct 2024
- 2024Towards Bridging Generalization and Expressivity of Graph Neural Networks14 Oct 2024
- 2024Fine-Grained Expressive Power of Weisfeiler-Leman: A Homomorphism Counting Perspective4 Oct 2024
- 2024Towards Dynamic Graph Neural Networks with Provably High-Order Expressive Power2 Oct 2024
- 2024Higher-Order Topological Directionality and Directed Simplicial Neural Networks12 Sep 2024
- 2024Foundations and Frontiers of Graph Learning Theory3 Jul 2024
- 2024Revisiting Random Walks for Learning on Graphs1 Jul 2024
- 2024GraphArena: Evaluating and Exploring Large Language Models on Graph Computation29 Jun 2024
- 2024Demystifying Higher-Order Graph Neural Networks18 Jun 2024
- 2024Separation Power of Equivariant Neural Networks13 Jun 2024
- 2024On the Expressive Power of Spectral Invariant Graph Neural Networks6 Jun 2024
- 2024A Canonicalization Perspective on Invariant and Equivariant Learning28 May 2024
- 2024Weisfeiler and Leman Go Loopy: A New Hierarchy for Graph Representational Learning20 Mar 2024
- 2024Homomorphism Counts for Graph Neural Networks: All About That Basis13 Feb 2024
- 2024Position: Graph Foundation Models are Already Here3 Feb 2024
- 2024Position: Graph Foundation Models are Already Herecited by 84
- 2024GFT: Graph Foundation Model with Transferable Tree Vocabularycited by 82
- 2024GraphArena: Evaluating and Exploring Large Language Models on Graph Computationcited by 48
- 2024Towards Graph Foundation Models: Learning Generalities Across Graphs via Task-Treescited by 30
- 2024A Canonicalization Perspective on Invariant and Equivariant Learningcited by 25
- 2025Beyond Message Passing: Neural Graph Pattern Machinecited by 17
- 2024Homomorphism Counts for Graph Neural Networks: All About That Basiscited by 16
- 2024On the Expressive Power of Spectral Invariant Graph Neural Networkscited by 15
- 2024Revisiting Random Walks for Learning on Graphscited by 13
- 2024Towards Bridging Generalization and Expressivity of Graph Neural Networkscited by 12
- 2025Generative Graph Pattern Machinecited by 11
- 2024Homomorphism Counts as Structural Encodings for Graph Learningcited by 6
12 most cited of 38 All 38 (JSON)
- 2026Edge-Level Automorphism in GNNs: A Quantitative Framework and Effective Designs For Link Prediction28 Sep 2026
- 2026Full-Spectrum Graph Neural Networks: Expressive and Scalable7 May 2026
- 2026Weisfeiler Lehman Test on Combinatorial Complexes: Generalized Expressive Power of Topological Neural Networks1 May 2026
- 2026Multi-Domain Riemannian Graph Gluing for Building Graph Foundation Models28 Feb 2026
- 2026Unifying approach to uniform expressivity of graph neural networks20 Feb 2026
- 2026FloydNet: A Learning Paradigm for Global Relational Reasoning27 Jan 2026
- 2026A Boolean Function-Theoretic Framework for Expressivity in GNNs with Applications to Fair Graph Mining19 Jan 2026
- 2026Position: Don't be Afraid of Over-Smoothing And Over-Squashing12 Jan 2026
- 2025Semantic Refinement with LLMs for Graph Representations24 Dec 2025
- 2025Connectivity-Guided Sparsification of 2-FWL GNNs: Preserving Full Expressivity with Improved Efficiency16 Nov 2025
- 2025On The Expressive Power of GNN Derivatives2 Oct 2025
- 2025What Expressivity Theory Misses: Message Passing Complexity for GNNs1 Sep 2025
12 newest of 38 All 38 (JSON)