mlsanityData to 7 Oct 2026

Beyond Weisfeiler-Lehman: A Quantitative Framework for GNN Expressiveness

arXiv 2401.08514 ↗First posted 16 Jan 2024cs.LG cs.DM cs.DScited by 38

Not on the map. Why?

Abstract (arXiv)

Designing expressive Graph Neural Networks (GNNs) is a fundamental topic in the graph learning community. So far, GNN expressiveness has been primarily assessed via the Weisfeiler-Lehman (WL) hierarchy. However, such an expressivity measure has notable limitations: it is inherently coarse, qualitative, and may not well reflect practical requirements (e.g., the ability to encode substructures). In this paper, we introduce a unified framework for quantitatively studying the expressiveness of GNN architectures, addressing all the above limitations. Specifically, we identify a fundamental expressivity measure termed homomorphism expressivity, which quantifies the ability of GNN models to count graphs under homomorphism. Homomorphism expressivity offers a complete and practical assessment tool: the completeness enables direct expressivity comparisons between GNN models, while the practicality allows for understanding concrete GNN abilities such as subgraph counting. By examining four classes of prominent GNNs as case studies, we derive simple, unified, and elegant descriptions of their homomorphism expressivity for both invariant and equivariant settings. Our results provide novel insights into a series of previous work, unify the landscape of different subareas in the community, and settle several open questions. Empirically, extensive experiments on both synthetic and real-world tasks verify our theory, showing that the practical performance of GNN models aligns well with the proposed metric.

Key facts. Cited by 38 papers in the map (data through 7 Oct 2026). Builds on 58 of its 96 references that are in the map. First posted on arXiv 16 Jan 2024.

Builds on

58 of 96 references.

References · 58

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  3. 2017Graph Attention Networkscited by 8,854
  4. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  5. 2017Inductive Representation Learning on Large Graphscited by 6,284
  6. 2018How Powerful are Graph Neural Networks?cited by 4,355
  7. 2017Neural Message Passing for Quantum Chemistrycited by 3,460
  8. 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
  9. 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
  10. 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 702
  11. 2020Benchmarking Graph Neural Networkscited by 672
  12. 2020A Generalization of Transformer Networks to Graphscited by 653
38 more
  1. 2020Principal Neighbourhood Aggregation for Graph Netscited by 477
  2. 2021Rethinking Graph Transformers with Spectral Attentioncited by 468
  3. 2017Residual Gated Graph ConvNetscited by 341
  4. 2021Graph Neural Networks with Learnable Structural and Positional Representationscited by 326
  5. 2020Can Graph Neural Networks Count Substructures?cited by 235
  6. 2021Weisfeiler and Lehman Go Topological: Message Passing Simplicial Networkscited by 219
  7. 2021Weisfeiler and Lehman Go Cellular: CW Networkscited by 218
  8. 2022Structure-Aware Transformer for Graph Representation Learningcited by 191
  9. 2019Universal Invariant and Equivariant Graph Neural Networkscited by 182
  10. 2022Sign and Basis Invariant Networks for Spectral Graph Representation Learningcited by 176
  11. 2019On the equivalence between graph isomorphism testing and function approximation with GNNscited by 172
  12. 2021Equivariant Subgraph Aggregation Networkscited by 154
  13. 2021From Stars to Subgraphs: Uplifting Any GNN with Local Structure Awarenesscited by 154
  14. 2021Nested Graph Neural Networkscited by 136
  15. 2021Weisfeiler and Leman go Machine Learning: The Story so farcited by 121
  16. 2023Rethinking the Expressive Power of GNNs via Graph Biconnectivitycited by 119
  17. 2021DropGNN: Random Dropouts Increase the Expressiveness of Graph Neural Networkscited by 117
  18. 2022Understanding and Extending Subgraph GNNs by Rethinking Their Symmetriescited by 112
  19. 2021Breaking the Limits of Message Passing Graph Neural Networkscited by 101
  20. 2020Expressive Power of Invariant and Equivariant Graph Neural Networkscited by 100
  21. 2020Building powerful and equivariant graph neural networks with structural message-passingcited by 95
  22. 2022How Powerful are K-hop Message Passing Graph Neural Networkscited by 90
  23. 2021Topological Graph Neural Networkscited by 86
  24. 2021Reconstruction for Powerful Graph Representationscited by 65
  25. 2023A Complete Expressiveness Hierarchy for Subgraph GNNs via Subgraph Weisfeiler-Lehman Testscited by 64
  26. 2022Expressiveness and Approximation Properties of Graph Neural Networkscited by 63
  27. 2022Ordered Subgraph Aggregation Networkscited by 57
  28. 2022Your Transformer May Not be as Powerful as You Expectcited by 55
  29. 2021Graph Neural Networks with Local Graph Parameterscited by 51
  30. 2022A Theoretical Comparison of Graph Neural Network Extensionscited by 47
  31. 2022Message passing all the way upcited by 47
  32. 2022Shortest Path Networks for Graph Property Predictioncited by 46
  33. 2021Autobahn: Automorphism-based Graph Neural Netscited by 39
  34. 2023Equivariant Polynomials for Graph Neural Networkscited by 38
  35. 2022SpeqNets: Sparsity-aware Permutation-equivariant Graph Networkscited by 37
  36. 2019Alchemy: A Quantum Chemistry Dataset for Benchmarking AI Modelscited by 36
  37. 2023Path Neural Networks: Expressive and Accurate Graph Neural Networkscited by 32
  38. 2022A Practical, Progressively-Expressive GNNcited by 20

50 most cited of 58 All 58 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 19; 2025: 11; 2026: 8.

38 papers.

Sort:

  1. 2024Position: Graph Foundation Models are Already Herecited by 84
  2. 2024GFT: Graph Foundation Model with Transferable Tree Vocabularycited by 82
  3. 2024GraphArena: Evaluating and Exploring Large Language Models on Graph Computationcited by 48
  4. 2024Towards Graph Foundation Models: Learning Generalities Across Graphs via Task-Treescited by 30
  5. 2024A Canonicalization Perspective on Invariant and Equivariant Learningcited by 25
  6. 2025Beyond Message Passing: Neural Graph Pattern Machinecited by 17
  7. 2024Homomorphism Counts for Graph Neural Networks: All About That Basiscited by 16
  8. 2024On the Expressive Power of Spectral Invariant Graph Neural Networkscited by 15
  9. 2024Revisiting Random Walks for Learning on Graphscited by 13
  10. 2024Towards Bridging Generalization and Expressivity of Graph Neural Networkscited by 12
  11. 2025Generative Graph Pattern Machinecited by 11
  12. 2024Homomorphism Counts as Structural Encodings for Graph Learningcited by 6
26 more
  1. 2025Semantic Refinement with LLMs for Graph Representationscited by 6
  2. 2024Higher-Order Topological Directionality and Directed Simplicial Neural Networkscited by 5
  3. 2024Demystifying Higher-Order Graph Neural Networkscited by 4
  4. 2024Towards Graph Foundation Models: A Study on the Generalization of Positional and Structural Encodingscited by 4
  5. 2025Homomorphism Expressivity of Spectral Invariant Graph Neural Networkscited by 4
  6. 2025Graph Representational Learning: When Does More Expressivity Hurt Generalization?cited by 4
  7. 2025On Universality Classes of Equivariant Networkscited by 4
  8. 2026Multi-Domain Riemannian Graph Gluing for Building Graph Foundation Modelscited by 4
  9. 2024Foundations and Frontiers of Graph Learning Theorycited by 3
  10. 2024Weisfeiler and Leman Go Loopy: A New Hierarchy for Graph Representational Learningcited by 2
  11. 2024Separation Power of Equivariant Neural Networkscited by 2
  12. 2025Generalization Performance of Hypergraph Neural Networkscited by 2
  13. 2025Plain Transformers Can be Powerful Graph Learnerscited by 2
  14. 2024Enhancing Graph Neural Networks in Large-scale Traffic Incident Analysis with Concurrency Hypothesiscited by 1
  15. 2025What Expressivity Theory Misses: Message Passing Complexity for GNNscited by 1
  16. 2026Position: Don't be Afraid of Over-Smoothing And Over-Squashingcited by 1
  17. 2026FloydNet: A Learning Paradigm for Global Relational Reasoningcited by 1
  18. 2024Towards Dynamic Graph Neural Networks with Provably High-Order Expressive Powercited by 0
  19. 2024Fine-Grained Expressive Power of Weisfeiler-Leman: A Homomorphism Counting Perspectivecited by 0
  20. 2025On The Expressive Power of GNN Derivativescited by 0
  21. 2025Connectivity-Guided Sparsification of 2-FWL GNNs: Preserving Full Expressivity with Improved Efficiencycited by 0
  22. 2026A Boolean Function-Theoretic Framework for Expressivity in GNNs with Applications to Fair Graph Miningcited by 0
  23. 2026Unifying approach to uniform expressivity of graph neural networkscited by 0
  24. 2026Weisfeiler Lehman Test on Combinatorial Complexes: Generalized Expressive Power of Topological Neural Networkscited by 0
  25. 2026Full-Spectrum Graph Neural Networks: Expressive and Scalablecited by 0
  26. 2026Edge-Level Automorphism in GNNs: A Quantitative Framework and Effective Designs For Link Predictioncited by 0