1-WL Expressiveness Is (Almost) All You Need
Not on the map. Why?
Abstract (arXiv)
It has been shown that a message passing neural networks (MPNNs), a popular family of neural networks for graph-structured data, are at most as expressive as the first-order Weisfeiler-Leman (1-WL) graph isomorphism test, which has motivated the development of more expressive architectures. In this work, we analyze if the limited expressiveness is actually a limiting factor for MPNNs and other WL-based models in standard graph datasets. Interestingly, we find that the expressiveness of WL is sufficient to identify almost all graphs in most datasets. Moreover, we find that the classification accuracy upper bounds are often close to 100%. Furthermore, we find that simple WL-based neural networks and several MPNNs can be fitted to several datasets. In sum, we conclude that the performance of WL/MPNNs is not limited by their expressiveness in practice.
Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Builds on 26 of its 39 references that are in the map. First posted on arXiv 21 Feb 2022.
Builds on
26 of 39 references.
References · 26
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,167
- 2018Weisfeiler and Leman Go Neural: Higher-order Graph Neural Networkscited by 881
- 2020TUDataset: A collection of benchmark datasets for learning with graphscited by 728
- 2020Benchmarking Graph Neural Networkscited by 680
- 2019Provably Powerful Graph Networkscited by 389
- 2020Improving Graph Neural Network Expressivity via Subgraph Isomorphism Countingcited by 313
- 2019A Fair Comparison of Graph Neural Networks for Graph Classificationcited by 244
- 2020Can Graph Neural Networks Count Substructures?cited by 236
14 more
- 2021Weisfeiler and Lehman Go Topological: Message Passing Simplicial Networkscited by 221
- 2020Generalization and Representational Limits of Graph Neural Networkscited by 218
- 2021Weisfeiler and Lehman Go Cellular: CW Networkscited by 218
- 2019What graph neural networks cannot learn: depth vs widthcited by 201
- 2020The Surprising Power of Graph Neural Networks with Random Node Initializationcited by 198
- 2020Random Features Strengthen Graph Neural Networkscited by 186
- 2019On the equivalence between graph isomorphism testing and function approximation with GNNscited by 172
- 2021Equivariant Subgraph Aggregation Networkscited by 154
- 2021Weisfeiler and Leman go Machine Learning: The Story so farcited by 122
- 2021DropGNN: Random Dropouts Increase the Expressiveness of Graph Neural Networkscited by 118
- 2020A Survey on The Expressive Power of Graph Neural Networkscited by 111
- 2021Breaking the Limits of Message Passing Graph Neural Networkscited by 101
- 2022A Short Tutorial on The Weisfeiler-Lehman Test And Its Variantscited by 52
- 2019Understanding Isomorphism Bias in Graph Data Setscited by 23
Built on by
Citing papers per year: 2022: 3; 2023: 2; 2024: 3; 2025: 5; 2026: 2.
15 papers.
Sort:
- 2022Pure Transformers are Powerful Graph Learnerscited by 188
- 2022A Generalization of ViT/MLP-Mixer to Graphscited by 93
- 2022Evaluating Self-Supervised Learning for Molecular Graph Embeddingscited by 22
- 2024Learning Graph Quantized Tokenizerscited by 19
- 2024FSW-GNN: A Bi-Lipschitz WL-Equivalent Graph Neural Networkcited by 8
- 2025Graph Representational Learning: When Does More Expressivity Hurt Generalization?cited by 5
- 2024Theoretical and Empirical Insights into the Origins of Degree Bias in Graph Neural Networkscited by 4
- 2023Graphtester: Exploring Theoretical Boundaries of GNNs on Graph Datasetscited by 3
- 2025On the Relationship Between Robustness and Expressivity of Graph Neural Networkscited by 3
- 2025What Expressivity Theory Misses: Message Passing Complexity for GNNscited by 2
- 2023Attacking Graph Neural Networks with Bit Flips: Weisfeiler and Lehman Go Indifferentcited by 0
- 2025Model-Level GNN Explanations via Rule-to-Graph Readout for Logit Reconstructioncited by 0
- 2026On the Expressive Power of Implicit Line-Graph Higher-Order Weisfeiler--Leman14 Sep 2026
- 2026Understanding Truncated Positional Encodings for Graph Neural Networks11 Jun 2026
- 2025Exact Generalisation Error Exposes Benchmarks Skew Graph Neural Networks Success (or Failure)12 Sep 2025
- 2025What Expressivity Theory Misses: Message Passing Complexity for GNNs1 Sep 2025
- 2025Graph Representational Learning: When Does More Expressivity Hurt Generalization?16 May 2025
- 2025On the Relationship Between Robustness and Expressivity of Graph Neural Networks18 Apr 2025
- 2025Model-Level GNN Explanations via Rule-to-Graph Readout for Logit Reconstruction12 Mar 2025
- 2024Learning Graph Quantized Tokenizers17 Oct 2024
- 2024FSW-GNN: A Bi-Lipschitz WL-Equivalent Graph Neural Network10 Oct 2024
- 2024Theoretical and Empirical Insights into the Origins of Degree Bias in Graph Neural Networks4 Apr 2024
- 2023Attacking Graph Neural Networks with Bit Flips: Weisfeiler and Lehman Go Indifferent2 Nov 2023
- 2023Graphtester: Exploring Theoretical Boundaries of GNNs on Graph Datasets30 Jun 2023
3 more
- 2022A Generalization of ViT/MLP-Mixer to Graphs27 Dec 2022
- 2022Pure Transformers are Powerful Graph Learners6 Jul 2022
- 2022Evaluating Self-Supervised Learning for Molecular Graph Embeddings16 Jun 2022
- 2022Pure Transformers are Powerful Graph Learnerscited by 188
- 2022A Generalization of ViT/MLP-Mixer to Graphscited by 93
- 2022Evaluating Self-Supervised Learning for Molecular Graph Embeddingscited by 22
- 2024Learning Graph Quantized Tokenizerscited by 19
- 2024FSW-GNN: A Bi-Lipschitz WL-Equivalent Graph Neural Networkcited by 8
- 2025Graph Representational Learning: When Does More Expressivity Hurt Generalization?cited by 5
- 2024Theoretical and Empirical Insights into the Origins of Degree Bias in Graph Neural Networkscited by 4
- 2023Graphtester: Exploring Theoretical Boundaries of GNNs on Graph Datasetscited by 3
- 2025On the Relationship Between Robustness and Expressivity of Graph Neural Networkscited by 3
- 2025What Expressivity Theory Misses: Message Passing Complexity for GNNscited by 2
- 2023Attacking Graph Neural Networks with Bit Flips: Weisfeiler and Lehman Go Indifferentcited by 0
- 2025Model-Level GNN Explanations via Rule-to-Graph Readout for Logit Reconstructioncited by 0
12 most cited of 15 All 15 (JSON)
- 2026On the Expressive Power of Implicit Line-Graph Higher-Order Weisfeiler--Leman14 Sep 2026
- 2026Understanding Truncated Positional Encodings for Graph Neural Networks11 Jun 2026
- 2025Exact Generalisation Error Exposes Benchmarks Skew Graph Neural Networks Success (or Failure)12 Sep 2025
- 2025What Expressivity Theory Misses: Message Passing Complexity for GNNs1 Sep 2025
- 2025Graph Representational Learning: When Does More Expressivity Hurt Generalization?16 May 2025
- 2025On the Relationship Between Robustness and Expressivity of Graph Neural Networks18 Apr 2025
- 2025Model-Level GNN Explanations via Rule-to-Graph Readout for Logit Reconstruction12 Mar 2025
- 2024Learning Graph Quantized Tokenizers17 Oct 2024
- 2024FSW-GNN: A Bi-Lipschitz WL-Equivalent Graph Neural Network10 Oct 2024
- 2024Theoretical and Empirical Insights into the Origins of Degree Bias in Graph Neural Networks4 Apr 2024
- 2023Attacking Graph Neural Networks with Bit Flips: Weisfeiler and Lehman Go Indifferent2 Nov 2023
- 2023Graphtester: Exploring Theoretical Boundaries of GNNs on Graph Datasets30 Jun 2023
12 newest of 15 All 15 (JSON)