Breaking Symmetry Bottlenecks in GNN Readouts
Not on the map. Why?
Abstract (arXiv)
Graph neural networks (GNNs) are widely used for learning on structured data, yet their ability to distinguish non-isomorphic graphs is fundamentally limited. These limitations are usually attributed to message passing; in this work we show that an independent bottleneck arises at the readout stage. Using finite-dimensional representation theory, we prove that all linear permutation-invariant readouts, including sum and mean pooling, factor through the Reynolds (group-averaging) operator and therefore project node embeddings onto the fixed subspace of the permutation action, erasing all non-trivial symmetry-aware components regardless of encoder expressivity. This yields both a new expressivity barrier and an interpretable characterization of what global pooling preserves or destroys. To overcome this collapse, we introduce projector-based invariant readouts that decompose node representations into symmetry-aware channels and summarize them with nonlinear invariant statistics, preserving permutation invariance while retaining information provably invisible to averaging. Empirically, swapping only the readout enables fixed encoders to separate WL-hard graph pairs and improves performance across multiple benchmarks, demonstrating that readout design is a decisive and under-appreciated factor in GNN expressivity.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 24 of its 37 references that are in the map. First posted on arXiv 5 Feb 2026.
Builds on
24 of 37 references.
References · 24
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2018How Powerful are Graph Neural Networks?cited by 4,355
- 2017Neural Message Passing for Quantum Chemistrycited by 3,460
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
- 2017Deep Setscited by 1,394
- 2016Group Equivariant Convolutional Networkscited by 1,154
- 2021How Attentive are Graph Attention Networks?cited by 818
- 2020TUDataset: A collection of benchmark datasets for learning with graphscited by 718
- 2020Benchmarking Graph Neural Networkscited by 672
- 2018Spherical CNNscited by 452
- 2019Provably Powerful Graph Networkscited by 385
- 2018Invariant and Equivariant Graph Networkscited by 339
12 more
- 2020Improving Graph Neural Network Expressivity via Subgraph Isomorphism Countingcited by 312
- 2018On the Generalization of Equivariance and Convolution in Neural Networks to the Action of Compact Groupscited by 296
- 2015Order Matters: Sequence to sequence for setscited by 236
- 2019Universal Invariant and Equivariant Graph Neural Networkscited by 182
- 2022Sign and Basis Invariant Networks for Spectral Graph Representation Learningcited by 176
- 2021Equivariant Subgraph Aggregation Networkscited by 154
- 2021Nested Graph Neural Networkscited by 136
- 2018Janossy Pooling: Learning Deep Permutation-Invariant Functions for Variable-Size Inputscited by 96
- 2021Topological Graph Neural Networkscited by 86
- 2021The Logic of Graph Neural Networkscited by 84
- 2022Boosting the Cycle Counting Power of Graph Neural Networks with I2-GNNscited by 55
- 2025Balancing Efficiency and Expressiveness: Subgraph GNNs with Walk-Based Centralitycited by 5
Built on by
Not cited yet.