A Flexible, Equivariant Framework for Subgraph GNNs via Graph Products and Graph Coarsening
Not on the map. Why?
Abstract (arXiv)
Subgraph GNNs enhance message-passing GNNs expressivity by representing graphs as sets of subgraphs, demonstrating impressive performance across various tasks. However, their scalability is hindered by the need to process large numbers of subgraphs. While previous approaches attempted to generate smaller subsets of subgraphs through random or learnable sampling, these methods often yielded suboptimal selections or were limited to small subset sizes, ultimately compromising their effectiveness. This paper introduces a new Subgraph GNN framework to address these issues. Our approach diverges from most previous methods by associating subgraphs with node clusters rather than with individual nodes. We show that the resulting collection of subgraphs can be viewed as the product of coarsened and original graphs, unveiling a new connectivity structure on which we perform generalized message passing. Crucially, controlling the coarsening function enables meaningful selection of any number of subgraphs. In addition, we reveal novel permutation symmetries in the resulting node feature tensor, characterize associated linear equivariant layers, and integrate them into our Subgraph GNN. We also introduce novel node marking strategies and provide a theoretical analysis of their expressive power and other key aspects of our approach. Extensive experiments on multiple graph learning benchmarks demonstrate that our method is significantly more flexible than previous approaches, as it can seamlessly handle any number of subgraphs, while consistently outperforming baseline approaches. Our code is available at https://github.com/BarSGuy/Efficient-Subgraph-GNNs.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 36 of its 41 references that are in the map. First posted on arXiv 13 Jun 2024.
Builds on
36 of 41 references.
References · 36
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2018How Powerful are Graph Neural Networks?cited by 4,355
- 2017Neural Message Passing for Quantum Chemistrycited by 3,460
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
- 2017Deep Setscited by 1,394
- 2019Strategies for Pre-training Graph Neural Networkscited by 964
- 2018Weisfeiler and Leman Go Neural: Higher-order Graph Neural Networkscited by 878
- 2016Automatic chemical design using a data-driven continuous representation of moleculescited by 762
- 2020Benchmarking Graph Neural Networkscited by 672
24 more
- 2019Provably Powerful Graph Networkscited by 385
- 2017Residual Gated Graph ConvNetscited by 341
- 2018Invariant and Equivariant Graph Networkscited by 339
- 2021ASAM: Adaptive Sharpness-Aware Minimization for Scale-Invariant Learning of Deep Neural Networkscited by 293
- 2022Long Range Graph Benchmarkcited by 258
- 2019Universal Invariant and Equivariant Graph Neural Networkscited by 182
- 2021Equivariant Subgraph Aggregation Networkscited by 154
- 2021From Stars to Subgraphs: Uplifting Any GNN with Local Structure Awarenesscited by 154
- 2017Equivariance Through Parameter-Sharingcited by 139
- 2021Nested Graph Neural Networkscited by 136
- 2021Weisfeiler and Leman go Machine Learning: The Story so farcited by 121
- 2021DropGNN: Random Dropouts Increase the Expressiveness of Graph Neural Networkscited by 117
- 2022Understanding and Extending Subgraph GNNs by Rethinking Their Symmetriescited by 112
- 2020Expressive Power of Invariant and Equivariant Graph Neural Networkscited by 100
- 2018Small ReLU networks are powerful memorizers: a tight analysis of memorization capacitycited by 76
- 2021Reconstruction for Powerful Graph Representationscited by 65
- 2023A Complete Expressiveness Hierarchy for Subgraph GNNs via Subgraph Weisfeiler-Lehman Testscited by 64
- 2022Ordered Subgraph Aggregation Networkscited by 57
- 2022Boosting the Cycle Counting Power of Graph Neural Networks with I2-GNNscited by 55
- 2022A Theoretical Comparison of Graph Neural Network Extensionscited by 47
- 2019Incidence Networks for Geometric Deep Learningcited by 17
- 2023Efficient Subgraph GNNs by Learning Effective Selection Policiescited by 17
- 2023MAG-GNN: Reinforcement Learning Boosted Graph Neural Networkcited by 11
- 2024Subgraphormer: Unifying Subgraph GNNs and Graph Transformers via Graph Productscited by 8
Built on by
Citing papers per year: 2024: 1; 2025: 5; 2026: 2.
8 papers.
- 2025Balancing Efficiency and Expressiveness: Subgraph GNNs with Walk-Based Centralitycited by 5
- 2024Demystifying Higher-Order Graph Neural Networkscited by 4
- 2025Spectral Graph Neural Networks are Incomplete on Graphs with a Simple Spectrumcited by 3
- 2025On topological descriptors for graph productscited by 2
- 2025Heat Kernel Goes Topologicalcited by 1
- 2026On the Expressive Power of GNNs to Solve Linear SDPscited by 1
- 2025On The Expressive Power of GNN Derivativescited by 0
- 2026Explaining Synergistic Effects in Social Recommendationscited by 0
- 2026On the Expressive Power of GNNs to Solve Linear SDPs30 Apr 2026
- 2026Explaining Synergistic Effects in Social Recommendations26 Jan 2026
- 2025On topological descriptors for graph products12 Nov 2025
- 2025On The Expressive Power of GNN Derivatives2 Oct 2025
- 2025Heat Kernel Goes Topological16 Jul 2025
- 2025Spectral Graph Neural Networks are Incomplete on Graphs with a Simple Spectrum5 Jun 2025
- 2025Balancing Efficiency and Expressiveness: Subgraph GNNs with Walk-Based Centrality6 Jan 2025
- 2024Demystifying Higher-Order Graph Neural Networks18 Jun 2024