mlsanityData to 7 Oct 2026

A Flexible, Equivariant Framework for Subgraph GNNs via Graph Products and Graph Coarsening

arXiv 2406.09291 ↗First posted 13 Jun 2024cs.LGcited by 8

Not on the map. Why?

Abstract (arXiv)

Subgraph GNNs enhance message-passing GNNs expressivity by representing graphs as sets of subgraphs, demonstrating impressive performance across various tasks. However, their scalability is hindered by the need to process large numbers of subgraphs. While previous approaches attempted to generate smaller subsets of subgraphs through random or learnable sampling, these methods often yielded suboptimal selections or were limited to small subset sizes, ultimately compromising their effectiveness. This paper introduces a new Subgraph GNN framework to address these issues. Our approach diverges from most previous methods by associating subgraphs with node clusters rather than with individual nodes. We show that the resulting collection of subgraphs can be viewed as the product of coarsened and original graphs, unveiling a new connectivity structure on which we perform generalized message passing. Crucially, controlling the coarsening function enables meaningful selection of any number of subgraphs. In addition, we reveal novel permutation symmetries in the resulting node feature tensor, characterize associated linear equivariant layers, and integrate them into our Subgraph GNN. We also introduce novel node marking strategies and provide a theoretical analysis of their expressive power and other key aspects of our approach. Extensive experiments on multiple graph learning benchmarks demonstrate that our method is significantly more flexible than previous approaches, as it can seamlessly handle any number of subgraphs, while consistently outperforming baseline approaches. Our code is available at https://github.com/BarSGuy/Efficient-Subgraph-GNNs.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 36 of its 41 references that are in the map. First posted on arXiv 13 Jun 2024.

Builds on

36 of 41 references.

References · 36

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  3. 2017Graph Attention Networkscited by 8,854
  4. 2018How Powerful are Graph Neural Networks?cited by 4,355
  5. 2017Neural Message Passing for Quantum Chemistrycited by 3,460
  6. 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
  7. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
  8. 2017Deep Setscited by 1,394
  9. 2019Strategies for Pre-training Graph Neural Networkscited by 964
  10. 2018Weisfeiler and Leman Go Neural: Higher-order Graph Neural Networkscited by 878
  11. 2016Automatic chemical design using a data-driven continuous representation of moleculescited by 762
  12. 2020Benchmarking Graph Neural Networkscited by 672
24 more
  1. 2019Provably Powerful Graph Networkscited by 385
  2. 2017Residual Gated Graph ConvNetscited by 341
  3. 2018Invariant and Equivariant Graph Networkscited by 339
  4. 2021ASAM: Adaptive Sharpness-Aware Minimization for Scale-Invariant Learning of Deep Neural Networkscited by 293
  5. 2022Long Range Graph Benchmarkcited by 258
  6. 2019Universal Invariant and Equivariant Graph Neural Networkscited by 182
  7. 2021Equivariant Subgraph Aggregation Networkscited by 154
  8. 2021From Stars to Subgraphs: Uplifting Any GNN with Local Structure Awarenesscited by 154
  9. 2017Equivariance Through Parameter-Sharingcited by 139
  10. 2021Nested Graph Neural Networkscited by 136
  11. 2021Weisfeiler and Leman go Machine Learning: The Story so farcited by 121
  12. 2021DropGNN: Random Dropouts Increase the Expressiveness of Graph Neural Networkscited by 117
  13. 2022Understanding and Extending Subgraph GNNs by Rethinking Their Symmetriescited by 112
  14. 2020Expressive Power of Invariant and Equivariant Graph Neural Networkscited by 100
  15. 2018Small ReLU networks are powerful memorizers: a tight analysis of memorization capacitycited by 76
  16. 2021Reconstruction for Powerful Graph Representationscited by 65
  17. 2023A Complete Expressiveness Hierarchy for Subgraph GNNs via Subgraph Weisfeiler-Lehman Testscited by 64
  18. 2022Ordered Subgraph Aggregation Networkscited by 57
  19. 2022Boosting the Cycle Counting Power of Graph Neural Networks with I2-GNNscited by 55
  20. 2022A Theoretical Comparison of Graph Neural Network Extensionscited by 47
  21. 2019Incidence Networks for Geometric Deep Learningcited by 17
  22. 2023Efficient Subgraph GNNs by Learning Effective Selection Policiescited by 17
  23. 2023MAG-GNN: Reinforcement Learning Boosted Graph Neural Networkcited by 11
  24. 2024Subgraphormer: Unifying Subgraph GNNs and Graph Transformers via Graph Productscited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 5; 2026: 2.

8 papers.