mlsanityData to 14 Oct 2026

Mitigating Over-squashing without Rewiring: A Sheaf Effective Resistance Perspective

arXiv 2610.04157 ↗First posted 3 Oct 2026stat.ML cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Graph Neural Networks (GNNs) often struggle to capture long-range dependencies due to over-squashing -- a phenomenon in which the repeated compression of node embeddings into finite-size messages causes representations to collapse. Over-squashing is most often diagnosed as a property of the graph topology, with effective resistance serving as a principled measure of the bottleneck. We provide a complementary view on the matter: building on cellular sheaves, we introduce sheaf effective resistance, a generalization of effective resistance that depends on the sheaf attached to the graph, and we prove that for flat vector bundles, the over-squashing sensitivity in the Jacobian sense is upper bounded by a quantity related to the sheaf effective resistance between the nodes. The bottleneck thus need not lie in the graph itself: it can be relocated, and reduced, by adjusting the sheaf. We instantiate this idea in FlatNSD, a simple message-passing variant of Neural Sheaf Diffusion, and show that it implicitly learns to modulate total sheaf effective resistance, performing well on benchmarks designed to stress over-squashing without altering the original graph topology.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 43 of its 50 references that are in the map. First posted on arXiv 3 Oct 2026.

Builds on

43 of 50 references.

References · 43

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  2. 2017Graph Attention Networkscited by 8,923
  3. 2017Inductive Representation Learning on Large Graphscited by 6,320
  4. 2017Neural Message Passing for Quantum Chemistrycited by 3,487
  5. 2018Graph Convolutional Neural Networks for Web-Scale Recommender Systemscited by 1,138
  6. 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 976
  7. 2020Learning to Simulate Complex Physics with Graph Networkscited by 880
  8. 2020Geom-GCN: Geometric Graph Convolutional Networkscited by 826
  9. 2015Convolutional Networks on Graphs for Learning Molecular Fingerprintscited by 754
  10. 2020TUDataset: A collection of benchmark datasets for learning with graphscited by 728
  11. 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 713
  12. 2020On the Bottleneck of Graph Neural Networks and its Practical Implicationscited by 631
31 more
  1. 2019Multi-scale Attributed Node Embeddingcited by 548
  2. 2020Masked Label Prediction: Unified Message Passing Model for Semi-Supervised Classificationcited by 506
  3. 2021Understanding over-squashing and bottlenecks on graphs via curvaturecited by 478
  4. 2021Rethinking Graph Transformers with Spectral Attentioncited by 473
  5. 2023A critical look at the evaluation of GNNs under heterophily: Are we really making progress?cited by 343
  6. 2020A Note on Over-Smoothing for Graph Neural Networkscited by 249
  7. 2022Neural Sheaf Diffusion: A Topological Perspective on Heterophily and Oversmoothing in GNNscited by 214
  8. 2023Exphormer: Sparse Transformers for Graphscited by 170
  9. 2023On Over-Squashing in Message Passing Neural Networks: The Impact of Width, Depth, and Topologycited by 166
  10. 2022FoSR: First-order spectral rewiring for addressing oversquashing in GNNscited by 105
  11. 2022Revisiting Over-smoothing and Over-squashing Using Ollivier-Ricci Curvaturecited by 98
  12. 2023Understanding Oversquashing in GNNs through the Lens of Effective Resistancecited by 97
  13. 2020Sheaf Neural Networkscited by 84
  14. 2022On the Trade-off between Over-smoothing and Over-squashing in Deep Graph Neural Networkscited by 64
  15. 2022Anti-Symmetric DGN: a stable architecture for Deep Graph Networkscited by 60
  16. 2016Efficient Orthogonal Parametrisation of Recurrent Neural Networks Using Householder Reflectionscited by 57
  17. 2023Locality-Aware Graph-Rewiring in GNNscited by 56
  18. 2022Oversquashing in GNNs through the lens of information contraction and graph expansioncited by 53
  19. 2023Mitigating Over-Smoothing and Over-Squashing using Augmentations of Forman-Ricci Curvaturecited by 41
  20. 2023Cooperative Graph Neural Networkscited by 36
  21. 2024On Oversquashing in Graph Neural Networks Through the Lens of Dynamical Systemscited by 28
  22. 2023Adaptive Message Passing: A General Framework to Mitigate Oversmoothing, Oversquashing, and Underreachingcited by 24
  23. 2024Spectral Graph Pruning Against Over-Squashing and Over-Smoothingcited by 24
  24. 2024Port-Hamiltonian Architectural Bias for Long-Range Propagation in Deep Graph Networkscited by 16
  25. 2024Bundle Neural Networks for message diffusion on graphscited by 14
  26. 2025Cooperative Sheaf Neural Networkscited by 12
  27. 2025Can You Hear Me Now? A Benchmark for Long-Range Graph Propagationcited by 10
  28. 2025Mitigating Over-Squashing in Graph Neural Networks by Spectrum-Preserving Sparsificationcited by 8
  29. 2025Sheaves Reloaded: A Directional Awakeningcited by 4
  30. 2025Directional Sheaf Hypergraph Networks: Unifying Learning on Directed and Undirected Hypergraphscited by 4
  31. 2025Short-Range Oversquashingcited by 3

Built on by

Not cited yet.