Beyond Oversquashing: Understanding Signal Propagation in GNNs Via Observables
Not on the map. Why?
Abstract (arXiv)
Graph Neural Networks (GNNs) perform computations on graphs by routing the signal between graph regions using a graph shift operator or a message passing scheme. Often, the propagation of the signal leads to a loss of information, where the signal tends to diffuse across the graph instead of being deliberately routed between regions of interest. Two notions that depict this phenomenon are oversmoothing and oversquashing. In this paper, we propose an alternative approach for modeling signal propagation, inspired by quantum mechanics, using the notion of observables. Specifically, we model the place in the graph where the signal lies, how much the signal is concentrated there, and how much of the signal is propagated towards a location of interest when applying a GNN. Using these new concepts, we prove that standard spectral GNNs have poor signal propagation capabilities. We then propose a new type of spectral GNN, termed Schr"odinger GNN, which we show has a superior capacity to route the signal across the graph.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 52 of its 71 references that are in the map. First posted on arXiv 13 May 2026.
Builds on
52 of 71 references.
References · 52
- 2017Attention Is All You Needcited by 60,361
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2017Neural Message Passing for Quantum Chemistrycited by 3,487
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,919
- 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,089
- 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,576
- 2014DeepWalk: Online Learning of Social Representationscited by 1,547
- 2017ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devicescited by 1,200
- 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,139
38 more
- 2018Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learningcited by 1,102
- 2020Learning to Simulate Complex Physics with Graph Networkscited by 880
- 2020Simple and Deep Graph Convolutional Networkscited by 860
- 2015Convolutional Networks on Graphs for Learning Molecular Fingerprintscited by 754
- 2020TUDataset: A collection of benchmark datasets for learning with graphscited by 728
- 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 713
- 2019DropEdge: Towards Deep Graph Convolutional Networks on Node Classificationcited by 680
- 2019Neural Graph Collaborative Filteringcited by 661
- 2020A Generalization of Transformer Networks to Graphscited by 661
- 2020On the Bottleneck of Graph Neural Networks and its Practical Implicationscited by 631
- 2017SchNet: A continuous-filter convolutional neural network for modeling quantum interactionscited by 571
- 2016Interaction Networks for Learning about Objects, Relations and Physicscited by 509
- 2021Understanding over-squashing and bottlenecks on graphs via curvaturecited by 478
- 2017Residual Gated Graph ConvNetscited by 346
- 2023A critical look at the evaluation of GNNs under heterophily: Are we really making progress?cited by 343
- 2019PairNorm: Tackling Oversmoothing in GNNscited by 297
- 2022Long Range Graph Benchmarkcited by 263
- 2016Molecular Graph Convolutions: Moving Beyond Fingerprintscited by 238
- 2017CayleyNets: Graph Convolutional Neural Networks with Complex Rational Spectral Filterscited by 203
- 2023Exphormer: Sparse Transformers for Graphscited by 170
- 2023On Over-Squashing in Message Passing Neural Networks: The Impact of Width, Depth, and Topologycited by 166
- 2023Graph Inductive Biases in Transformers without Message Passingcited by 153
- 2022Revisiting Over-smoothing and Over-squashing Using Ollivier-Ricci Curvaturecited by 98
- 2023Understanding Oversquashing in GNNs through the Lens of Effective Resistancecited by 97
- 2022A Generalization of ViT/MLP-Mixer to Graphscited by 93
- 2023Where Did the Gap Go? Reassessing the Long-Range Graph Benchmarkcited by 85
- 2023DRew: Dynamically Rewired Message Passing with Delaycited by 82
- 2013Discrete Signal Processing on Graphs: Frequency Analysiscited by 73
- 2019Quantum Graph Neural Networkscited by 66
- 2022On the Trade-off between Over-smoothing and Over-squashing in Deep Graph Neural Networkscited by 64
- 2021A Survey of Complex-Valued Neural Networkscited by 61
- 2017CirCNN: Accelerating and Compressing Deep Neural Networks Using Block-CirculantWeight Matricescited by 55
- 2022Oversquashing in GNNs through the lens of information contraction and graph expansioncited by 53
- 2021Walking Out of the Weisfeiler Leman Hierarchy: Graph Learning Beyond Message Passingcited by 47
- 2024On Oversquashing in Graph Neural Networks Through the Lens of Dynamical Systemscited by 28
- 2021Hybrid Quantum Classical Graph Neural Networks for Particle Track Reconstructioncited by 20
- 2018Graph Convolutional Neural Networks based on Quantum Vertex Saliencycited by 12
- 2018Building Efficient Deep Neural Networks with Unitary Group Convolutionscited by 9
50 most cited of 52 All 52 (JSON)
Built on by
Not cited yet.