A Signed Graph Approach to Understanding and Mitigating Oversmoothing in GNNs
Not on the map. Why?
Abstract (arXiv)
Deep graph neural networks (GNNs) often suffer from oversmoothing, where node representations become overly homogeneous with increasing depth. While techniques like normalization, residual connections, and edge dropout have been proposed to mitigate oversmoothing, they are typically developed independently, with limited theoretical understanding of their underlying mechanisms. In this work, we present a unified theoretical perspective based on the framework of signed graphs, showing that many existing strategies implicitly introduce negative edges that alter message-passing to resist oversmoothing. However, we show that merely adding negative edges in an unstructured manner is insufficient-the asymptotic behavior of signed propagation depends critically on the strength and organization of positive and negative edges. To address this limitation, we leverage the theory of structural balance, which promotes stable, cluster-preserving dynamics by connecting similar nodes with positive edges and dissimilar ones with negative edges. We propose Structural Balanced Propagation (SBP), a plug-and-play method that assigns signed edges based on either labels or feature similarity to explicitly enhance structural balance in the constructed signed graphs. Experiments on nine benchmarks across both homophilic and heterophilic settings demonstrate that SBP consistently improves classification accuracy and mitigates oversmoothing, even at depths of up to 300 layers. Our results provide a principled explanation for prior oversmoothing remedies and introduce a new direction for signed message-passing design in deep GNNs.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 39 of its 51 references that are in the map. First posted on arXiv 17 Feb 2025.
Builds on
39 of 51 references.
References · 39
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
- 2016Layer Normalizationcited by 5,669
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
- 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,089
- 2019Simplifying Graph Convolutional Networkscited by 1,477
- 2013Spectral Networks and Locally Connected Networks on Graphscited by 1,102
- 2018Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learningcited by 1,102
- 2018Predict then Propagate: Graph Neural Networks meet Personalized PageRankcited by 993
- 2018Representation Learning on Graphs with Jumping Knowledge Networkscited by 877
27 more
- 2020Simple and Deep Graph Convolutional Networkscited by 860
- 2015Gated Graph Sequence Neural Networkscited by 796
- 2015Convolutional Networks on Graphs for Learning Molecular Fingerprintscited by 754
- 2019DropEdge: Towards Deep Graph Convolutional Networks on Node Classificationcited by 680
- 2020Adaptive Universal Generalized PageRank Graph Neural Networkcited by 595
- 2016Interaction Networks for Learning about Objects, Relations and Physicscited by 509
- 2023A critical look at the evaluation of GNNs under heterophily: Are we really making progress?cited by 343
- 2019PairNorm: Tackling Oversmoothing in GNNscited by 297
- 2020Towards Deeper Graph Neural Networkscited by 296
- 2020A Note on Over-Smoothing for Graph Neural Networkscited by 249
- 2023A Survey on Oversmoothing in Graph Neural Networkscited by 247
- 2021Two Sides of the Same Coin: Heterophily and Oversmoothing in Graph Convolutional Neural Networkscited by 182
- 2022Revisiting Heterophily For Graph Neural Networkscited by 169
- 2020Graph Clustering with Graph Neural Networkscited by 163
- 2018Contextual Stochastic Block Modelscited by 134
- 2021PDE-GCN: Novel Architectures for Graph Neural Networks Motivated by Partial Differential Equationscited by 106
- 2023Ordered GNN: Ordering Message Passing to Deal with Heterophily and Over-smoothingcited by 67
- 2021Dissecting the Diffusion Process in Linear Graph Convolutional Networkscited by 58
- 2022A Non-Asymptotic Analysis of Oversmoothing in Graph Neural Networkscited by 49
- 2023Demystifying Oversmoothing in Attention-Based Graph Neural Networkscited by 49
- 2023ContraNorm: A Contrastive Learning Perspective on Oversmoothing and Beyondcited by 39
- 2024Residual Connections and Normalization Can Provably Prevent Oversmoothing in GNNscited by 34
- 2022ACMP: Allen-Cahn Message Passing with Attractive and Repulsive Forces for Graph Neural Networkscited by 31
- 2023A Message Passing Perspective on Learning Dynamics of Contrastive Learningcited by 22
- 2022Improving Graph Neural Networks with Learnable Propagation Operatorscited by 19
- 2017Dynamics over Signed Networkscited by 8
- 2024Sign is Not a Remedy: Multiset-to-Multiset Message Passing for Learning on Heterophilic Graphscited by 8
Built on by
Citing papers per year: 2026: 2.
2 papers.
- 2026A Spectral Theory of Normalized Corrected GNN Propagationcited by 0
- 2026Exploring Oversmoothing with Householder Matricescited by 0
- 2026Exploring Oversmoothing with Householder Matrices12 Aug 2026
- 2026A Spectral Theory of Normalized Corrected GNN Propagation22 Jun 2026