Measuring Over-smoothing beyond Dirichlet energy
Not on the map. Why?
Abstract (arXiv)
While Dirichlet energy serves as a prevalent metric for quantifying over-smoothing, it is inherently restricted to capturing first-order feature derivatives. To address this limitation, we propose a generalized family of node similarity measures based on the energy of higher-order feature derivatives. Through a rigorous theoretical analysis of the relationships among these measures, we establish the decay rates of Dirichlet energy under both continuous heat diffusion and discrete aggregation operators. Furthermore, our analysis reveals an intrinsic connection between the over-smoothing decay rate and the spectral gap of the graph Laplacian. Finally, empirical results demonstrate that attention-based Graph Neural Networks (GNNs) suffer from over-smoothing when evaluated under these proposed metrics.
Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Builds on 24 of its 31 references that are in the map. First posted on arXiv 7 Dec 2025.
Builds on
24 of 31 references.
References · 24
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,318
- 2017Graph Attention Networkscited by 8,888
- 2019Simplifying Graph Convolutional Networkscited by 1,474
- 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 973
- 2019Measuring and Relieving the Over-smoothing Problem for Graph Neural Networks from the Topological Viewcited by 545
- 2019PairNorm: Tackling Oversmoothing in GNNscited by 297
- 2021GRAND: Graph Neural Diffusioncited by 258
- 2020A Note on Over-Smoothing for Graph Neural Networkscited by 248
- 2023A Survey on Oversmoothing in Graph Neural Networkscited by 247
- 2022Graph-Coupled Oscillator Networkscited by 124
- 2019Continuous Graph Neural Networkscited by 114
- 2020Towards Deeper Graph Neural Networks with Differentiable Group Normalizationcited by 114
12 more
- 2022FoSR: First-order spectral rewiring for addressing oversquashing in GNNscited by 105
- 2022Revisiting Over-smoothing and Over-squashing Using Ollivier-Ricci Curvaturecited by 97
- 2022On the Trade-off between Over-smoothing and Over-squashing in Deep Graph Neural Networkscited by 64
- 2021Dissecting the Diffusion Process in Linear Graph Convolutional Networkscited by 58
- 2022GREAD: Graph Neural Reaction-Diffusion Networkscited by 54
- 2022Gradient Gating for Deep Multi-Rate Learning on Graphscited by 49
- 2023Demystifying Oversmoothing in Attention-Based Graph Neural Networkscited by 48
- 2023A Fractional Graph Laplacian Approach to Oversmoothingcited by 45
- 2022ACMP: Allen-Cahn Message Passing with Attractive and Repulsive Forces for Graph Neural Networkscited by 31
- 2024Spectral Graph Pruning Against Over-Squashing and Over-Smoothingcited by 24
- 2022TIDE: Time Derivative Diffusion for Deep Learning on Graphscited by 17
- 2024Unleashing the Potential of Fractional Calculus in Graph Neural Networks with FRONDcited by 16
Built on by
Citing papers per year: 2025: 1.
1 paper.