mlsanityData to 14 Oct 2026

From ChebNet to ChebGibbsNet

arXiv 2412.01789 ↗First posted 2 Dec 2024cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent advancements in Spectral Graph Convolutional Networks (SpecGCNs) have led to state-of-the-art performance in various graph representation learning tasks. To exploit the potential of SpecGCNs, we analyze corresponding graph filters via polynomial interpolation, the cornerstone of graph signal processing. Different polynomial bases, such as Bernstein, Chebyshev, and monomial basis, have various convergence rates that will affect the error in polynomial interpolation. Although adopting Chebyshev basis for interpolation can minimize maximum error, the performance of ChebNet is still weaker than GPR-GNN and BernNet. We point out it is caused by the Gibbs phenomenon, which occurs when the graph frequency response function approximates the target function. It reduces the approximation ability of a truncated polynomial interpolation. In order to mitigate the Gibbs phenomenon, we propose to add the Gibbs damping factor with each term of Chebyshev polynomials on ChebNet. As a result, our lightweight approach leads to a significant performance boost. Afterwards, we reorganize ChebNet via decoupling feature propagation and transformation. We name this variant as ChebGibbsNet. Our experiments indicate that ChebGibbsNet is superior to other advanced SpecGCNs, such as GPR-GNN and BernNet, in both homogeneous graphs and heterogeneous graphs.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 37 references that are in the map. First posted on arXiv 2 Dec 2024.

Builds on

15 of 37 references.

References · 15

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  2. 2016Gaussian Error Linear Units (GELUs)cited by 3,502
  3. 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,089
  4. 2018Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learningcited by 1,102
  5. 2017Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learningcited by 950
  6. 2020Geom-GCN: Geometric Graph Convolutional Networkscited by 826
  7. 2020Adaptive Universal Generalized PageRank Graph Neural Networkcited by 595
  8. 2019DeepGCNs: Can GCNs Go as Deep as CNNs?cited by 527
  9. 2019Revisiting Graph Neural Networks: All We Have is Low-Pass Filterscited by 261
  10. 2021BernNet: Learning Arbitrary Graph Spectral Filters via Bernstein Approximationcited by 195
  11. 2013Discrete Signal Processing on Graphs: Frequency Analysiscited by 73
  12. 2014PageRank beyond the Webcited by 51
3 more
  1. 2016Autoregressive Moving Average Graph Filteringcited by 35
  2. 2016Random walks and diffusion on networkscited by 28
  3. 2013Vertex-Frequency Analysis on Graphscited by 25

Built on by

Not cited yet.