Graph Neural Networks with Learnable and Optimal Polynomial Bases
Not on the map. Why?
Abstract (arXiv)
Polynomial filters, a kind of Graph Neural Networks, typically use a predetermined polynomial basis and learn the coefficients from the training data. It has been observed that the effectiveness of the model is highly dependent on the property of the polynomial basis. Consequently, two natural and fundamental questions arise: Can we learn a suitable polynomial basis from the training data? Can we determine the optimal polynomial basis for a given graph and node features? In this paper, we propose two spectral GNN models that provide positive answers to the questions posed above. First, inspired by Favard's Theorem, we propose the FavardGNN model, which learns a polynomial basis from the space of all possible orthonormal bases. Second, we examine the supposedly unsolvable definition of optimal polynomial basis from Wang & Zhang (2022) and propose a simple model, OptBasisGNN, which computes the optimal basis for a given graph structure and graph signal. Extensive experiments are conducted to demonstrate the effectiveness of our proposed models. Our code is available at https://github.com/yuziGuo/FarOptBasis.
Key facts. Cited by 36 papers in the map (data through 7 Oct 2026). Builds on 23 of its 45 references that are in the map. First posted on arXiv 24 Feb 2023.
Builds on
23 of 45 references.
References · 23
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
- 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
- 2019Simplifying Graph Convolutional Networkscited by 1,470
- 2018Predict then Propagate: Graph Neural Networks meet Personalized PageRankcited by 987
- 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 970
- 2020Simple and Deep Graph Convolutional Networkscited by 857
- 2020Adaptive Universal Generalized PageRank Graph Neural Networkcited by 592
- 2019MixHop: Higher-Order Graph Convolutional Architectures via Sparsified Neighborhood Mixingcited by 442
- 2021Large Scale Learning on Non-Homophilous Graphs: New Benchmarks and Strong Simple Methodscited by 309
11 more
- 2020SIGN: Scalable Inception Graph Neural Networkscited by 283
- 2021BernNet: Learning Arbitrary Graph Spectral Filters via Bernstein Approximationcited by 195
- 2019Graph Neural Networks with convolutional ARMA filterscited by 185
- 2022How Powerful are Spectral Graph Neural Networkscited by 169
- 2020Scalable Graph Neural Networks via Bidirectional Propagationcited by 87
- 2022Convolutional Neural Networks on Graphs with Chebyshev Approximation, Revisitedcited by 87
- 2021Optimization of Graph Neural Networks: Implicit Acceleration by Skip Connections and More Depthcited by 55
- 2022Graph Filters for Signal Processing and Machine Learning on Graphscited by 53
- 2021Node Dependent Local Smoothing for Scalable Graph Learningcited by 45
- 2020EdgeNets:Edge Varying Graph Neural Networkscited by 36
- 2019Improving Graph Attention Networks with Large Margin-based Constraintscited by 34
Built on by
Citing papers per year: 2023: 4; 2024: 14; 2025: 9; 2026: 9.
36 papers.
Sort:
- 2024fKAN: Fractional Kolmogorov-Arnold Networks with trainable Jacobi basis functionscited by 60
- 2024How Universal Polynomial Bases Enhance Spectral Graph Neural Networks: Heterophily, Over-smoothing, and Over-squashingcited by 24
- 2023Breaking the Entanglement of Homophily and Heterophily in Semi-supervised Node Classificationcited by 19
- 2024Spatio-Spectral Graph Neural Networkscited by 17
- 2024PolyFormer: Scalable Node-wise Filters via Polynomial Graph Transformercited by 10
- 2023Spectral Heterogeneous Graph Convolutions via Positive Noncommutative Polynomialscited by 8
- 2024A Comprehensive Benchmark on Spectral GNNs: The Impact on Efficiency, Memory, and Effectivenesscited by 6
- 2023Clarify Confused Nodes via Separated Learningcited by 5
- 2024Improving Expressive Power of Spectral Graph Neural Networks with Eigenvalue Correctioncited by 5
- 2024Optimizing Polynomial Graph Filters: A Novel Adaptive Krylov Subspace Approachcited by 5
- 2024ERGNN: Spectral Graph Neural Network With Explicitly-Optimized Rational Graph Filterscited by 5
- 2025Homophily Heterogeneity Matters in Graph Federated Learning: A Spectrum Sharing and Complementing Perspectivecited by 4
24 more
- 2024Rethinking Spectral Graph Neural Networks with Spatially Adaptive Filteringcited by 3
- 2024Simplified PCNet with Robustnesscited by 3
- 2024Spectral GNN via Two-dimensional (2-D) Graph Convolutioncited by 3
- 2024Equivariant Machine Learning on Graphs with Nonlinear Spectral Filterscited by 2
- 2024Scalable Graph Compressed Convolutionscited by 2
- 2025Toward Effective Digraph Representation Learning: A Magnetic Adaptive Propagation based Approachcited by 2
- 2025Addressing Noise and Stochasticity in Fraud Detection for Service Networkscited by 2
- 2025Partition-wise Graph Filtering: A Unified Perspective Through the Lens of Graph Coarseningcited by 2
- 2025Hyperbolic-PDE GNN: Spectral Graph Neural Networks in the Perspective of A System of Hyperbolic Partial Differential Equationscited by 2
- 2024Polynomial Selection in Spectral Graph Neural Networks: An Error-Sum of Function Slices Approachcited by 1
- 2025Piecewise Constant Spectral Graph Neural Networkcited by 1
- 2026Heterogeneity-Aware Knowledge Sharing for Graph Federated Learningcited by 1
- 2023An Effective Universal Polynomial Basis for Spectral Graph Neural Networkscited by 0
- 2025Toward Data-centric Directed Graph Learning: An Entropy-driven Approachcited by 0
- 2025Convexified Message-Passing Graph Neural Networkscited by 0
- 2025On the Impact of Downstream Tasks on Sampling and Reconstructing Noisy Graph Signalscited by 0
- 2026Learning from Historical Activations in Graph Neural Networkscited by 0
- 2026Position: Spectral GNNs Are Neither Spectral Nor Superior for Node Classificationcited by 0
- 2026Full-Spectrum Graph Neural Networks: Expressive and Scalablecited by 0
- 2026Hierarchical Multi-Scale Graph Neural Networks: Scalable Heterophilous Learning with Oversmoothing and Oversquashing Mitigationcited by 0
- 2026Graph Navier Stokes Networkscited by 0
- 2026SMGFM: Spectral Multimodal Graph Pretraining for Multimodal-Attributed Graphscited by 0
- 2026Continuous-Time Quantum Walks based Graph Neural Networkcited by 0
- 2026Spectral Graph Neural Networks with Hermite Polynomials: A Comprehensive Studycited by 0
- 2026Spectral Graph Neural Networks with Hermite Polynomials: A Comprehensive Study24 Sep 2026
- 2026Continuous-Time Quantum Walks based Graph Neural Network21 Aug 2026
- 2026SMGFM: Spectral Multimodal Graph Pretraining for Multimodal-Attributed Graphs11 Jun 2026
- 2026Graph Navier Stokes Networks20 May 2026
- 2026Hierarchical Multi-Scale Graph Neural Networks: Scalable Heterophilous Learning with Oversmoothing and Oversquashing Mitigation8 May 2026
- 2026Full-Spectrum Graph Neural Networks: Expressive and Scalable7 May 2026
- 2026Position: Spectral GNNs Are Neither Spectral Nor Superior for Node Classification19 Mar 2026
- 2026Heterogeneity-Aware Knowledge Sharing for Graph Federated Learning29 Jan 2026
- 2026Learning from Historical Activations in Graph Neural Networks3 Jan 2026
- 2025On the Impact of Downstream Tasks on Sampling and Reconstructing Noisy Graph Signals13 Sep 2025
- 2025Hyperbolic-PDE GNN: Spectral Graph Neural Networks in the Perspective of A System of Hyperbolic Partial Differential Equations29 May 2025
- 2025Convexified Message-Passing Graph Neural Networks23 May 2025
24 more
- 2025Partition-wise Graph Filtering: A Unified Perspective Through the Lens of Graph Coarsening20 May 2025
- 2025Piecewise Constant Spectral Graph Neural Network7 May 2025
- 2025Toward Data-centric Directed Graph Learning: An Entropy-driven Approach2 May 2025
- 2025Addressing Noise and Stochasticity in Fraud Detection for Service Networks2 May 2025
- 2025Homophily Heterogeneity Matters in Graph Federated Learning: A Spectrum Sharing and Complementing Perspective19 Feb 2025
- 2025Toward Effective Digraph Representation Learning: A Magnetic Adaptive Propagation based Approach21 Jan 2025
- 2024ERGNN: Spectral Graph Neural Network With Explicitly-Optimized Rational Graph Filters26 Dec 2024
- 2024Scalable Graph Compressed Convolutions26 Jul 2024
- 2024PolyFormer: Scalable Node-wise Filters via Polynomial Graph Transformer19 Jul 2024
- 2024A Comprehensive Benchmark on Spectral GNNs: The Impact on Efficiency, Memory, and Effectiveness14 Jun 2024
- 2024fKAN: Fractional Kolmogorov-Arnold Networks with trainable Jacobi basis functions11 Jun 2024
- 2024Equivariant Machine Learning on Graphs with Nonlinear Spectral Filters3 Jun 2024
- 2024Spatio-Spectral Graph Neural Networks29 May 2024
- 2024How Universal Polynomial Bases Enhance Spectral Graph Neural Networks: Heterophily, Over-smoothing, and Over-squashing21 May 2024
- 2024Polynomial Selection in Spectral Graph Neural Networks: An Error-Sum of Function Slices Approach15 Apr 2024
- 2024Spectral GNN via Two-dimensional (2-D) Graph Convolution6 Apr 2024
- 2024Optimizing Polynomial Graph Filters: A Novel Adaptive Krylov Subspace Approach12 Mar 2024
- 2024Simplified PCNet with Robustness6 Mar 2024
- 2024Improving Expressive Power of Spectral Graph Neural Networks with Eigenvalue Correction28 Jan 2024
- 2024Rethinking Spectral Graph Neural Networks with Spatially Adaptive Filtering17 Jan 2024
- 2023Breaking the Entanglement of Homophily and Heterophily in Semi-supervised Node Classification7 Dec 2023
- 2023An Effective Universal Polynomial Basis for Spectral Graph Neural Networks30 Nov 2023
- 2023Clarify Confused Nodes via Separated Learning4 Jun 2023
- 2023Spectral Heterogeneous Graph Convolutions via Positive Noncommutative Polynomials31 May 2023
- 2024fKAN: Fractional Kolmogorov-Arnold Networks with trainable Jacobi basis functionscited by 60
- 2024How Universal Polynomial Bases Enhance Spectral Graph Neural Networks: Heterophily, Over-smoothing, and Over-squashingcited by 24
- 2023Breaking the Entanglement of Homophily and Heterophily in Semi-supervised Node Classificationcited by 19
- 2024Spatio-Spectral Graph Neural Networkscited by 17
- 2024PolyFormer: Scalable Node-wise Filters via Polynomial Graph Transformercited by 10
- 2023Spectral Heterogeneous Graph Convolutions via Positive Noncommutative Polynomialscited by 8
- 2024A Comprehensive Benchmark on Spectral GNNs: The Impact on Efficiency, Memory, and Effectivenesscited by 6
- 2023Clarify Confused Nodes via Separated Learningcited by 5
- 2024Improving Expressive Power of Spectral Graph Neural Networks with Eigenvalue Correctioncited by 5
- 2024Optimizing Polynomial Graph Filters: A Novel Adaptive Krylov Subspace Approachcited by 5
- 2024ERGNN: Spectral Graph Neural Network With Explicitly-Optimized Rational Graph Filterscited by 5
- 2025Homophily Heterogeneity Matters in Graph Federated Learning: A Spectrum Sharing and Complementing Perspectivecited by 4
12 most cited of 36 All 36 (JSON)
- 2026Spectral Graph Neural Networks with Hermite Polynomials: A Comprehensive Study24 Sep 2026
- 2026Continuous-Time Quantum Walks based Graph Neural Network21 Aug 2026
- 2026SMGFM: Spectral Multimodal Graph Pretraining for Multimodal-Attributed Graphs11 Jun 2026
- 2026Graph Navier Stokes Networks20 May 2026
- 2026Hierarchical Multi-Scale Graph Neural Networks: Scalable Heterophilous Learning with Oversmoothing and Oversquashing Mitigation8 May 2026
- 2026Full-Spectrum Graph Neural Networks: Expressive and Scalable7 May 2026
- 2026Position: Spectral GNNs Are Neither Spectral Nor Superior for Node Classification19 Mar 2026
- 2026Heterogeneity-Aware Knowledge Sharing for Graph Federated Learning29 Jan 2026
- 2026Learning from Historical Activations in Graph Neural Networks3 Jan 2026
- 2025On the Impact of Downstream Tasks on Sampling and Reconstructing Noisy Graph Signals13 Sep 2025
- 2025Hyperbolic-PDE GNN: Spectral Graph Neural Networks in the Perspective of A System of Hyperbolic Partial Differential Equations29 May 2025
- 2025Convexified Message-Passing Graph Neural Networks23 May 2025
12 newest of 36 All 36 (JSON)