mlsanityData to 14 Oct 2026

Automated Polynomial Filter Learning for Graph Neural Networks

arXiv 2307.07956 ↗First posted 16 Jul 2023cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Polynomial graph filters have been widely used as guiding principles in the design of Graph Neural Networks (GNNs). Recently, the adaptive learning of the polynomial graph filters has demonstrated promising performance for modeling graph signals on both homophilic and heterophilic graphs, owning to their flexibility and expressiveness. In this work, we conduct a novel preliminary study to explore the potential and limitations of polynomial graph filter learning approaches, revealing a severe overfitting issue. To improve the effectiveness of polynomial graph filters, we propose Auto-Polynomial, a novel and general automated polynomial graph filter learning framework that efficiently learns better filters capable of adapting to various complex graph signals. Comprehensive experiments and ablation studies demonstrate significant and consistent performance improvements on both homophilic and heterophilic graphs across multiple learning settings considering various labeling ratios, which unleashes the potential of polynomial filter learning.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 42 of its 60 references that are in the map. First posted on arXiv 16 Jul 2023.

Builds on

42 of 60 references.

References · 42

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  3. 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,434
  4. 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,269
  5. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
  6. 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,089
  7. 2018DARTS: Differentiable Architecture Searchcited by 1,798
  8. 2016Neural Architecture Search with Reinforcement Learningcited by 1,499
  9. 2019Simplifying Graph Convolutional Networkscited by 1,477
  10. 2018Predict then Propagate: Graph Neural Networks meet Personalized PageRankcited by 993
  11. 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 976
  12. 2020Simple and Deep Graph Convolutional Networkscited by 860
30 more
  1. 2018Link Prediction Based on Graph Neural Networkscited by 832
  2. 2020Geom-GCN: Geometric Graph Convolutional Networkscited by 826
  3. 2018AutoAugment: Learning Augmentation Policies from Datacited by 730
  4. 2015Image-based Recommendations on Styles and Substitutescited by 706
  5. 2020Adaptive Universal Generalized PageRank Graph Neural Networkcited by 595
  6. 2019Multi-scale Attributed Node Embeddingcited by 548
  7. 2020Graph Neural Networks in Recommender Systems: A Surveycited by 494
  8. 2019MixHop: Higher-Order Graph Convolutional Architectures via Sparsified Neighborhood Mixingcited by 443
  9. 2018Bilevel Programming for Hyperparameter Optimization and Meta-Learningcited by 405
  10. 2019Optimizing Millions of Hyperparameters by Implicit Differentiationcited by 304
  11. 2019Revisiting Graph Neural Networks: All We Have is Low-Pass Filterscited by 261
  12. 2021Graph Neural Network for Traffic Forecasting: A Surveycited by 261
  13. 2019A Fair Comparison of Graph Neural Networks for Graph Classificationcited by 244
  14. 2017CayleyNets: Graph Convolutional Neural Networks with Complex Rational Spectral Filterscited by 203
  15. 2020Graph Neural Networks with Heterophilycited by 202
  16. 2021BernNet: Learning Arbitrary Graph Spectral Filters via Bernstein Approximationcited by 195
  17. 2019Graph Neural Networks with convolutional ARMA filterscited by 185
  18. 2020Design Space for Graph Neural Networkscited by 182
  19. 2021Is Homophily a Necessity for Graph Neural Networks?cited by 182
  20. 2019Graph Wavelet Neural Networkcited by 131
  21. 2021Interpreting and Unifying Graph Neural Networks with An Optimization Frameworkcited by 131
  22. 2019Auto-GNN: Neural Architecture Search of Graph Neural Networkscited by 74
  23. 2019GraphNAS: Graph Neural Architecture Search with Reinforcement Learningcited by 41
  24. 2020Beyond Homophily in Graph Neural Networks: Current Limitations and Effective Designscited by 25
  25. 2020Learned Low Precision Graph Neural Networkscited by 25
  26. 2015Homophily and missing links in citation networkscited by 21
  27. 2020Probabilistic Dual Network Architecture Search on Graphscited by 15
  28. 2020Neural Architecture Search in Graph Neural Networkscited by 15
  29. 2020Evolutionary Architecture Search for Graph Neural Networkscited by 10
  30. 2013User recommendation in reciprocal and bipartite social networks -- a case study of online datingcited by 1

Built on by

Not cited yet.