Automated Graph Learning via Population Based Self-Tuning GCN
Not on the map. Why?
Abstract (arXiv)
Owing to the remarkable capability of extracting effective graph embeddings, graph convolutional network (GCN) and its variants have been successfully applied to a broad range of tasks, such as node classification, link prediction, and graph classification. Traditional GCN models suffer from the issues of overfitting and oversmoothing, while some recent techniques like DropEdge could alleviate these issues and thus enable the development of deep GCN. However, training GCN models is non-trivial, as it is sensitive to the choice of hyperparameters such as dropout rate and learning weight decay, especially for deep GCN models. In this paper, we aim to automate the training of GCN models through hyperparameter optimization. To be specific, we propose a self-tuning GCN approach with an alternate training algorithm, and further extend our approach by incorporating the population based training scheme. Experimental results on three benchmark datasets demonstrate the effectiveness of our approaches on optimizing multi-layer GCN, compared with several representative baselines.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 19 of its 31 references that are in the map. First posted on arXiv 9 Jul 2021.
Builds on
19 of 31 references.
References · 19
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,571
- 2013Spectral Networks and Locally Connected Networks on Graphscited by 1,097
- 2020Simple and Deep Graph Convolutional Networkscited by 857
- 2016Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimizationcited by 688
- 2019DropEdge: Towards Deep Graph Convolutional Networks on Node Classificationcited by 679
- 2019DeepGCNs: Can GCNs Go as Deep as CNNs?cited by 527
- 2018BOHB: Robust and Efficient Hyperparameter Optimization at Scalecited by 466
- 2017Population Based Training of Neural Networkscited by 351
- 2017Forward and Reverse Gradient-Based Hyperparameter Optimizationcited by 232
7 more
- 2019Self-Tuning Networks: Bilevel Optimization of Hyperparameters using Structured Best-Response Functionscited by 104
- 2019Auto-GNN: Neural Architecture Search of Graph Neural Networkscited by 73
- 2020Policy-GNN: Aggregation Optimization for Graph Neural Networkscited by 48
- 2020Co-embedding of Nodes and Edges with Graph Neural Networkscited by 30
- 2020Graph Neural Network Architecture Search for Molecular Property Predictioncited by 17
- 2021Edge: Enriching Knowledge Graph Embeddings with External Textcited by 13
- 2020Evolutionary Architecture Search for Graph Neural Networkscited by 10
Built on by
Citing papers per year: 2021: 1; 2022: 2; 2023: 1; 2024: 1.
5 papers.
- 2023Fair Attribute Completion on Graph with Missing Attributescited by 22
- 2022Automated Graph Machine Learning: Approaches, Libraries, Benchmarks and Directionscited by 8
- 2022MetaGL: Evaluation-Free Selection of Graph Learning Models via Meta-Learningcited by 5
- 2021Modeling Mask Uncertainty in Hyperspectral Image Reconstructioncited by 4
- 2024GLEMOS: Benchmark for Instantaneous Graph Learning Model Selectioncited by 1
- 2024GLEMOS: Benchmark for Instantaneous Graph Learning Model Selection2 Apr 2024
- 2023Fair Attribute Completion on Graph with Missing Attributes25 Feb 2023
- 2022MetaGL: Evaluation-Free Selection of Graph Learning Models via Meta-Learning18 Jun 2022
- 2022Automated Graph Machine Learning: Approaches, Libraries, Benchmarks and Directions4 Jan 2022
- 2021Modeling Mask Uncertainty in Hyperspectral Image Reconstruction31 Dec 2021