Label Efficient Regularization and Propagation for Graph Node Classification
Not on the map. Why?
Abstract (arXiv)
An enhanced label propagation (LP) method called GraphHop was proposed recently. It outperforms graph convolutional networks (GCNs) in the semi-supervised node classification task on various networks. Although the performance of GraphHop was explained intuitively with joint node attribute and label signal smoothening, its rigorous mathematical treatment is lacking. In this paper, we propose a label efficient regularization and propagation (LERP) framework for graph node classification, and present an alternate optimization procedure for its solution. Furthermore, we show that GraphHop only offers an approximate solution to this framework and has two drawbacks. First, it includes all nodes in the classifier training without taking the reliability of pseudo-labeled nodes into account in the label update step. Second, it provides a rough approximation to the optimum of a subproblem in the label aggregation step. Based on the LERP framework, we propose a new method, named the LERP method, to solve these two shortcomings. LERP determines reliable pseudo-labels adaptively during the alternate optimization and provides a better approximation to the optimum with computational efficiency. Theoretical convergence of LERP is guaranteed. Extensive experiments are conducted to demonstrate the effectiveness and efficiency of LERP. That is, LERP outperforms all benchmarking methods, including GraphHop, consistently on five test datasets and an object recognition task at extremely low label rates (i.e., 1, 2, 4, 8, 16, and 20 labeled samples per class).
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 38 of its 60 references that are in the map. First posted on arXiv 19 Apr 2022.
Builds on
38 of 60 references.
References · 38
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2018How Powerful are Graph Neural Networks?cited by 4,355
- 2017Neural Message Passing for Quantum Chemistrycited by 3,460
- 2021Convex optimizationcited by 2,479
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
- 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
- 2019Simplifying Graph Convolutional Networkscited by 1,470
- 2018Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learningcited by 1,099
- 2013Spectral Networks and Locally Connected Networks on Graphscited by 1,097
26 more
- 2018Pitfalls of Graph Neural Network Evaluationcited by 994
- 2018Predict then Propagate: Graph Neural Networks meet Personalized PageRankcited by 987
- 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 970
- 2015Image-based Recommendations on Styles and Substitutescited by 702
- 2019GraphSAINT: Graph Sampling Based Inductive Learning Methodcited by 618
- 2018FastGCN: Fast Learning with Graph Convolutional Networks via Importance Samplingcited by 583
- 2016Geometric deep learning on graphs and manifolds using mixture model CNNscited by 468
- 2019MixHop: Higher-Order Graph Convolutional Architectures via Sparsified Neighborhood Mixingcited by 442
- 2019Diffusion Improves Graph Learningcited by 414
- 2018GraphRNN: Generating Realistic Graphs with Deep Auto-regressive Modelscited by 406
- 2020Graph Random Neural Network for Semi-Supervised Learning on Graphscited by 213
- 2020Combining Label Propagation and Simple Models Out-performs Graph Neural Networkscited by 199
- 2019Layer-Dependent Importance Sampling for Training Deep and Large Graph Convolutional Networkscited by 177
- 2020Scaling Graph Neural Networks with Approximate PageRankcited by 174
- 2019Multi-Stage Self-Supervised Learning for Graph Convolutional Networks on Graphs with Few Labelscited by 111
- 2022Decoupling the Depth and Scope of Graph Neural Networkscited by 94
- 2018Bayesian graph convolutional neural networks for semi-supervised classificationcited by 88
- 2020Scalable Graph Neural Networks via Bidirectional Propagationcited by 87
- 2019GMNN: Graph Markov Neural Networkscited by 82
- 2021Graph-based Semi-supervised Learning: A Comprehensive Reviewcited by 79
- 2020Poisson Learning: Graph Based Semi-Supervised Learning At Very Low Label Ratescited by 49
- 2019Label Efficient Semi-Supervised Learning via Graph Filteringcited by 46
- 2022GRAND+: Scalable Graph Random Neural Networkscited by 25
- 2019A Flexible Generative Framework for Graph-based Semi-supervised Learningcited by 24
- 2021GraphHop: An Enhanced Label Propagation Method for Node Classificationcited by 15
- 2020Consistent Semi-Supervised Graph Regularization for High Dimensional Datacited by 10
Built on by
Citing papers per year: 2023: 1; 2024: 2.
3 papers.