Posterior Label Smoothing for Node Classification
Not on the map. Why?
Abstract (arXiv)
Label smoothing is a widely studied regularization technique in machine learning. However, its potential for node classification in graph-structured data, spanning homophilic to heterophilic graphs, remains largely unexplored. We introduce posterior label smoothing, a novel method for transductive node classification that derives soft labels from a posterior distribution conditioned on neighborhood labels. The likelihood and prior distributions are estimated from the global statistics of the graph structure, allowing our approach to adapt naturally to various graph properties. We evaluate our method on 10 benchmark datasets using eight baseline models, demonstrating consistent improvements in classification accuracy. The following analysis demonstrates that soft labels mitigate overfitting during training, leading to better generalization performance, and that pseudo-labeling effectively refines the global label statistics of the graph. Our code is available at https://github.com/ml-postech/PosteL.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 37 of its 53 references that are in the map. First posted on arXiv 1 Jun 2024.
Builds on
37 of 53 references.
References · 37
- 2017Attention Is All You Needcited by 60,361
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2017Graph Attention Networkscited by 8,923
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
- 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,089
- 2019TinyBERT: Distilling BERT for Natural Language Understandingcited by 1,167
- 2018Predict then Propagate: Graph Neural Networks meet Personalized PageRankcited by 993
- 2019When Does Label Smoothing Help?cited by 988
- 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 976
25 more
- 2019Strategies for Pre-training Graph Neural Networkscited by 971
- 2020Geom-GCN: Geometric Graph Convolutional Networkscited by 826
- 2015Image-based Recommendations on Styles and Substitutescited by 706
- 2020Adaptive Universal Generalized PageRank Graph Neural Networkcited by 595
- 2019Multi-scale Attributed Node Embeddingcited by 548
- 2017Regularizing Neural Networks by Penalizing Confident Output Distributionscited by 464
- 2019Structured Knowledge Distillation for Dense Predictioncited by 279
- 2019Learning Discrete Structures for Graph Neural Networkscited by 231
- 2020Iterative Deep Graph Learning for Graph Neural Networks: Better and Robust Node Embeddingscited by 214
- 2020Does label smoothing mitigate label noise?cited by 204
- 2020Graph Neural Networks with Heterophilycited by 202
- 2021BernNet: Learning Arbitrary Graph Spectral Filters via Bernstein Approximationcited by 195
- 2021Does Knowledge Distillation Really Work?cited by 190
- 2021GraphSMOTE: Imbalanced Node Classification on Graphs with Graph Neural Networkscited by 147
- 2020Delving Deep into Label Smoothingcited by 94
- 2023Ordered GNN: Ordering Message Passing to Deal with Heterophily and Over-smoothingcited by 67
- 2018Ranking Distillation: Learning Compact Ranking Models With High Performance for Recommender Systemcited by 60
- 2021ImGAGN:Imbalanced Network Embedding via Generative Adversarial Graph Networkscited by 51
- 2021Node Dependent Local Smoothing for Scalable Graph Learningcited by 45
- 2020Regularization via Structural Label Smoothingcited by 29
- 2022Make Heterophily Graphs Better Fit GNN: A Graph Rewiring Approachcited by 23
- 2020Label Confusion Learning to Enhance Text Classification Modelscited by 16
- 2021Adaptive Label Smoothing To Regularize Large-Scale Graph Trainingcited by 12
- 2021Structure-Aware Label Smoothing for Graph Neural Networkscited by 4
- 2022Label Efficient Regularization and Propagation for Graph Node Classificationcited by 3
Built on by
Not cited yet.