Does your graph need a confidence boost? Convergent boosted smoothing on graphs with tabular node features
Not on the map. Why?
Abstract (arXiv)
For supervised learning with tabular data, decision tree ensembles produced via boosting techniques generally dominate real-world applications involving iid training/test sets. However for graph data where the iid assumption is violated due to structured relations between samples, it remains unclear how to best incorporate this structure within existing boosting pipelines. To this end, we propose a generalized framework for iterating boosting with graph propagation steps that share node/sample information across edges connecting related samples. Unlike previous efforts to integrate graph-based models with boosting, our approach is anchored in a principled meta loss function such that provable convergence can be guaranteed under relatively mild assumptions. Across a variety of non-iid graph datasets with tabular node features, our method achieves comparable or superior performance than both tabular and graph neural network models, as well as existing hybrid strategies that combine the two. Beyond producing better predictive performance than recently proposed graph models, our proposed techniques are easy to implement, computationally more efficient, and enjoy stronger theoretical guarantees (which make our results more reproducible).
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 29 of its 48 references that are in the map. First posted on arXiv 26 Oct 2021.
Builds on
29 of 48 references.
References · 29
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
- 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,571
- 2018Pitfalls of Graph Neural Network Evaluationcited by 994
- 2018Predict then Propagate: Graph Neural Networks meet Personalized PageRankcited by 987
- 2020On the Bottleneck of Graph Neural Networks and its Practical Implicationscited by 624
- 2020TabTransformer: Tabular Data Modeling Using Contextual Embeddingscited by 398
- 2020Generalization and Representational Limits of Graph Neural Networkscited by 217
- 2020Graph Neural Networks with Heterophilycited by 202
- 2020Combining Label Propagation and Simple Models Out-performs Graph Neural Networkscited by 199
- 2020Machine Learning on Graphs: A Model and Comprehensive Taxonomycited by 156
17 more
- 2021Interpreting and Unifying Graph Neural Networks with An Optimization Frameworkcited by 131
- 2020A Unified View on Graph Neural Networks as Graph Signal Denoisingcited by 110
- 2018Attention-based Graph Neural Network for Semi-supervised Learningcited by 100
- 2021Graph Neural Networks Inspired by Classical Iterative Algorithmscited by 60
- 2016AdaNet: Adaptive Structural Learning of Artificial Neural Networkscited by 54
- 2020Understanding and Resolving Performance Degradation in Graph Convolutional Networkscited by 53
- 2021Do We Really Need Deep Learning Models for Time Series Forecasting?cited by 45
- 2021Boost then Convolve: Gradient Boosting Meets Graph Neural Networkscited by 42
- 2021Bag of Tricks for Node Classification with Graph Neural Networkscited by 40
- 2019AdaGCN: Adaboosting Graph Convolutional Networks into Deep Modelscited by 37
- 2020Fast, Accurate, and Simple Models for Tabular Data via Augmented Distillationcited by 27
- 2020Revisiting Graph Convolutional Network on Semi-Supervised Node Classification from an Optimization Perspectivecited by 17
- 2021Gradient boosting for extreme quantile regressioncited by 17
- 2018Randomized Gradient Boosting Machinecited by 9
- 2017Kernel-based Inference of Functions over Graphscited by 8
- 2021Should Graph Neural Networks Use Features, Edges, Or Both?cited by 7
- 2020Understanding the Message Passing in Graph Neural Networks via Power Iteration Clusteringcited by 3
Built on by
Citing papers per year: 2022: 3; 2023: 3; 2024: 2; 2025: 1.
9 papers.
- 2023GADBench: Revisiting and Benchmarking Supervised Graph Anomaly Detectioncited by 57
- 2025Turning Tabular Foundation Models into Graph Foundation Modelscited by 30
- 2024Automated Data Curation for Robust Language Model Fine-Tuningcited by 27
- 2022Descent Steps of a Relation-Aware Energy Produce Heterogeneous Graph Neural Networkscited by 9
- 2023Efficient Link Prediction via GNN Layers Induced by Negative Samplingcited by 6
- 2022Graph Learning Indexer: A Contributor-Friendly and Metadata-Rich Platform for Graph Learning Benchmarkscited by 4
- 2023MuseGNN: Forming Scalable, Convergent GNN Layers that Minimize a Sampling-Based Energycited by 2
- 2024BloomGML: Graph Machine Learning through the Lens of Bilevel Optimizationcited by 1
- 2022High-Order Optimization of Gradient Boosted Decision Treescited by 0
- 2025Turning Tabular Foundation Models into Graph Foundation Models28 Aug 2025
- 2024Automated Data Curation for Robust Language Model Fine-Tuning19 Mar 2024
- 2024BloomGML: Graph Machine Learning through the Lens of Bilevel Optimization7 Mar 2024
- 2023MuseGNN: Forming Scalable, Convergent GNN Layers that Minimize a Sampling-Based Energy19 Oct 2023
- 2023Efficient Link Prediction via GNN Layers Induced by Negative Sampling14 Oct 2023
- 2023GADBench: Revisiting and Benchmarking Supervised Graph Anomaly Detection21 Jun 2023
- 2022Graph Learning Indexer: A Contributor-Friendly and Metadata-Rich Platform for Graph Learning Benchmarks8 Dec 2022
- 2022High-Order Optimization of Gradient Boosted Decision Trees21 Nov 2022
- 2022Descent Steps of a Relation-Aware Energy Produce Heterogeneous Graph Neural Networks22 Jun 2022