mlsanityData to 7 Oct 2026

Does your graph need a confidence boost? Convergent boosted smoothing on graphs with tabular node features

arXiv 2110.13413 ↗First posted 26 Oct 2021cs.LGcited by 9

Not on the map. Why?

Abstract (arXiv)

For supervised learning with tabular data, decision tree ensembles produced via boosting techniques generally dominate real-world applications involving iid training/test sets. However for graph data where the iid assumption is violated due to structured relations between samples, it remains unclear how to best incorporate this structure within existing boosting pipelines. To this end, we propose a generalized framework for iterating boosting with graph propagation steps that share node/sample information across edges connecting related samples. Unlike previous efforts to integrate graph-based models with boosting, our approach is anchored in a principled meta loss function such that provable convergence can be guaranteed under relatively mild assumptions. Across a variety of non-iid graph datasets with tabular node features, our method achieves comparable or superior performance than both tabular and graph neural network models, as well as existing hybrid strategies that combine the two. Beyond producing better predictive performance than recently proposed graph models, our proposed techniques are easy to implement, computationally more efficient, and enjoy stronger theoretical guarantees (which make our results more reproducible).

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 29 of its 48 references that are in the map. First posted on arXiv 26 Oct 2021.

Builds on

29 of 48 references.

References · 29

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  2. 2017Graph Attention Networkscited by 8,854
  3. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
  4. 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,571
  5. 2018Pitfalls of Graph Neural Network Evaluationcited by 994
  6. 2018Predict then Propagate: Graph Neural Networks meet Personalized PageRankcited by 987
  7. 2020On the Bottleneck of Graph Neural Networks and its Practical Implicationscited by 624
  8. 2020TabTransformer: Tabular Data Modeling Using Contextual Embeddingscited by 398
  9. 2020Generalization and Representational Limits of Graph Neural Networkscited by 217
  10. 2020Graph Neural Networks with Heterophilycited by 202
  11. 2020Combining Label Propagation and Simple Models Out-performs Graph Neural Networkscited by 199
  12. 2020Machine Learning on Graphs: A Model and Comprehensive Taxonomycited by 156
17 more
  1. 2021Interpreting and Unifying Graph Neural Networks with An Optimization Frameworkcited by 131
  2. 2020A Unified View on Graph Neural Networks as Graph Signal Denoisingcited by 110
  3. 2018Attention-based Graph Neural Network for Semi-supervised Learningcited by 100
  4. 2021Graph Neural Networks Inspired by Classical Iterative Algorithmscited by 60
  5. 2016AdaNet: Adaptive Structural Learning of Artificial Neural Networkscited by 54
  6. 2020Understanding and Resolving Performance Degradation in Graph Convolutional Networkscited by 53
  7. 2021Do We Really Need Deep Learning Models for Time Series Forecasting?cited by 45
  8. 2021Boost then Convolve: Gradient Boosting Meets Graph Neural Networkscited by 42
  9. 2021Bag of Tricks for Node Classification with Graph Neural Networkscited by 40
  10. 2019AdaGCN: Adaboosting Graph Convolutional Networks into Deep Modelscited by 37
  11. 2020Fast, Accurate, and Simple Models for Tabular Data via Augmented Distillationcited by 27
  12. 2020Revisiting Graph Convolutional Network on Semi-Supervised Node Classification from an Optimization Perspectivecited by 17
  13. 2021Gradient boosting for extreme quantile regressioncited by 17
  14. 2018Randomized Gradient Boosting Machinecited by 9
  15. 2017Kernel-based Inference of Functions over Graphscited by 8
  16. 2021Should Graph Neural Networks Use Features, Edges, Or Both?cited by 7
  17. 2020Understanding the Message Passing in Graph Neural Networks via Power Iteration Clusteringcited by 3

Built on by

Cited by year

Citing papers per year: 2022: 3; 2023: 3; 2024: 2; 2025: 1.

9 papers.