Gradient Boosting Neural Networks: GrowNet
Not on the map. Why?
Abstract (arXiv)
A novel gradient boosting framework is proposed where shallow neural networks are employed as ``weak learners''. General loss functions are considered under this unified framework with specific examples presented for classification, regression, and learning to rank. A fully corrective step is incorporated to remedy the pitfall of greedy function approximation of classic gradient boosting decision tree. The proposed model rendered outperforming results against state-of-the-art boosting methods in all three tasks on multiple datasets. An ablation study is performed to shed light on the effect of each model components and model hyperparameters.
Key facts. Cited by 46 papers in the map (data through 14 Oct 2026). First posted on arXiv 19 Feb 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 7; 2023: 8; 2024: 14; 2025: 10; 2026: 4.
46 papers.
Sort:
By area:
- 2021Revisiting Deep Learning Models for Tabular Datacited by 740
- 2021Tabular Data: Deep Learning is Not All You Needcited by 535
- 2022On Embeddings for Numerical Features in Tabular Deep Learningcited by 186
- 2024TabM: Advancing Tabular Deep Learning with Parameter-Efficient Ensemblingcited by 113
- 2024ReconBoost: Boosting Can Achieve Modality Reconcilementcited by 60
- 2022Transfer Learning with Deep Tabular Modelscited by 52
- 2024TALENT: A Tabular Analytics and Learning Toolboxcited by 52
- 2021Boost then Convolve: Gradient Boosting Meets Graph Neural Networkscited by 44
- 2022Revisiting Pretraining Objectives for Tabular Deep Learningcited by 43
- 2025A Closer Look at TabPFN v2: Understanding Its Strengths and Extending Its Capabilitiescited by 41
- 2024SwitchTab: Switched Autoencoders Are Effective Tabular Learnerscited by 38
- 2025TabPFN Unleashed: A Scalable and Effective Solution to Tabular Classification Problemscited by 36
34 more
- 2025Representation Learning for Tabular Data: A Comprehensive Surveycited by 36
- 2023A review of ensemble learning and data augmentation models for class imbalanced problems: combination, implementation and evaluationcited by 25
- 2023ReConTab: Regularized Contrastive Representation Learning for Tabular Datacited by 25
- 2023A Performance-Driven Benchmark for Feature Selection in Tabular Deep Learningcited by 24
- 2022Precision Machine Learningcited by 14
- 2024Binning as a Pretext Task: Improving Self-Supervised Learning in Tabular Domainscited by 12
- 2022Boosted Dynamic Neural Networkscited by 8
- 2024Fully Test-time Adaptation for Tabular Datacited by 8
- 2025On-device edge learning for IoT data streams: a surveycited by 8
- 2024Multimodal Clinical Trial Outcome Prediction with Large Language Modelscited by 7
- 2024TabSeq: A Framework for Deep Learning on Tabular Data via Sequential Orderingcited by 5
- 2023Homological Convolutional Neural Networkscited by 4
- 2025Latte: Transfering LLMs` Latent-level Knowledge for Few-shot Tabular Learningcited by 4
- 2025Realistic Evaluation of TabPFN v2 in Open Environmentscited by 4
- 2024Team up GBDTs and DNNs: Advancing Efficient and Effective Tabular Prediction with Tree-hybrid MLPscited by 3
- 2024Transformers with Stochastic Competition for Tabular Data Modellingcited by 3
- 2025Make Still Further Progress: Chain of Thoughts for Tabular Data Leaderboardcited by 3
- 2023A Gradient Boosting Approach for Training Convolutional and Deep Neural Networkscited by 2
- 2024Self-Guided Masked Autoencoders for Domain-Agnostic Self-Supervised Learningcited by 2
- 2024TabDeco: A Comprehensive Contrastive Framework for Decoupled Representations in Tabular Datacited by 2
- 2022Transfer learning for ensembles: reducing computation time and keeping the diversitycited by 1
- 2023Incomplete Multimodal Learning for Complex Brain Disorders Predictioncited by 1
- 2024Forecasting with Hyper-Treescited by 1
- 2026ARASH: Adaptive Retrieval And Shot Selection for Tabular Predictioncited by 1
- 2022Towards Domain-Independent Supervised Discourse Parsing Through Gradient Boostingcited by 0
- 2023Prediction of Post-Operative Renal and Pulmonary Complications Using Transformerscited by 0
- 2023I Open at the Close: A Deep Reinforcement Learning Evaluation of Open Streets Initiativescited by 0
- 2024Breast Cancer Classification Using Gradient Boosting Algorithms Focusing on Reducing the False Negative and SHAP for Explainabilitycited by 0
- 2025Representation Learning on Out of Distribution in Tabular Datacited by 0
- 2025Harnessing LLMs Explanations to Boost Surrogate Models in Tabular Data Classificationcited by 0
- 2025HiPreNets: High-Precision Neural Networks through Progressive Trainingcited by 0
- 2026CFNN: Continued Fraction Neural Networkcited by 0
- 2026Gradient Boosting within a Single Attention Layercited by 0
- 2026TabNSM: Neural Sparse Mixer for Tabular Regressioncited by 0
- 2026TabNSM: Neural Sparse Mixer for Tabular Regression18 Aug 2026
- 2026ARASH: Adaptive Retrieval And Shot Selection for Tabular Prediction18 Aug 2026
- 2026Gradient Boosting within a Single Attention Layer3 Apr 2026
- 2026CFNN: Continued Fraction Neural Network21 Mar 2026
- 2025HiPreNets: High-Precision Neural Networks through Progressive Training18 Jun 2025
- 2025Realistic Evaluation of TabPFN v2 in Open Environments22 May 2025
- 2025Make Still Further Progress: Chain of Thoughts for Tabular Data Leaderboard19 May 2025
- 2025Harnessing LLMs Explanations to Boost Surrogate Models in Tabular Data Classification9 May 2025
- 2025Latte: Transfering LLMs` Latent-level Knowledge for Few-shot Tabular Learning8 May 2025
- 2025Representation Learning for Tabular Data: A Comprehensive Survey17 Apr 2025
- 2025On-device edge learning for IoT data streams: a survey25 Feb 2025
- 2025A Closer Look at TabPFN v2: Understanding Its Strengths and Extending Its Capabilities24 Feb 2025
34 more
- 2025Representation Learning on Out of Distribution in Tabular Data14 Feb 2025
- 2025TabPFN Unleashed: A Scalable and Effective Solution to Tabular Classification Problems4 Feb 2025
- 2024Fully Test-time Adaptation for Tabular Data14 Dec 2024
- 2024TabDeco: A Comprehensive Contrastive Framework for Decoupled Representations in Tabular Data17 Nov 2024
- 2024TabM: Advancing Tabular Deep Learning with Parameter-Efficient Ensembling31 Oct 2024
- 2024TabSeq: A Framework for Deep Learning on Tabular Data via Sequential Ordering17 Oct 2024
- 2024Transformers with Stochastic Competition for Tabular Data Modelling18 Jul 2024
- 2024Team up GBDTs and DNNs: Advancing Efficient and Effective Tabular Prediction with Tree-hybrid MLPs13 Jul 2024
- 2024TALENT: A Tabular Analytics and Learning Toolbox4 Jul 2024
- 2024ReconBoost: Boosting Can Achieve Modality Reconcilement15 May 2024
- 2024Forecasting with Hyper-Trees13 May 2024
- 2024Binning as a Pretext Task: Improving Self-Supervised Learning in Tabular Domains13 May 2024
- 2024Breast Cancer Classification Using Gradient Boosting Algorithms Focusing on Reducing the False Negative and SHAP for Explainability14 Mar 2024
- 2024Self-Guided Masked Autoencoders for Domain-Agnostic Self-Supervised Learning22 Feb 2024
- 2024Multimodal Clinical Trial Outcome Prediction with Large Language Models9 Feb 2024
- 2024SwitchTab: Switched Autoencoders Are Effective Tabular Learners4 Jan 2024
- 2023I Open at the Close: A Deep Reinforcement Learning Evaluation of Open Streets Initiatives12 Dec 2023
- 2023A Performance-Driven Benchmark for Feature Selection in Tabular Deep Learning10 Nov 2023
- 2023ReConTab: Regularized Contrastive Representation Learning for Tabular Data28 Oct 2023
- 2023Homological Convolutional Neural Networks26 Aug 2023
- 2023Prediction of Post-Operative Renal and Pulmonary Complications Using Transformers1 Jun 2023
- 2023Incomplete Multimodal Learning for Complex Brain Disorders Prediction25 May 2023
- 2023A review of ensemble learning and data augmentation models for class imbalanced problems: combination, implementation and evaluation6 Apr 2023
- 2023A Gradient Boosting Approach for Training Convolutional and Deep Neural Networks22 Feb 2023
- 2022Boosted Dynamic Neural Networks30 Nov 2022
- 2022Precision Machine Learning24 Oct 2022
- 2022Towards Domain-Independent Supervised Discourse Parsing Through Gradient Boosting18 Oct 2022
- 2022Revisiting Pretraining Objectives for Tabular Deep Learning7 Jul 2022
- 2022Transfer Learning with Deep Tabular Models30 Jun 2022
- 2022Transfer learning for ensembles: reducing computation time and keeping the diversity27 Jun 2022
- 2022On Embeddings for Numerical Features in Tabular Deep Learning10 Mar 2022
- 2021Revisiting Deep Learning Models for Tabular Data22 Jun 2021
- 2021Tabular Data: Deep Learning is Not All You Need6 Jun 2021
- 2021Boost then Convolve: Gradient Boosting Meets Graph Neural Networks21 Jan 2021
- 2021Revisiting Deep Learning Models for Tabular Datacited by 740
- 2021Tabular Data: Deep Learning is Not All You Needcited by 535
- 2022On Embeddings for Numerical Features in Tabular Deep Learningcited by 186
- 2024TabM: Advancing Tabular Deep Learning with Parameter-Efficient Ensemblingcited by 113
- 2024ReconBoost: Boosting Can Achieve Modality Reconcilementcited by 60
- 2022Transfer Learning with Deep Tabular Modelscited by 52
- 2024TALENT: A Tabular Analytics and Learning Toolboxcited by 52
- 2021Boost then Convolve: Gradient Boosting Meets Graph Neural Networkscited by 44
- 2022Revisiting Pretraining Objectives for Tabular Deep Learningcited by 43
- 2025A Closer Look at TabPFN v2: Understanding Its Strengths and Extending Its Capabilitiescited by 41
- 2024SwitchTab: Switched Autoencoders Are Effective Tabular Learnerscited by 38
- 2025TabPFN Unleashed: A Scalable and Effective Solution to Tabular Classification Problemscited by 36
12 most cited of 44 All 44 (JSON)
- 2026TabNSM: Neural Sparse Mixer for Tabular Regression18 Aug 2026
- 2026ARASH: Adaptive Retrieval And Shot Selection for Tabular Prediction18 Aug 2026
- 2026Gradient Boosting within a Single Attention Layer3 Apr 2026
- 2026CFNN: Continued Fraction Neural Network21 Mar 2026
- 2025HiPreNets: High-Precision Neural Networks through Progressive Training18 Jun 2025
- 2025Realistic Evaluation of TabPFN v2 in Open Environments22 May 2025
- 2025Harnessing LLMs Explanations to Boost Surrogate Models in Tabular Data Classification9 May 2025
- 2025Latte: Transfering LLMs` Latent-level Knowledge for Few-shot Tabular Learning8 May 2025
- 2025Representation Learning for Tabular Data: A Comprehensive Survey17 Apr 2025
- 2025On-device edge learning for IoT data streams: a survey25 Feb 2025
- 2025A Closer Look at TabPFN v2: Understanding Its Strengths and Extending Its Capabilities24 Feb 2025
- 2025Representation Learning on Out of Distribution in Tabular Data14 Feb 2025
12 newest of 44 All 44 (JSON)