A Comparative Analysis of XGBoost
Not on the map. Why?
Abstract (arXiv)
XGBoost is a scalable ensemble technique based on gradient boosting that has demonstrated to be a reliable and efficient machine learning challenge solver. This work proposes a practical analysis of how this novel technique works in terms of training speed, generalization performance and parameter setup. In addition, a comprehensive comparison between XGBoost, random forests and gradient boosting has been performed using carefully tuned models as well as using the default settings. The results of this comparison may indicate that XGBoost is not necessarily the best choice under all circumstances. Finally an extensive analysis of XGBoost parametrization tuning process is carried out.
Key facts. Cited by 80 papers in the map (data through 14 Oct 2026). First posted on arXiv 5 Nov 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 9; 2023: 11; 2024: 24; 2025: 26; 2026: 6.
80 papers.
Sort:
By area:
- 2021Boost then Convolve: Gradient Boosting Meets Graph Neural Networkscited by 44
- 2021Zero Time Waste: Recycling Predictions in Early Exit Neural Networkscited by 39
- 2023A review of ensemble learning and data augmentation models for class imbalanced problems: combination, implementation and evaluationcited by 25
- 2025Transformer Copilot: Learning from The Mistake Log in LLM Fine-tuningcited by 21
- 2024A Comprehensive Benchmark of Machine and Deep Learning Across Diverse Tabular Datasetscited by 15
- 2021Scalable Gaussian Processes for Data-Driven Design using Big Data with Categorical Factorscited by 11
- 2024Benchmark Data Repositories for Better Benchmarkingcited by 10
- 2022A k-additive Choquet integral-based approach to approximate the SHAP values for local interpretability in machine learningcited by 8
- 2023HyperTime: Hyperparameter Optimization for Combating Temporal Distribution Shiftscited by 8
- 2023Enhanced Gradient Boosting for Zero-Inflated Insurance Claims and Comparative Analysis of CatBoost, XGBoost, and LightGBMcited by 5
- 2023Benchmarking state-of-the-art gradient boosting algorithms for classificationcited by 4
- 2025MorphBoost: Self-Organizing Universal Gradient Boosting with Adaptive Tree Morphingcited by 4
38 more
- 2022The MIT Supercloud Workload Classification Challengecited by 3
- 2023Overview of AdaBoost : Reconciling its views to better understand its dynamicscited by 3
- 2024Leveraging graph neural networks for supporting Automatic Triage of Patientscited by 3
- 2022Condensed Gradient Boostingcited by 2
- 2023A Gradient Boosting Approach for Training Convolutional and Deep Neural Networkscited by 2
- 2023Embeddings for Tabular Data: A Surveycited by 2
- 2023Interpretable Ensembles of Hyper-Rectangles as Base Modelscited by 2
- 2024Optimizing BioTac Simulation for Realistic Tactile Perceptioncited by 2
- 2025TabGLM: Tabular Graph Language Model for Learning Transferable Representations Through Multi-Modal Consistency Minimizationcited by 2
- 2025Optical Ocean Recipes: Creating Realistic Datasets to Facilitate Underwater Vision Researchcited by 2
- 2026ITBoost: Information-Theoretic Trust for Robust Boostingcited by 2
- 2026Causal multi-modal AI for personalized chemosensitivity predictioncited by 2
- 2022Churn modeling of life insurance policies via statistical and machine learning methods -- Analysis of important featurescited by 1
- 2022Automatic Error Classification and Root Cause Determination while Replaying Recorded Workload Data at SAP HANAcited by 1
- 2022Forecasting COVID-19 spreading trough an ensemble of classical and machine learning models: Spain's case studycited by 1
- 2022A Data-driven Case-based Reasoning in Bankruptcy Predictioncited by 1
- 2022OOG- Optuna Optimized GAN Sampling Technique for Tabular Imbalanced Malware Datacited by 1
- 2022GWRBoost:A geographically weighted gradient boosting method for explainable quantification of spatially-varying relationshipscited by 1
- 2024Predicting Fairness of ML Software Configurationscited by 1
- 2024Histogram-Based Federated XGBoost using Minimal Variance Sampling for Federated Tabular Datacited by 1
- 2024Exploring Speech Pattern Disorders in Autism using Machine Learningcited by 1
- 2024Interpretable classification of wiki-review streamscited by 1
- 2024Integrating White and Black Box Techniques for Interpretable Machine Learningcited by 1
- 2024Exploratory Visual Analysis for Increasing Data Readiness in Artificial Intelligence Projectscited by 1
- 2024Supervised Score-Based Modeling by Gradient Boostingcited by 1
- 2024Classifying Simulated Gait Impairments using Privacy-preserving Explainable Artificial Intelligence and Mobile Phone Videoscited by 1
- 2024Semi-decentralized Training of Spatio-Temporal Graph Neural Networks for Traffic Predictioncited by 1
- 2025Predicting Anthropometric Body Composition Variables Using 3D Optical Imaging and Machine Learningcited by 1
- 2025Robust-Multi-Task Gradient Boostingcited by 1
- 2025Symbolic Quantile Regression for the Interpretable Prediction of Conditional Quantilescited by 1
- 2026Robust multi-task boosting using clustering and local ensemblingcited by 1
- 2021Machine-learning-based investigation on classifying binary and multiclass behavior outcomes of children with PIMD/SMIDcited by 0
- 2023Digital elevation model correction in urban areas using extreme gradient boosting, land cover and terrain parameterscited by 0
- 2023A Boosted Machine Learning Framework for the Improvement of Phase and Crystal Structure Prediction of High Entropy Alloys Using Thermodynamic and Configurational Parameterscited by 0
- 2023Smart OMVI: Obfuscated Malware Variant Identification using a novel datasetcited by 0
- 2024Evaluating Explanatory Capabilities of Machine Learning Models in Medical Diagnostics: A Human-in-the-Loop Approachcited by 0
- 2024Advanced Detection of Source Code Clones via an Ensemble of Unsupervised Similarity Measurescited by 0
- 2024Classification Modeling with RNN-Based, Random Forest, and XGBoost for Imbalanced Data: A Case of Early Crash Detection in ASEAN-5 Stock Marketscited by 0
50 most cited of 80 All 80 (JSON)
- 2026Causal multi-modal AI for personalized chemosensitivity prediction11 Sep 2026
- 2026ITBoost: Information-Theoretic Trust for Robust Boosting6 May 2026
- 2026Skeleton-Based Posture Classification to Promote Safer Walker-Assisted Gait in Older Adults27 Apr 2026
- 2026Developing Machine Learning-Based Watch-to-Warning Severe Weather Guidance from the Warn-on-Forecast System10 Mar 2026
- 2026Robust multi-task boosting using clustering and local ensembling15 Feb 2026
- 2026Deep learning approaches show promise for predicting childhood malnutrition: A comparative study with traditional machine learning methods using survey data11 Feb 2026
- 2025Adaptive Graph Pruning with Sudden-Events Evaluation for Traffic Prediction using Online Semi-Decentralized ST-GNNs19 Dec 2025
- 2025Neural Factorization-based Bearing Fault Diagnosis7 Dec 2025
- 2025Enhancing Dimensionality Prediction in Hybrid Metal Halides via Feature Engineering and Class-Imbalance Mitigation5 Dec 2025
- 2025Data-driven Prediction of Species-Specific Plant Responses to Spectral-Shifting Films from Leaf Phenotypic and Photosynthetic Traits19 Nov 2025
- 2025MorphBoost: Self-Organizing Universal Gradient Boosting with Adaptive Tree Morphing17 Nov 2025
- 2025Q-Sat AI: Machine Learning-Based Decision Support for Data Saturation in Qualitative Studies2 Nov 2025
38 more
- 2025A Multi-level Analysis of Factors Associated with Student Performance: A Machine Learning Approach to the SAEB Microdata25 Oct 2025
- 2025Optical Ocean Recipes: Creating Realistic Datasets to Facilitate Underwater Vision Research24 Sep 2025
- 2025Hadamard-Riemannian Optimization for Margin-Variance Ensemble12 Sep 2025
- 2025Working My Way Back to You: Resource-Centric Next-Activity Prediction26 Aug 2025
- 2025Electromagnetic Simulations of Antennas on GPUs for Machine Learning Applications14 Aug 2025
- 2025Symbolic Quantile Regression for the Interpretable Prediction of Conditional Quantiles11 Aug 2025
- 2025Helix 1.0: An Open-Source Framework for Reproducible and Interpretable Machine Learning on Tabular Scientific Data23 Jul 2025
- 2025Robust-Multi-Task Gradient Boosting15 Jul 2025
- 2025e-Profits: A Business-Aligned Evaluation Metric for Profit-Sensitive Customer Churn Prediction9 Jul 2025
- 2025Harnessing Near-Infrared Spectroscopy and Machine Learning for Traceable Classification of Hanwoo and Holstein Beef24 Jun 2025
- 2025AI-based modular warning machine for risk identification in proximity healthcare13 Jun 2025
- 2025Predicting Anthropometric Body Composition Variables Using 3D Optical Imaging and Machine Learning8 Jun 2025
- 2025Transformer Copilot: Learning from The Mistake Log in LLM Fine-tuning22 May 2025
- 2025Re-experiment Smart: a Novel Method to Enhance Data-driven Prediction of Mechanical Properties of Epoxy Polymers19 May 2025
- 2025Solar Flare Forecast: A Comparative Analysis of Machine Learning Algorithms for Solar Flare Class Prediction6 May 2025
- 2025Enhanced Smart Contract Reputability Analysis using Multimodal Data Fusion on Ethereum21 Mar 2025
- 2025ML-Based Bidding Price Prediction for Pay-As-Bid Ancillary Services Markets: A Use Case in the German Control Reserve Market21 Mar 2025
- 2025TabGLM: Tabular Graph Language Model for Learning Transferable Representations Through Multi-Modal Consistency Minimization26 Feb 2025
- 2025Predictive Modeling and Uncertainty Quantification of Fatigue Life in Metal Alloys using Machine Learning25 Jan 2025
- 2025Evaluation of Artificial Intelligence Methods for Lead Time Prediction in Non-Cycled Areas of Automotive Production13 Jan 2025
- 2024High-dimensional Statistics Applications to Batch Effects in Metabolomics13 Dec 2024
- 2024Semi-decentralized Training of Spatio-Temporal Graph Neural Networks for Traffic Prediction4 Dec 2024
- 2024Classifying Simulated Gait Impairments using Privacy-preserving Explainable Artificial Intelligence and Mobile Phone Videos2 Dec 2024
- 2024An Oversampling-enhanced Multi-class Imbalanced Classification Framework for Patient Health Status Prediction Using Patient-reported Outcomes16 Nov 2024
- 2024Supervised Score-Based Modeling by Gradient Boosting2 Nov 2024
- 2024Benchmark Data Repositories for Better Benchmarking31 Oct 2024
- 2024Minimal Variance Model Aggregation: A principled, non-intrusive, and versatile integration of black box models25 Sep 2024
- 2024Pareto Data Framework: Steps Towards Resource-Efficient Decision Making Using Minimum Viable Data (MVD)18 Sep 2024
- 2024Exploratory Visual Analysis for Increasing Data Readiness in Artificial Intelligence Projects5 Sep 2024
- 2024A Comprehensive Benchmark of Machine and Deep Learning Across Diverse Tabular Datasets27 Aug 2024
- 2024A Deep Features-Based Approach Using Modified ResNet50 and Gradient Boosting for Visual Sentiments Classification15 Aug 2024
- 2024Integrating White and Black Box Techniques for Interpretable Machine Learning12 Jul 2024
- 2024Dataset Representativeness and Downstream Task Fairness28 Jun 2024
- 2024SimClone: Detecting Tabular Data Clones using Value Similarity24 Jun 2024
- 2024Classification Modeling with RNN-Based, Random Forest, and XGBoost for Imbalanced Data: A Case of Early Crash Detection in ASEAN-5 Stock Markets12 Jun 2024
- 2024Use of Boosting Algorithms in Household-Level Poverty Measurement: A Machine Learning Approach to Predict and Classify Household Wealth Quintiles in the Philippines28 May 2024
- 2024Interpretable classification of wiki-review streams28 May 2024
- 2024Exploring Speech Pattern Disorders in Autism using Machine Learning3 May 2024
50 newest of 80 All 80 (JSON)
- 2024Supervised Score-Based Modeling by Gradient Boostingcited by 1
- 2024Supervised Score-Based Modeling by Gradient Boosting2 Nov 2024
- 2021Boost then Convolve: Gradient Boosting Meets Graph Neural Networkscited by 44
- 2023A review of ensemble learning and data augmentation models for class imbalanced problems: combination, implementation and evaluationcited by 25
- 2025Transformer Copilot: Learning from The Mistake Log in LLM Fine-tuningcited by 21
- 2024A Comprehensive Benchmark of Machine and Deep Learning Across Diverse Tabular Datasetscited by 15
- 2021Scalable Gaussian Processes for Data-Driven Design using Big Data with Categorical Factorscited by 11
- 2024Benchmark Data Repositories for Better Benchmarkingcited by 10
- 2022A k-additive Choquet integral-based approach to approximate the SHAP values for local interpretability in machine learningcited by 8
- 2023HyperTime: Hyperparameter Optimization for Combating Temporal Distribution Shiftscited by 8
- 2023Enhanced Gradient Boosting for Zero-Inflated Insurance Claims and Comparative Analysis of CatBoost, XGBoost, and LightGBMcited by 5
- 2023Benchmarking state-of-the-art gradient boosting algorithms for classificationcited by 4
- 2025MorphBoost: Self-Organizing Universal Gradient Boosting with Adaptive Tree Morphingcited by 4
- 2022The MIT Supercloud Workload Classification Challengecited by 3
12 most cited of 78 All 78 (JSON)
- 2026Causal multi-modal AI for personalized chemosensitivity prediction11 Sep 2026
- 2026ITBoost: Information-Theoretic Trust for Robust Boosting6 May 2026
- 2026Skeleton-Based Posture Classification to Promote Safer Walker-Assisted Gait in Older Adults27 Apr 2026
- 2026Developing Machine Learning-Based Watch-to-Warning Severe Weather Guidance from the Warn-on-Forecast System10 Mar 2026
- 2026Robust multi-task boosting using clustering and local ensembling15 Feb 2026
- 2026Deep learning approaches show promise for predicting childhood malnutrition: A comparative study with traditional machine learning methods using survey data11 Feb 2026
- 2025Adaptive Graph Pruning with Sudden-Events Evaluation for Traffic Prediction using Online Semi-Decentralized ST-GNNs19 Dec 2025
- 2025Neural Factorization-based Bearing Fault Diagnosis7 Dec 2025
- 2025Enhancing Dimensionality Prediction in Hybrid Metal Halides via Feature Engineering and Class-Imbalance Mitigation5 Dec 2025
- 2025Data-driven Prediction of Species-Specific Plant Responses to Spectral-Shifting Films from Leaf Phenotypic and Photosynthetic Traits19 Nov 2025
- 2025MorphBoost: Self-Organizing Universal Gradient Boosting with Adaptive Tree Morphing17 Nov 2025
- 2025Q-Sat AI: Machine Learning-Based Decision Support for Data Saturation in Qualitative Studies2 Nov 2025
12 newest of 78 All 78 (JSON)