mlsanityData to 7 Oct 2026

Hyperparameters and Tuning Strategies for Random Forest

arXiv 1804.03515 ↗First posted 10 Apr 2018stat.ML cs.LGcited by 83

Not on the map. Why?

Abstract (arXiv)

The random forest algorithm (RF) has several hyperparameters that have to be set by the user, e.g., the number of observations drawn randomly for each tree and whether they are drawn with or without replacement, the number of variables drawn randomly for each split, the splitting rule, the minimum number of samples that a node must contain and the number of trees. In this paper, we first provide a literature review on the parameters' influence on the prediction performance and on variable importance measures. It is well known that in most cases RF works reasonably well with the default values of the hyperparameters specified in software packages. Nevertheless, tuning the hyperparameters can improve the performance of RF. In the second part of this paper, after a brief overview of tuning strategies we demonstrate the application of one of the most established tuning strategies, model-based optimization (MBO). To make it easier to use, we provide the tuneRanger R package that tunes RF with MBO automatically. In a benchmark study on several datasets, we compare the prediction performance and runtime of tuneRanger with other tuning implementations in R and RF with default hyperparameters.

Key facts. Cited by 83 papers in the map (data through 7 Oct 2026). First posted on arXiv 10 Apr 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 17; 2022: 16; 2023: 15; 2024: 21; 2025: 9; 2026: 5.

83 papers.

Sort:

By area:

  1. 2021Hyperparameter Optimization: Foundations, Algorithms, Best Practices and Open Challengescited by 143
  2. 2022Adversarial random forests for density estimation and generative modelingcited by 44
  3. 2023Kriging Convolutional Networkscited by 30
  4. 2021Large Scale Prediction with Decision Treescited by 28
  5. 2021Regularized target encoding outperforms traditional methods in supervised machine learning with high cardinality featurescited by 20
  6. 2022MeltpoolNet: Melt pool Characteristic Prediction in Metal Additive Manufacturing Using Machine Learningcited by 19
  7. 2024A Unified Debiasing Approach for Vision-Language Models across Modalities and Taskscited by 18
  8. 2021Trees, Forests, Chickens, and Eggs: When and Why to Prune Trees in a Random Forestcited by 13
  9. 2021Data-driven discovery of interpretable causal relations for deep learning material laws with uncertainty propagationcited by 10
  10. 2022Machine Learning-Enabled IoT Security: Open Issues and Challenges Under Advanced Persistent Threatscited by 7
  11. 2023Strengthening structural baselines for graph classification using Local Topological Profilecited by 7
  12. 2023Medoid splits for efficient random forests in metric spacescited by 7
38 more
  1. 2021When are Deep Networks really better than Decision Forests at small sample sizes, and how?cited by 6
  2. 2021On Wasted Contributions: Understanding the Dynamics of Contributor-Abandoned Pull Requestscited by 6
  3. 2023Constrained Twin Variational Auto-Encoder for Intrusion Detection in IoT Systemscited by 5
  4. 2022What Makes Forest-Based Heterogeneous Treatment Effect Estimators Work?cited by 4
  5. 2022MABSplit: Faster Forest Training Using Multi-Armed Banditscited by 4
  6. 2023Double Machine Learning for Static Panel Models with Fixed Effectscited by 4
  7. 2021Product Progression: a machine learning approach to forecasting industrial upgradingcited by 3
  8. 2022A Survey on Automated Sarcasm Detection on Twittercited by 3
  9. 2023Conceptual Views on Tree Ensemble Classifierscited by 3
  10. 2023A Comprehensive Study of Machine Learning Techniques for Log-Based Anomaly Detectioncited by 3
  11. 2024Aligning Tutor Discourse Supporting Rigorous Thinking with Tutee Content Mastery for Predicting Math Achievementcited by 3
  12. 2025Modern Neural Networks for Small Tabular Datasets: The New Default for Field-Scale Digital Soil Mapping?cited by 3
  13. 2021CovidAlert -- A Wristwatch-based System to Alert Users from Face Touchingcited by 2
  14. 2021Manifold embedding data-driven mechanicscited by 2
  15. 2022Machine learning to assess relatedness: the advantage of using firm-level datacited by 2
  16. 2022Trying to Outrun Causality with Machine Learning: Limitations of Model Explainability Techniques for Identifying Predictive Variablescited by 2
  17. 2022MechProNet: Machine Learning Prediction of Mechanical Properties in Metal Additive Manufacturingcited by 2
  18. 2022Post-Selection Confidence Bounds for Prediction Performancecited by 2
  19. 2023Learning to Select SAT Encodings for Pseudo-Boolean and Linear Integer Constraintscited by 2
  20. 2024Data Distribution-based Curriculum Learningcited by 2
  21. 2024Estimating Heterogeneous Treatment Effects by Combining Weak Instruments and Observational Datacited by 2
  22. 2024Which Imputation Fits Which Feature Selection Method? A Survey-Based Simulation Studycited by 2
  23. 2025Foundation for unbiased cross-validation of spatio-temporal models for species distribution modelingcited by 2
  24. 2022Artificial Intelligence-Based Analytics for Impacts of COVID-19 and Online Learning on College Students' Mental Healthcited by 1
  25. 2022Augmented cross-selling through explainable AI -- a case from energy retailingcited by 1
  26. 2023Random forests, sound symbolism and Pokemon evolutioncited by 1
  27. 2023SLEM: Machine Learning for Path Modeling and Causal Inference with Super Learner Equation Modelingcited by 1
  28. 2024Understanding overfitting in random forest for probability estimation: a visualization and simulation studycited by 1
  29. 2024missForestPredict -- Missing data imputation for prediction settingscited by 1
  30. 2024Can a Single Tree Outperform an Entire Forest?cited by 1
  31. 2026How Many Trees in a Random Forest? A Revisited Approach with Plateau Search and Optuna Integrationcited by 1
  32. 2021Advances in Electron Microscopy with Deep Learningcited by 0
  33. 2021Analysis of the Evolution of Parametric Drivers of High-End Sea-Level Hazardscited by 0
  34. 2021Experimental Investigation and Evaluation of Model-based Hyperparameter Optimizationcited by 0
  35. 2021Fast Estimation Method for the Stability of Ensemble Feature Selectorscited by 0
  36. 2021WildWood: a new Random Forest algorithmcited by 0
  37. 2021Rapid Assessments of Light-Duty Gasoline Vehicle Emissions Using On-Road Remote Sensing and Machine Learningcited by 0
  38. 2021Machine Learning-based Prediction of Porosity for Concrete Containing Supplementary Cementitious Materialscited by 0

50 most cited of 83 All 83 (JSON)