# Hyperparameters and Tuning Strategies for Random Forest

arXiv: https://arxiv.org/abs/1804.03515 · HTML: https://mlsanity.com/paper/1804.03515/

## Key facts

- Cited by 84 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 10 Apr 2018.

## Built on by (most cited first, 30 of 84)

- [Hyperparameter Optimization: Foundations, Algorithms, Best Practices and Open Challenges](https://mlsanity.com/paper/2107.05847/) (2021)
- [Adversarial random forests for density estimation and generative modeling](https://mlsanity.com/paper/2205.09435/) (2022)
- [Kriging Convolutional Networks](https://mlsanity.com/paper/2306.09463/) (2023)
- [Large Scale Prediction with Decision Trees](https://mlsanity.com/paper/2104.13881/) (2021)
- [Regularized target encoding outperforms traditional methods in supervised machine learning with high cardinality features](https://mlsanity.com/paper/2104.00629/) (2021)
- [MeltpoolNet: Melt pool Characteristic Prediction in Metal Additive Manufacturing Using Machine Learning](https://mlsanity.com/paper/2201.11662/) (2022)
- [A Unified Debiasing Approach for Vision-Language Models across Modalities and Tasks](https://mlsanity.com/paper/2410.07593/) (2024)
- [Trees, Forests, Chickens, and Eggs: When and Why to Prune Trees in a Random Forest](https://mlsanity.com/paper/2103.16700/) (2021)
- [Data-driven discovery of interpretable causal relations for deep learning material laws with uncertainty propagation](https://mlsanity.com/paper/2105.09980/) (2021)
- [Machine Learning-Enabled IoT Security: Open Issues and Challenges Under Advanced Persistent Threats](https://mlsanity.com/paper/2204.03433/) (2022)
- [Strengthening structural baselines for graph classification using Local Topological Profile](https://mlsanity.com/paper/2305.00724/) (2023)
- [Medoid splits for efficient random forests in metric spaces](https://mlsanity.com/paper/2306.17031/) (2023)
- [When are Deep Networks really better than Decision Forests at small sample sizes, and how?](https://mlsanity.com/paper/2108.13637/) (2021)
- [On Wasted Contributions: Understanding the Dynamics of Contributor-Abandoned Pull Requests](https://mlsanity.com/paper/2110.15447/) (2021)
- [Constrained Twin Variational Auto-Encoder for Intrusion Detection in IoT Systems](https://mlsanity.com/paper/2312.02490/) (2023)
- [What Makes Forest-Based Heterogeneous Treatment Effect Estimators Work?](https://mlsanity.com/paper/2206.10323/) (2022)
- [MABSplit: Faster Forest Training Using Multi-Armed Bandits](https://mlsanity.com/paper/2212.07473/) (2022)
- [A Comprehensive Study of Machine Learning Techniques for Log-Based Anomaly Detection](https://mlsanity.com/paper/2307.16714/) (2023)
- [Double Machine Learning for Static Panel Models with Fixed Effects](https://mlsanity.com/paper/2312.08174/) (2023)
- [Modern Neural Networks for Small Tabular Datasets: The New Default for Field-Scale Digital Soil Mapping?](https://mlsanity.com/paper/2508.09888/) (2025)
- [Product Progression: a machine learning approach to forecasting industrial upgrading](https://mlsanity.com/paper/2105.15018/) (2021)
- [A Survey on Automated Sarcasm Detection on Twitter](https://mlsanity.com/paper/2202.02516/) (2022)
- [Conceptual Views on Tree Ensemble Classifiers](https://mlsanity.com/paper/2302.05270/) (2023)
- [Aligning Tutor Discourse Supporting Rigorous Thinking with Tutee Content Mastery for Predicting Math Achievement](https://mlsanity.com/paper/2405.06218/) (2024)
- [Foundation for unbiased cross-validation of spatio-temporal models for species distribution modeling](https://mlsanity.com/paper/2502.03480/) (2025)
- [CovidAlert -- A Wristwatch-based System to Alert Users from Face Touching](https://mlsanity.com/paper/2112.00131/) (2021)
- [Manifold embedding data-driven mechanics](https://mlsanity.com/paper/2112.09842/) (2021)
- [Machine learning to assess relatedness: the advantage of using firm-level data](https://mlsanity.com/paper/2202.00458/) (2022)
- [Trying to Outrun Causality with Machine Learning: Limitations of Model Explainability Techniques for Identifying Predictive Variables](https://mlsanity.com/paper/2202.09875/) (2022)
- [MechProNet: Machine Learning Prediction of Mechanical Properties in Metal Additive Manufacturing](https://mlsanity.com/paper/2209.12605/) (2022)

## Abstract (arXiv)

The random forest algorithm (RF) has several hyperparameters that have to be set by the user, e.g., the number of observations drawn randomly for each tree and whether they are drawn with or without replacement, the number of variables drawn randomly for each split, the splitting rule, the minimum number of samples that a node must contain and the number of trees. In this paper, we first provide a literature review on the parameters' influence on the prediction performance and on variable importance measures. It is well known that in most cases RF works reasonably well with the default values of the hyperparameters specified in software packages. Nevertheless, tuning the hyperparameters can improve the performance of RF. In the second part of this paper, after a brief overview of tuning strategies we demonstrate the application of one of the most established tuning strategies, model-based optimization (MBO). To make it easier to use, we provide the tuneRanger R package that tunes RF with MBO automatically. In a benchmark study on several datasets, we compare the prediction performance and runtime of tuneRanger with other tuning implementations in R and RF with default hyperparameters.