Narrowing the Gap: Random Forests In Theory and In Practice
Not on the map. Why?
Abstract (arXiv)
Despite widespread interest and practical use, the theoretical properties of random forests are still not well understood. In this paper we contribute to this understanding in two ways. We present a new theoretically tractable variant of random regression forests and prove that our algorithm is consistent. We also provide an empirical evaluation, comparing our algorithm and other theoretically tractable random forest models to the random forest algorithm used in practice. Our experiments provide insight into the relative importance of different simplifications that theoreticians have made to obtain tractable models for analysis.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 Oct 2013.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 3; 2023: 4; 2024: 1; 2025: 3; 2026: 1.
17 papers.
Sort:
- 2022Adversarial random forests for density estimation and generative modelingcited by 44
- 2021Large Scale Prediction with Decision Treescited by 28
- 2022Survival Kernets: Scalable and Interpretable Deep Kernel Survival Analysis with an Accuracy Guaranteecited by 9
- 2021Muddling Label Regularization: Deep Learning for Tabular Datasetscited by 5
- 2021There is no Double-Descent in Random Forestscited by 4
- 2023Stability of Random Forests and Coverage of Random-Forest Prediction Intervalscited by 4
- 2021Improving the Accuracy-Memory Trade-Off of Random Forests Via Leaf-Refinementcited by 3
- 2021Label Ranking through Nonparametric Regressioncited by 3
- 2025Autoencoding Random Forestscited by 3
- 2023Targeting relative risk heterogeneity with causal forestscited by 1
- 2025Multivariate Uncertainty Quantification with Tomographic Quantile Forestscited by 1
- 2022Data-driven multinomial random forest: A new random forest variant with strong consistencycited by 0
5 more
- 2023Data-driven multinomial random forestcited by 0
- 2023Generalized Random Forests using Fixed-Point Treescited by 0
- 2024The Role of Depth, Width, and Tree Size in Expressiveness of Deep Forestcited by 0
- 2025Targeted tuning of random forests for quantile estimation and prediction intervalscited by 0
- 2026Covariance-Driven Regression Trees: Reducing Overfitting in CARTcited by 0
- 2026Covariance-Driven Regression Trees: Reducing Overfitting in CART12 Jan 2026
- 2025Multivariate Uncertainty Quantification with Tomographic Quantile Forests18 Dec 2025
- 2025Targeted tuning of random forests for quantile estimation and prediction intervals2 Jul 2025
- 2025Autoencoding Random Forests27 May 2025
- 2024The Role of Depth, Width, and Tree Size in Expressiveness of Deep Forest6 Jul 2024
- 2023Stability of Random Forests and Coverage of Random-Forest Prediction Intervals28 Oct 2023
- 2023Targeting relative risk heterogeneity with causal forests26 Sep 2023
- 2023Generalized Random Forests using Fixed-Point Trees20 Jun 2023
- 2023Data-driven multinomial random forest9 Apr 2023
- 2022Data-driven multinomial random forest: A new random forest variant with strong consistency28 Nov 2022
- 2022Survival Kernets: Scalable and Interpretable Deep Kernel Survival Analysis with an Accuracy Guarantee21 Jun 2022
- 2022Adversarial random forests for density estimation and generative modeling19 May 2022
5 more
- 2021There is no Double-Descent in Random Forests8 Nov 2021
- 2021Label Ranking through Nonparametric Regression4 Nov 2021
- 2021Improving the Accuracy-Memory Trade-Off of Random Forests Via Leaf-Refinement19 Oct 2021
- 2021Muddling Label Regularization: Deep Learning for Tabular Datasets8 Jun 2021
- 2021Large Scale Prediction with Decision Trees28 Apr 2021
- 2022Adversarial random forests for density estimation and generative modelingcited by 44
- 2021Large Scale Prediction with Decision Treescited by 28
- 2022Survival Kernets: Scalable and Interpretable Deep Kernel Survival Analysis with an Accuracy Guaranteecited by 9
- 2021Muddling Label Regularization: Deep Learning for Tabular Datasetscited by 5
- 2021There is no Double-Descent in Random Forestscited by 4
- 2023Stability of Random Forests and Coverage of Random-Forest Prediction Intervalscited by 4
- 2021Improving the Accuracy-Memory Trade-Off of Random Forests Via Leaf-Refinementcited by 3
- 2021Label Ranking through Nonparametric Regressioncited by 3
- 2025Autoencoding Random Forestscited by 3
- 2023Targeting relative risk heterogeneity with causal forestscited by 1
- 2025Multivariate Uncertainty Quantification with Tomographic Quantile Forestscited by 1
- 2022Data-driven multinomial random forest: A new random forest variant with strong consistencycited by 0
12 most cited of 17 All 17 (JSON)
- 2026Covariance-Driven Regression Trees: Reducing Overfitting in CART12 Jan 2026
- 2025Multivariate Uncertainty Quantification with Tomographic Quantile Forests18 Dec 2025
- 2025Targeted tuning of random forests for quantile estimation and prediction intervals2 Jul 2025
- 2025Autoencoding Random Forests27 May 2025
- 2024The Role of Depth, Width, and Tree Size in Expressiveness of Deep Forest6 Jul 2024
- 2023Stability of Random Forests and Coverage of Random-Forest Prediction Intervals28 Oct 2023
- 2023Targeting relative risk heterogeneity with causal forests26 Sep 2023
- 2023Generalized Random Forests using Fixed-Point Trees20 Jun 2023
- 2023Data-driven multinomial random forest9 Apr 2023
- 2022Data-driven multinomial random forest: A new random forest variant with strong consistency28 Nov 2022
- 2022Survival Kernets: Scalable and Interpretable Deep Kernel Survival Analysis with an Accuracy Guarantee21 Jun 2022
- 2022Adversarial random forests for density estimation and generative modeling19 May 2022
12 newest of 17 All 17 (JSON)