A Random Forest Guided Tour
Not on the map. Why?
Abstract (arXiv)
The random forest algorithm, proposed by L. Breiman in 2001, has been extremely successful as a general-purpose classification and regression method. The approach, which combines several randomized decision trees and aggregates their predictions by averaging, has shown excellent performance in settings where the number of variables is much larger than the number of observations. Moreover, it is versatile enough to be applied to large-scale problems, is easily adapted to various ad-hoc learning tasks, and returns measures of variable importance. The present article reviews the most recent theoretical and methodological developments for random forests. Emphasis is placed on the mathematical forces driving the algorithm, with special attention given to the selection of parameters, the resampling mechanism, and variable importance measures. This review is intended to provide non-experts easy access to the main ideas.
Key facts. Cited by 168 papers in the map (data through 14 Oct 2026). First posted on arXiv 18 Nov 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 22; 2022: 32; 2023: 30; 2024: 34; 2025: 31; 2026: 19.
168 papers.
Sort:
By area:
- 2024HARGPT: Are LLMs Zero-Shot Human Activity Recognizers?cited by 54
- 2022Adversarial random forests for density estimation and generative modelingcited by 44
- 2021Classification with abstention but without disparitiescited by 28
- 2023A review of ensemble learning and data augmentation models for class imbalanced problems: combination, implementation and evaluationcited by 25
- 2023Chemist-X: Large Language Model-empowered Agent for Reaction Condition Recommendation in Chemical Synthesiscited by 25
- 2021Optimal randomized classification treescited by 16
- 2021Bridging observation, theory and numerical simulation of the ocean using Machine Learningcited by 15
- 2024Why do Random Forests Work? Understanding Tree Ensembles as Self-Regularizing Adaptive Smootherscited by 15
- 2021Unveiling the potential of Graph Neural Networks for robust Intrusion Detectioncited by 14
- 2021Trees, Forests, Chickens, and Eggs: When and Why to Prune Trees in a Random Forestcited by 13
- 2021A cautionary tale on fitting decision trees to data from additive models: generalization lower boundscited by 9
- 2022Action Conditioned Tactile Prediction: case study on slip predictioncited by 8
38 more
- 2022A k-additive Choquet integral-based approach to approximate the SHAP values for local interpretability in machine learningcited by 8
- 2021Bridging Breiman's Brook: From Algorithmic Modeling to Statistical Learningcited by 7
- 2022IGRF-RFE: A Hybrid Feature Selection Method for MLP-based Network Intrusion Detection on UNSW-NB15 Datasetcited by 7
- 2024Keeping Deep Learning Models in Check: A History-Based Approach to Mitigate Overfittingcited by 6
- 2021On the Trustworthiness of Tree Ensemble Explainability Methodscited by 5
- 2022Counter Hate Speech in Social Media: A Surveycited by 5
- 2023Optimal Weighted Random Forestscited by 5
- 2024An Evaluation of Large Language Models in Bioinformatics Researchcited by 5
- 2025Exploring the Capabilities of LLMs for IMU-based Fine-grained Human Activity Understandingcited by 5
- 2021Multivariate Data Explanation by Jumping Emerging Patterns Visualizationcited by 4
- 2021Minimax Rates for High-Dimensional Random Tessellation Forestscited by 4
- 2021There is no Double-Descent in Random Forestscited by 4
- 2022Meta-Learners for Estimation of Causal Effects: Finite Sample Cross-Fit Performancecited by 4
- 2022Self-supervised learning -- A way to minimize time and effort for precision agriculture?cited by 4
- 2023Leveraging Brain Modularity Prior for Interpretable Representation Learning of fMRIcited by 4
- 2023Stability of Random Forests and Coverage of Random-Forest Prediction Intervalscited by 4
- 2024Detecting Anomalies in Blockchain Transactions using Machine Learning Classifiers and Explainability Analysiscited by 4
- 2024Open Set Recognition for Random Forestcited by 4
- 2024Free Lunch in the Forest: Functionally-Identical Pruning of Boosted Tree Ensemblescited by 4
- 2021Feature Analyses and Modelling of Lithium-ion Batteries Manufacturing based on Random Forest Classificationcited by 3
- 2021Improving the Accuracy-Memory Trade-Off of Random Forests Via Leaf-Refinementcited by 3
- 2023Machine Learning technique for isotopic determination of radioisotopes using HPGe γ-ray spectracited by 3
- 2023RF+clust for Leave-One-Problem-Out Performance Predictioncited by 3
- 2023Enhancing Supply Chain Resilience: A Machine Learning Approach for Predicting Product Availability Dates Under Disruptioncited by 3
- 2023Landslide Topology Uncovers Failure Movementscited by 3
- 2023Comprehensive Validation on Reweighting Samples for Bias Mitigation via AIF360cited by 3
- 2024TwinBooster: Synergising Large Language Models with Barlow Twins and Gradient Boosting for Enhanced Molecular Property Predictioncited by 3
- 2024A Survey of Features Used for Representing Black-box Single-objective Continuous Optimizationcited by 3
- 2025Autoencoding Random Forestscited by 3
- 2026Australian Bushfire Intelligence with AI-Driven Environmental Analyticscited by 3
- 2026Decorrelation, Diversity, and Emergent Intelligence: The Isomorphism Between Social Insect Colonies and Ensemble Machine Learningcited by 3
- 2022Manifoldron: Direct Space Partition via Manifold Discoverycited by 2
- 2022Don't Explain Noise: Robust Counterfactuals for Randomized Ensemblescited by 2
- 2022A Mathematical Programming Approach to Optimal Classification Forestscited by 2
- 2022Beyond Ensemble Averages: Leveraging Climate Model Ensembles for Subseasonal Forecastingcited by 2
- 2022AI-enabled exploration of Instagram profiles predicts soft skills and personality traits to empower hiring decisionscited by 2
- 2023FITNESS: A Causal De-correlation Approach for Mitigating Bias in Machine Learning Softwarecited by 2
- 2023Sensitivity Analysis of RF+clust for Leave-one-problem-out Performance Predictioncited by 2
50 most cited of 168 All 168 (JSON)
- 2026FMMO: Detecting the Divergence Between Local Attribution and Global Drift5 Sep 2026
- 2026Beyond Landmark Extraction: A Framework for Robust Geometric Feature Construction in Structured Image Classification1 Sep 2026
- 2026Interpretable statistical feature engineering for early disruption prediction in the short pulse ADITYA tokamak23 Aug 2026
- 2026Dynamical Lie Algebras Cannot Describe Shallow QAOA: Cragged Terrains, Barren Plateaus, and Empirical Hardness Models4 Aug 2026
- 2026A Stationary-Distribution Theory for Triplet-Based Plateau Search in Random Forest Ensemble-Size Selection29 Jun 2026
- 2026Kernel of Partition Paths: A Unified Representation for Tree Ensembles17 Jun 2026
- 2026How Many Trees in a Random Forest? A Revisited Approach with Plateau Search and Optuna Integration2 Jun 2026
- 2026PINE: Pruning Boosted Tree Ensembles with Conformal In-Distribution Prediction Equivalence27 May 2026
- 2026Minimax Rates and Spectral Distillation for Tree Ensembles12 May 2026
- 2026When Does ℓ2-Boosting Overfit Benignly? High-Dimensional Risk Asymptotics and the ℓ1 Implicit Bias7 May 2026
- 2026CRADIPOR: Crash Dispersion Predictor30 Apr 2026
- 2026Towards Counterfactual Explanation and Assertion Inference for CPS Debugging9 Apr 2026
38 more
- 2026Quantum Random Forest for the Regression Problem24 Mar 2026
- 2026Decorrelation, Diversity, and Emergent Intelligence: The Isomorphism Between Social Insect Colonies and Ensemble Machine Learning20 Mar 2026
- 2026Random Forests as Statistical Procedures: Design, Variance, and Dependence13 Feb 2026
- 2026Aggregate Models, Not Explanations: Improving Feature Importance Estimation12 Feb 2026
- 2026Principled Federated Random Forests for Heterogeneous Data3 Feb 2026
- 2026Prediction of Cellular Malignancy Using Electrical Impedance Signatures and Supervised Machine Learning8 Jan 2026
- 2026Australian Bushfire Intelligence with AI-Driven Environmental Analytics3 Jan 2026
- 2025Deep classifier kriging for probabilistic spatial prediction of air quality index29 Dec 2025
- 2025Fairness Is Not Just Ethical: Performance Trade-Off via Data Correlation Tuning to Mitigate Bias in ML Software19 Dec 2025
- 2025Distributional Random Forests for Complex Survey Designs9 Dec 2025
- 2025Graph Convolutional Long Short-Term Memory Attention Network for Post-Stroke Compensatory Movement Detection Based on Skeleton Data7 Dec 2025
- 2025Functional Random Forest with Adaptive Cost-Sensitive Splitting for Imbalanced Functional Data Classification2 Dec 2025
- 2025ParaGate: Parasitic-Driven Domain Adaptation Transfer Learning for Netlist Performance Prediction28 Nov 2025
- 2025Empirical Likelihood for Random Forests and Ensembles17 Nov 2025
- 2025Improving Neutrino Oscillation Measurements through Event Classification14 Nov 2025
- 2025Detecting Vulnerabilities from Issue Reports for Internet-of-Things3 Nov 2025
- 2025MH-1M: A 1.34 Million-Sample Comprehensive Multi-Feature Android Malware Dataset for Machine Learning, Deep Learning, Large Language Models, and Threat Intelligence Research1 Nov 2025
- 2025Interpretable Model-Aware Counterfactual Explanations for Random Forest31 Oct 2025
- 2025DiNo and RanBu: Lightweight Predictions from Shallow Random Forests23 Oct 2025
- 2025Transfer Learning with Distance Covariance for Random Forest: Error Bounds and an EHR Application13 Oct 2025
- 2025TreeNet: Layered Decision Ensembles7 Oct 2025
- 2025Comparison of Deterministic and Probabilistic Machine Learning Algorithms for Precise Dimensional Control and Uncertainty Quantification in Additive Manufacturing15 Sep 2025
- 2025Discovering equations from data: symbolic regression in dynamical systems27 Aug 2025
- 2025Dac-Fake: A Divide and Conquer Framework for Detecting Fake News on Social Media22 Aug 2025
- 2025Tracing the Interactions of Modular CMA-ES Configurations Across Problem Landscapes3 Jul 2025
- 2025Customized Exploration of Landscape Features Driving Multi-Objective Combinatorial Optimization Performance2 Jul 2025
- 2025Targeted tuning of random forests for quantile estimation and prediction intervals2 Jul 2025
- 2025WANDER: An Explainable Decision-Support Framework for HPC4 Jun 2025
- 2025Self-supervised Learning Method Using Transformer for Multi-dimensional Sensor Data Processing28 May 2025
- 2025Autoencoding Random Forests27 May 2025
- 2025Measuring Social Influence with Networked Synthetic Control19 May 2025
- 2025Learning to fuse: dynamic integration of multi-source data for accurate battery lifespan prediction25 Apr 2025
- 2025Orbit Determination through Cosmic Microwave Background Radiation3 Apr 2025
- 2025Exploring the Capabilities of LLMs for IMU-based Fine-grained Human Activity Understanding2 Apr 2025
- 2025Examining the Mental Health Impact of Misinformation on Social Media Using a Hybrid Transformer-Based Approach4 Mar 2025
- 2025Deep learning and classical computer vision techniques in medical image analysis: Case studies on brain MRI tissue segmentation, lung CT COPD registration, and skin lesion classification26 Feb 2025
- 2025Identifying Flaky Tests in Quantum Code: A Machine Learning Approach6 Feb 2025
- 2025Generalized coarsened confounding for causal effects: a large-sample framework6 Jan 2025
50 newest of 168 All 168 (JSON)
- 2024HARGPT: Are LLMs Zero-Shot Human Activity Recognizers?cited by 54
- 2022Adversarial random forests for density estimation and generative modelingcited by 44
- 2021Classification with abstention but without disparitiescited by 28
- 2023A review of ensemble learning and data augmentation models for class imbalanced problems: combination, implementation and evaluationcited by 25
- 2021Optimal randomized classification treescited by 16
- 2021Bridging observation, theory and numerical simulation of the ocean using Machine Learningcited by 15
- 2024Why do Random Forests Work? Understanding Tree Ensembles as Self-Regularizing Adaptive Smootherscited by 15
- 2021Unveiling the potential of Graph Neural Networks for robust Intrusion Detectioncited by 14
- 2021Trees, Forests, Chickens, and Eggs: When and Why to Prune Trees in a Random Forestcited by 13
- 2021A cautionary tale on fitting decision trees to data from additive models: generalization lower boundscited by 9
- 2022Action Conditioned Tactile Prediction: case study on slip predictioncited by 8
- 2022A k-additive Choquet integral-based approach to approximate the SHAP values for local interpretability in machine learningcited by 8
12 most cited of 167 All 167 (JSON)
- 2026FMMO: Detecting the Divergence Between Local Attribution and Global Drift5 Sep 2026
- 2026Beyond Landmark Extraction: A Framework for Robust Geometric Feature Construction in Structured Image Classification1 Sep 2026
- 2026Interpretable statistical feature engineering for early disruption prediction in the short pulse ADITYA tokamak23 Aug 2026
- 2026Dynamical Lie Algebras Cannot Describe Shallow QAOA: Cragged Terrains, Barren Plateaus, and Empirical Hardness Models4 Aug 2026
- 2026A Stationary-Distribution Theory for Triplet-Based Plateau Search in Random Forest Ensemble-Size Selection29 Jun 2026
- 2026Kernel of Partition Paths: A Unified Representation for Tree Ensembles17 Jun 2026
- 2026How Many Trees in a Random Forest? A Revisited Approach with Plateau Search and Optuna Integration2 Jun 2026
- 2026PINE: Pruning Boosted Tree Ensembles with Conformal In-Distribution Prediction Equivalence27 May 2026
- 2026Minimax Rates and Spectral Distillation for Tree Ensembles12 May 2026
- 2026When Does ℓ2-Boosting Overfit Benignly? High-Dimensional Risk Asymptotics and the ℓ1 Implicit Bias7 May 2026
- 2026CRADIPOR: Crash Dispersion Predictor30 Apr 2026
- 2026Towards Counterfactual Explanation and Assertion Inference for CPS Debugging9 Apr 2026
12 newest of 167 All 167 (JSON)