# Interpreting Tree Ensembles with inTrees

arXiv: https://arxiv.org/abs/1408.5456 · HTML: https://mlsanity.com/paper/1408.5456/

## Key facts

- Cited by 37 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 23 Aug 2014.

## Built on by (most cited first, 30 of 37)

- [CARLA: A Python Library to Benchmark Algorithmic Recourse and Counterfactual Explanation Algorithms](https://mlsanity.com/paper/2108.00783/) (2021)
- [Leveraging Explanations in Interactive Machine Learning: An Overview](https://mlsanity.com/paper/2207.14526/) (2022)
- [GLocalX -- From Local to Global Explanations of Black Box AI Models](https://mlsanity.com/paper/2101.07685/) (2021)
- [Fast Sparse Decision Tree Optimization via Reference Ensembles](https://mlsanity.com/paper/2112.00798/) (2021)
- [Amortized Generation of Sequential Algorithmic Recourses for Black-box Models](https://mlsanity.com/paper/2106.03962/) (2021)
- [Explainable AI for clinical and remote health applications: a survey on tabular and time series data](https://mlsanity.com/paper/2209.06528/) (2022)
- [Conclusive Local Interpretation Rules for Random Forests](https://mlsanity.com/paper/2104.06040/) (2021)
- [AcME -- Accelerated Model-agnostic Explanations: Fast Whitening of the Machine-Learning Black Box](https://mlsanity.com/paper/2112.12635/) (2021)
- [A Survey of Privacy-Preserving Model Explanations: Privacy Risks, Attacks, and Countermeasures](https://mlsanity.com/paper/2404.00673/) (2024)
- [Explainable Global Fairness Verification of Tree-Based Classifiers](https://mlsanity.com/paper/2209.13179/) (2022)
- [Explainable AI applications in the Medical Domain: a systematic review](https://mlsanity.com/paper/2308.05411/) (2023)
- [Decision Predicate Graphs: Enhancing Interpretability in Tree Ensembles](https://mlsanity.com/paper/2404.02942/) (2024)
- [Generating Explainable Rule Sets from Tree-Ensemble Learning Methods by Answer Set Programming](https://mlsanity.com/paper/2109.08290/) (2021)
- [Local Multi-Label Explanations for Random Forest](https://mlsanity.com/paper/2207.01994/) (2022)
- [MachineLearningLM: Scaling Many-shot In-context Learning via Continued Pretraining](https://mlsanity.com/paper/2509.06806/) (2025)
- [Towards Interpretable Deep Reinforcement Learning Models via Inverse Reinforcement Learning](https://mlsanity.com/paper/2203.16464/) (2022)
- [On the Robustness of Random Forest Against Untargeted Data Poisoning: An Ensemble-Based Approach](https://mlsanity.com/paper/2209.14013/) (2022)
- [A Voting Approach for Explainable Classification with Rule Learning](https://mlsanity.com/paper/2311.07323/) (2023)
- [Forest-ORE: Mining Optimal Rule Ensemble to interpret Random Forest models](https://mlsanity.com/paper/2403.17588/) (2024)
- [Explaining Predictions by Characteristic Rules](https://mlsanity.com/paper/2405.21003/) (2024)
- [A survey and taxonomy of methods interpreting random forest models](https://mlsanity.com/paper/2407.12759/) (2024)
- [Tree-based local explanations of machine learning model predictions, AraucanaXAI](https://mlsanity.com/paper/2110.08272/) (2021)
- [Principled Diverse Counterfactuals in Multilinear Models](https://mlsanity.com/paper/2201.06467/) (2022)
- [Explainability in Machine Learning: a Pedagogical Perspective](https://mlsanity.com/paper/2202.10335/) (2022)
- [The Yield Curve as a Recession Leading Indicator. An Application for Gradient Boosting and Random Forest](https://mlsanity.com/paper/2203.06648/) (2022)
- [An Explainable Stacked Ensemble Model for Static Route-Free Estimation of Time of Arrival](https://mlsanity.com/paper/2203.09438/) (2022)
- [BELLATREX: Building Explanations through a LocaLly AccuraTe Rule EXtractor](https://mlsanity.com/paper/2203.15511/) (2022)
- [Example-Based Explanations of Random Forest Predictions](https://mlsanity.com/paper/2311.14581/) (2023)
- [Generating Global and Local Explanations for Tree-Ensemble Learning Methods by Answer Set Programming](https://mlsanity.com/paper/2410.11000/) (2024)
- [Surrogate Interpretable Graph for Random Decision Forests](https://mlsanity.com/paper/2506.01988/) (2025)

## Abstract (arXiv)

Tree ensembles such as random forests and boosted trees are accurate but difficult to understand, debug and deploy. In this work, we provide the inTrees (interpretable trees) framework that extracts, measures, prunes and selects rules from a tree ensemble, and calculates frequent variable interactions. An rule-based learner, referred to as the simplified tree ensemble learner (STEL), can also be formed and used for future prediction. The inTrees framework can applied to both classification and regression problems, and is applicable to many types of tree ensembles, e.g., random forests, regularized random forests, and boosted trees. We implemented the inTrees algorithms in the "inTrees" R package.
