mlsanityData to 7 Oct 2026

A survey and taxonomy of methods interpreting random forest models

arXiv 2407.12759 ↗First posted 17 Jul 2024cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

The interpretability of random forest (RF) models is a research topic of growing interest in the machine learning (ML) community. In the state of the art, RF is considered a powerful learning ensemble given its predictive performance, flexibility, and ease of use. Furthermore, the inner process of the RF model is understandable because it uses an intuitive and intelligible approach for building the RF decision tree ensemble. However, the RF resulting model is regarded as a "black box" because of its numerous deep decision trees. Gaining visibility over the entire process that induces the final decisions by exploring each decision tree is complicated, if not impossible. This complexity limits the acceptance and implementation of RF models in several fields of application. Several papers have tackled the interpretation of RF models. This paper aims to provide an extensive review of methods used in the literature to interpret RF resulting models. We have analyzed these methods and classified them based on different axes. Although this review is not exhaustive, it provides a taxonomy of various techniques that should guide users in choosing the most appropriate tools for interpreting RF models, depending on the interpretability aspects sought. It should also be valuable for researchers who aim to focus their work on the interpretability of RF or ML black boxes in general.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 34 of its 92 references that are in the map. First posted on arXiv 17 Jul 2024.

Builds on

34 of 92 references.

References · 34

  1. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
  2. 2016European Union regulations on algorithmic decision-making and a "right to explanation"cited by 343
  3. 2018Consistent Individualized Feature Attribution for Tree Ensemblescited by 279
  4. 2018Manipulating and Measuring Model Interpretabilitycited by 256
  5. 2020Questioning the AI: Informing Design Practices for Explainable AI User Experiencescited by 251
  6. 2015A Random Forest Guided Tourcited by 168
  7. 2018Local Rule-Based Explanations of Black Box Decision Systemscited by 165
  8. 2021Explainable AI (XAI): A Systematic Meta-Survey of Current Challenges and Future Opportunitiescited by 125
  9. 2019Explainable AI for Trees: From Local Explanations to Global Understandingcited by 64
  10. 2017Interpreting Blackbox Models via Model Extractioncited by 43
  11. 2014Interpreting Tree Ensembles with inTreescited by 37
  12. 2016Making Tree Ensembles Interpretable: A Bayesian Model Selection Approachcited by 27
22 more
  1. 2020Explainable Matrix -- Visualization for Global and Local Interpretability of Random Forest Classification Ensemblescited by 23
  2. 2020Why model why? Assessing the strengths and limitations of LIMEcited by 21
  3. 2020Survey of explainable machine learning with visual and granular methods beyond quasi-explanationscited by 20
  4. 2020Explainable Artificial Intelligence and Machine Learning: A reality rooted perspectivecited by 12
  5. 2018What is Interpretable? Using Machine Learning to Design Interpretable Decision-Support Systemscited by 11
  6. 2021EUCA: the End-User-Centered Explainable AI Frameworkcited by 10
  7. 2021Conclusive Local Interpretation Rules for Random Forestscited by 9
  8. 2021Ensembles of Random SHAPscited by 8
  9. 2023Identifying Explanation Needs of End-users: Applying and Extending the XAI Question Bankcited by 8
  10. 2013Interpreting random forest classification models using a feature contribution methodcited by 6
  11. 2018A Parallel Random Forest Algorithm for Big Data in a Spark Cloud Computing Environmentcited by 6
  12. 2020Rule Covering for Interpretation and Boostingcited by 4
  13. 2020TREX: Tree-Ensemble Representer-Point Explanationscited by 4
  14. 2021Extracting Optimal Explanations for Ensemble Trees via Logical Reasoningcited by 4
  15. 2020From unbiased MDI Feature Importance to Explainable AI for Treescited by 3
  16. 2021Forest Guided Smoothingcited by 3
  17. 2021An exact counterfactual-example-based approach to tree-ensemble models interpretabilitycited by 3
  18. 2014Visualizing Random Forest with Self-Organising Mapcited by 2
  19. 2015ggRandomForests: Visually Exploring a Random Forest for Regressioncited by 2
  20. 2015An Outlier Detection-based Tree Selection Approach to Extreme Pruning of Random Forestscited by 1
  21. 2019Single Sample Feature Importance: An Interpretable Algorithm for Low-Level Feature Analysiscited by 1
  22. 2019ADD-Lib: Decision Diagrams in Practicecited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.