From global to local MDI variable importances for random forests and when they are Shapley values
Not on the map. Why?
Abstract (arXiv)
Random forests have been widely used for their ability to provide so-called importance measures, which give insight at a global (per dataset) level on the relevance of input variables to predict a certain output. On the other hand, methods based on Shapley values have been introduced to refine the analysis of feature relevance in tree-based models to a local (per instance) level. In this context, we first show that the global Mean Decrease of Impurity (MDI) variable importance scores correspond to Shapley values under some conditions. Then, we derive a local MDI importance measure of variable relevance, which has a very natural connection with the global MDI measure and can be related to a new notion of local feature relevance. We further link local MDI importances with Shapley values and discuss them in the light of related measures from the literature. The measures are illustrated through experiments on several classification and regression problems.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 8 of its 40 references that are in the map. First posted on arXiv 3 Nov 2021.
Builds on
8 of 40 references.
References · 8
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2014Understanding Random Forests: From Theory to Practicecited by 57
- 2020On Explaining Decision Treescited by 49
- 2019A Debiased MDI Feature Importance Measure for Random Forestscited by 24
- 2020Explainable Matrix -- Visualization for Global and Local Interpretability of Random Forest Classification Ensemblescited by 23
- 2020Trees, forests, and impurity-based variable importancecited by 16
- 2021Importance measures derived from random forests: characterisation and extensioncited by 2
- 2017Random Subspace with Trees for Feature Selection Under Memory Constraintscited by 1
Built on by
Citing papers per year: 2022: 1; 2023: 0; 2024: 1; 2025: 1; 2026: 1.
4 papers.
- 2022Ultra-marginal Feature Importance: Learning from Data with Causal Guaranteescited by 6
- 2025Local MDI+: Local Feature Importances for Tree-Based Modelscited by 3
- 2024Online High-Frequency Trading Stock Forecasting with Automated Feature Clustering and Radial Basis Function Neural Networkscited by 1
- 2026Kernel of Partition Paths: A Unified Representation for Tree Ensemblescited by 0
- 2026Kernel of Partition Paths: A Unified Representation for Tree Ensembles17 Jun 2026
- 2025Local MDI+: Local Feature Importances for Tree-Based Models10 Jun 2025
- 2024Online High-Frequency Trading Stock Forecasting with Automated Feature Clustering and Radial Basis Function Neural Networks23 Nov 2024
- 2022Ultra-marginal Feature Importance: Learning from Data with Causal Guarantees21 Apr 2022