Explainable Matrix -- Visualization for Global and Local Interpretability of Random Forest Classification Ensembles
Not on the map. Why?
Abstract (arXiv)
Over the past decades, classification models have proven to be essential machine learning tools given their potential and applicability in various domains. In these years, the north of the majority of the researchers had been to improve quantitative metrics, notwithstanding the lack of information about models' decisions such metrics convey. This paradigm has recently shifted, and strategies beyond tables and numbers to assist in interpreting models' decisions are increasing in importance. Part of this trend, visualization techniques have been extensively used to support classification models' interpretability, with a significant focus on rule-based models. Despite the advances, the existing approaches present limitations in terms of visual scalability, and the visualization of large and complex models, such as the ones produced by the Random Forest (RF) technique, remains a challenge. In this paper, we propose Explainable Matrix (ExMatrix), a novel visualization method for RF interpretability that can handle models with massive quantities of rules. It employs a simple yet powerful matrix-like visual metaphor, where rows are rules, columns are features, and cells are rules predicates, enabling the analysis of entire models and auditing classification results. ExMatrix applicability is confirmed via different examples, showing how it can be used in practice to promote RF models interpretability.
Key facts. Cited by 23 papers in the map (data through 7 Oct 2026). First posted on arXiv 8 May 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 4; 2023: 4; 2024: 7; 2025: 3.
23 papers.
Sort:
- 2023Visual Analytics For Machine Learning: A Data Perspective Surveycited by 25
- 2022Diagnosing Ensemble Few-Shot Classifierscited by 13
- 2022TimberTrek: Exploring and Curating Sparse Decision Trees with Interactive Visualizationcited by 13
- 2021VisRuler: Visual Analytics for Extracting Decision Rules from Bagged and Boosted Decision Treescited by 8
- 2023Towards an Understanding and Explanation for Mixed-Initiative Artificial Scientific Text Detectioncited by 8
- 2022Visual Exploration of Machine Learning Model Behavior with Hierarchical Surrogate Rule Setscited by 5
- 2024Decision Predicate Graphs: Enhancing Interpretability in Tree Ensemblescited by 5
- 2021Multivariate Data Explanation by Jumping Emerging Patterns Visualizationcited by 4
- 2021From global to local MDI variable importances for random forests and when they are Shapley valuescited by 4
- 2022Local Multi-Label Explanations for Random Forestcited by 3
- 2024Explainable automatic industrial carbon footprint estimation from bank transaction classification using natural language processingcited by 3
- 2023DeforestVis: Behavior Analysis of Machine Learning Models with Surrogate Decision Stumpscited by 2
11 more
- 2024A survey and taxonomy of methods interpreting random forest modelscited by 2
- 2024Automatic explanation of the classification of Spanish legal judgments in jurisdiction-dependent law categories with tree estimatorscited by 1
- 2024Sentiment analysis and random forest to classify LLM versus human source applied to Scientific Textscited by 1
- 2024RuleExplorer: A Scalable Matrix Visualization for Understanding Tree Ensemble Classifierscited by 1
- 2025Cluster-Based Random Forest Visualization and Interpretationcited by 1
- 2021Visualizing Rule Sets: Exploration and Validation of a Design Spacecited by 0
- 2021Facilitating Machine Learning Model Comparison and Explanation Through A Radial Visualisationcited by 0
- 2023Multi-rules mining algorithm for combinatorially exploded decision trees with modified Aitchison-Aitken function-based Bayesian optimizationcited by 0
- 2024Underwater SONAR Image Classification and Analysis using LIME-based Explainable Artificial Intelligencecited by 0
- 2025Integrating Explainable AI in Medical Devices: Technical, Clinical and Regulatory Insights and Recommendationscited by 0
- 2025ConceptFlow: Hierarchical and Fine-grained Concept-Based Explanation for Convolutional Neural Networkscited by 0
- 2025ConceptFlow: Hierarchical and Fine-grained Concept-Based Explanation for Convolutional Neural Networks16 Sep 2025
- 2025Cluster-Based Random Forest Visualization and Interpretation30 Jul 2025
- 2025Integrating Explainable AI in Medical Devices: Technical, Clinical and Regulatory Insights and Recommendations10 May 2025
- 2024RuleExplorer: A Scalable Matrix Visualization for Understanding Tree Ensemble Classifiers5 Sep 2024
- 2024Underwater SONAR Image Classification and Analysis using LIME-based Explainable Artificial Intelligence23 Aug 2024
- 2024A survey and taxonomy of methods interpreting random forest models17 Jul 2024
- 2024Explainable automatic industrial carbon footprint estimation from bank transaction classification using natural language processing23 May 2024
- 2024Sentiment analysis and random forest to classify LLM versus human source applied to Scientific Texts5 Apr 2024
- 2024Decision Predicate Graphs: Enhancing Interpretability in Tree Ensembles3 Apr 2024
- 2024Automatic explanation of the classification of Spanish legal judgments in jurisdiction-dependent law categories with tree estimators30 Mar 2024
- 2023Multi-rules mining algorithm for combinatorially exploded decision trees with modified Aitchison-Aitken function-based Bayesian optimization4 Oct 2023
- 2023Visual Analytics For Machine Learning: A Data Perspective Survey15 Jul 2023
11 more
- 2023Towards an Understanding and Explanation for Mixed-Initiative Artificial Scientific Text Detection11 Apr 2023
- 2023DeforestVis: Behavior Analysis of Machine Learning Models with Surrogate Decision Stumps31 Mar 2023
- 2022TimberTrek: Exploring and Curating Sparse Decision Trees with Interactive Visualization19 Sep 2022
- 2022Local Multi-Label Explanations for Random Forest5 Jul 2022
- 2022Diagnosing Ensemble Few-Shot Classifiers9 Jun 2022
- 2022Visual Exploration of Machine Learning Model Behavior with Hierarchical Surrogate Rule Sets19 Jan 2022
- 2021VisRuler: Visual Analytics for Extracting Decision Rules from Bagged and Boosted Decision Trees1 Dec 2021
- 2021From global to local MDI variable importances for random forests and when they are Shapley values3 Nov 2021
- 2021Multivariate Data Explanation by Jumping Emerging Patterns Visualization21 Jun 2021
- 2021Facilitating Machine Learning Model Comparison and Explanation Through A Radial Visualisation15 Apr 2021
- 2021Visualizing Rule Sets: Exploration and Validation of a Design Space1 Mar 2021
- 2023Visual Analytics For Machine Learning: A Data Perspective Surveycited by 25
- 2022Diagnosing Ensemble Few-Shot Classifierscited by 13
- 2022TimberTrek: Exploring and Curating Sparse Decision Trees with Interactive Visualizationcited by 13
- 2021VisRuler: Visual Analytics for Extracting Decision Rules from Bagged and Boosted Decision Treescited by 8
- 2023Towards an Understanding and Explanation for Mixed-Initiative Artificial Scientific Text Detectioncited by 8
- 2022Visual Exploration of Machine Learning Model Behavior with Hierarchical Surrogate Rule Setscited by 5
- 2024Decision Predicate Graphs: Enhancing Interpretability in Tree Ensemblescited by 5
- 2021Multivariate Data Explanation by Jumping Emerging Patterns Visualizationcited by 4
- 2021From global to local MDI variable importances for random forests and when they are Shapley valuescited by 4
- 2022Local Multi-Label Explanations for Random Forestcited by 3
- 2024Explainable automatic industrial carbon footprint estimation from bank transaction classification using natural language processingcited by 3
- 2023DeforestVis: Behavior Analysis of Machine Learning Models with Surrogate Decision Stumpscited by 2
12 most cited of 23 All 23 (JSON)
- 2025ConceptFlow: Hierarchical and Fine-grained Concept-Based Explanation for Convolutional Neural Networks16 Sep 2025
- 2025Cluster-Based Random Forest Visualization and Interpretation30 Jul 2025
- 2025Integrating Explainable AI in Medical Devices: Technical, Clinical and Regulatory Insights and Recommendations10 May 2025
- 2024RuleExplorer: A Scalable Matrix Visualization for Understanding Tree Ensemble Classifiers5 Sep 2024
- 2024Underwater SONAR Image Classification and Analysis using LIME-based Explainable Artificial Intelligence23 Aug 2024
- 2024A survey and taxonomy of methods interpreting random forest models17 Jul 2024
- 2024Explainable automatic industrial carbon footprint estimation from bank transaction classification using natural language processing23 May 2024
- 2024Sentiment analysis and random forest to classify LLM versus human source applied to Scientific Texts5 Apr 2024
- 2024Decision Predicate Graphs: Enhancing Interpretability in Tree Ensembles3 Apr 2024
- 2024Automatic explanation of the classification of Spanish legal judgments in jurisdiction-dependent law categories with tree estimators30 Mar 2024
- 2023Multi-rules mining algorithm for combinatorially exploded decision trees with modified Aitchison-Aitken function-based Bayesian optimization4 Oct 2023
- 2023Visual Analytics For Machine Learning: A Data Perspective Survey15 Jul 2023
12 newest of 23 All 23 (JSON)