mlsanityData to 7 Oct 2026

Explainable Matrix -- Visualization for Global and Local Interpretability of Random Forest Classification Ensembles

arXiv 2005.04289 ↗First posted 8 May 2020cs.LG stat.MLcited by 23

Not on the map. Why?

Abstract (arXiv)

Over the past decades, classification models have proven to be essential machine learning tools given their potential and applicability in various domains. In these years, the north of the majority of the researchers had been to improve quantitative metrics, notwithstanding the lack of information about models' decisions such metrics convey. This paradigm has recently shifted, and strategies beyond tables and numbers to assist in interpreting models' decisions are increasing in importance. Part of this trend, visualization techniques have been extensively used to support classification models' interpretability, with a significant focus on rule-based models. Despite the advances, the existing approaches present limitations in terms of visual scalability, and the visualization of large and complex models, such as the ones produced by the Random Forest (RF) technique, remains a challenge. In this paper, we propose Explainable Matrix (ExMatrix), a novel visualization method for RF interpretability that can handle models with massive quantities of rules. It employs a simple yet powerful matrix-like visual metaphor, where rows are rules, columns are features, and cells are rules predicates, enabling the analysis of entire models and auditing classification results. ExMatrix applicability is confirmed via different examples, showing how it can be used in practice to promote RF models interpretability.

Key facts. Cited by 23 papers in the map (data through 7 Oct 2026). First posted on arXiv 8 May 2020.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 5; 2022: 4; 2023: 4; 2024: 7; 2025: 3.

23 papers.

Sort:

  1. 2023Visual Analytics For Machine Learning: A Data Perspective Surveycited by 25
  2. 2022Diagnosing Ensemble Few-Shot Classifierscited by 13
  3. 2022TimberTrek: Exploring and Curating Sparse Decision Trees with Interactive Visualizationcited by 13
  4. 2021VisRuler: Visual Analytics for Extracting Decision Rules from Bagged and Boosted Decision Treescited by 8
  5. 2023Towards an Understanding and Explanation for Mixed-Initiative Artificial Scientific Text Detectioncited by 8
  6. 2022Visual Exploration of Machine Learning Model Behavior with Hierarchical Surrogate Rule Setscited by 5
  7. 2024Decision Predicate Graphs: Enhancing Interpretability in Tree Ensemblescited by 5
  8. 2021Multivariate Data Explanation by Jumping Emerging Patterns Visualizationcited by 4
  9. 2021From global to local MDI variable importances for random forests and when they are Shapley valuescited by 4
  10. 2022Local Multi-Label Explanations for Random Forestcited by 3
  11. 2024Explainable automatic industrial carbon footprint estimation from bank transaction classification using natural language processingcited by 3
  12. 2023DeforestVis: Behavior Analysis of Machine Learning Models with Surrogate Decision Stumpscited by 2
11 more
  1. 2024A survey and taxonomy of methods interpreting random forest modelscited by 2
  2. 2024Automatic explanation of the classification of Spanish legal judgments in jurisdiction-dependent law categories with tree estimatorscited by 1
  3. 2024Sentiment analysis and random forest to classify LLM versus human source applied to Scientific Textscited by 1
  4. 2024RuleExplorer: A Scalable Matrix Visualization for Understanding Tree Ensemble Classifierscited by 1
  5. 2025Cluster-Based Random Forest Visualization and Interpretationcited by 1
  6. 2021Visualizing Rule Sets: Exploration and Validation of a Design Spacecited by 0
  7. 2021Facilitating Machine Learning Model Comparison and Explanation Through A Radial Visualisationcited by 0
  8. 2023Multi-rules mining algorithm for combinatorially exploded decision trees with modified Aitchison-Aitken function-based Bayesian optimizationcited by 0
  9. 2024Underwater SONAR Image Classification and Analysis using LIME-based Explainable Artificial Intelligencecited by 0
  10. 2025Integrating Explainable AI in Medical Devices: Technical, Clinical and Regulatory Insights and Recommendationscited by 0
  11. 2025ConceptFlow: Hierarchical and Fine-grained Concept-Based Explanation for Convolutional Neural Networkscited by 0