Techniques for Interpretable Machine Learning
Not on the map. Why?
Abstract (arXiv)
Interpretable machine learning tackles the important problem that humans cannot understand the behaviors of complex machine learning models and how these models arrive at a particular decision. Although many approaches have been proposed, a comprehensive understanding of the achievements and challenges is still lacking. We provide a survey covering existing techniques to increase the interpretability of machine learning models. We also discuss crucial issues that the community should consider in future work such as designing user-friendly explanations and developing comprehensive evaluation metrics to further push forward the area of interpretable machine learning.
Key facts. Cited by 238 papers in the map (data through 14 Oct 2026). First posted on arXiv 31 Jul 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 47; 2022: 47; 2023: 64; 2024: 44; 2025: 27; 2026: 9.
238 papers.
Sort:
By area:
- 2023Explainability for Large Language Models: A Surveycited by 333
- 2022Interpretable and Generalizable Graph Learning via Stochastic Attention Mechanismcited by 171
- 2022Maieutic Prompting: Logically Consistent Reasoning with Recursive Explanationscited by 159
- 2021Post-hoc Interpretability for Neural NLP: A Surveycited by 156
- 2021Trustworthy AI: A Computational Perspectivecited by 93
- 2021A Comprehensive Taxonomy for Explainable Artificial Intelligence: A Systematic Survey of Surveys on Methods and Conceptscited by 91
- 2021Towards Interpreting and Mitigating Shortcut Learning Behavior of NLU Modelscited by 78
- 2021Unbox the Black-box for the Medical Explainable AI via Multi-modal and Multi-centre Data Fusion: A Mini-Review, Two Showcases and Beyondcited by 76
- 2021Explainable Deep Few-shot Anomaly Detection with Deviation Networkscited by 69
- 2023Applying Large Language Models and Chain-of-Thought for Automatic Scoringcited by 69
- 2021Graph-Based Deep Learning for Medical Diagnosis and Analysis: Past, Present and Futurecited by 67
- 2021Beyond Expertise and Roles: A Framework to Characterize the Stakeholders of Interpretable Machine Learning and their Needscited by 64
38 more
- 2021Fairness via Representation Neutralizationcited by 63
- 2024Explainable AI for Safe and Trustworthy Autonomous Driving: A Systematic Reviewcited by 53
- 2021S-LIME: Stabilized-LIME for Model Explanationcited by 52
- 2024Usable XAI: 10 Strategies Towards Exploiting Explainability in the LLM Eracited by 46
- 2021A Survey on Graph-Based Deep Learning for Computational Histopathologycited by 41
- 2022The Road to Explainability is Paved with Bias: Measuring the Fairness of Explanationscited by 41
- 2023Disentanglement via Latent Quantizationcited by 40
- 2024Trust in AI: Progress, Challenges, and Future Directionscited by 35
- 2022The State of the Art in Enhancing Trust in Machine Learning Models with the Use of Visualizationscited by 29
- 2022Scalable Interpretability via Polynomialscited by 25
- 2022SEAT: Stable and Explainable Attentioncited by 25
- 2022Explainable AI for clinical and remote health applications: a survey on tabular and time series datacited by 24
- 2021Explainable Tsetlin Machine framework for fake news detection with credibility score assessmentcited by 23
- 2024Local vs. Global Interpretability: A Computational Complexity Perspectivecited by 23
- 2021An Explainable Artificial Intelligence Approach for Unsupervised Fault Detection and Diagnosis in Rotating Machinerycited by 22
- 2021The Impact of Machine Learning on 2D/3D Registration for Image-guided Interventions: A Systematic Review and Perspectivecited by 22
- 2023Interpretable-by-Design Text Understanding with Iteratively Generated Concept Bottleneckcited by 22
- 2023Understanding the (Extra-)Ordinary: Validating Deep Model Decisions with Prototypical Concept-based Explanationscited by 22
- 2021Self-Interpretable Model with TransformationEquivariant Interpretationcited by 21
- 2022Mind the gap: Challenges of deep learning approaches to Theory of Mindcited by 21
- 2023Model Based Explanations of Concept Driftcited by 21
- 2023CoRTX: Contrastive Framework for Real-time Explanationcited by 20
- 2022Robust and Explainable Autoencoders for Unsupervised Time Series Outlier Detection---Extended Versioncited by 19
- 2024FaithLM: Towards Faithful Explanations for Large Language Modelscited by 19
- 2021Deep Learning for Android Malware Defenses: a Systematic Literature Reviewcited by 18
- 2022A Survey on Aspect-Based Sentiment Classificationcited by 18
- 2022FR: Folded Rationalization with a Unified Encodercited by 18
- 2023DEGREE: Decomposition Based Explanation For Graph Neural Networkscited by 18
- 2021Modeling Techniques for Machine Learning Fairness: A Surveycited by 17
- 2023The role of causality in explainable artificial intelligencecited by 17
- 2021SurvNAM: The machine learning survival model explanationcited by 16
- 2022Attribution-based XAI Methods in Computer Vision: A Reviewcited by 16
- 2022Graph Learning for Anomaly Analytics: Algorithms, Applications, and Challengescited by 15
- 2023Interpretation of Time-Series Deep Models: A Surveycited by 15
- 2021Model-Based Counterfactual Synthesizer for Interpretationcited by 14
- 2022DC-Check: A Data-Centric AI checklist to guide the development of reliable machine learning systemscited by 14
- 2023Efficient XAI Techniques: A Taxonomic Surveycited by 14
- 2021Applying Machine Learning to Study Fluid Mechanicscited by 13
50 most cited of 238 All 238 (JSON)
- 2026GFGE: Unifying Explainable AI Methods through an Interpretation Framework4 Oct 2026
- 2026A unified framework for global and local interpretability using adaptive derivative-ordered random explanation15 Sep 2026
- 2026The Mirror Agent Model: a Bayesian Architecture for Interpretable Agent Behavior4 Sep 2026
- 2026Assessing Alignment and Stability of Feature Importance Explanations via Weight of Evidence31 Aug 2026
- 2026Measuring Explainer Stability via Attribution Separability3 Aug 2026
- 2026Counterfactual Optimal Action Trees (COAT): Interpretable Prescriptive Policies from Observational Data15 Jul 2026
- 2026All Circuits Lead to Rome: Rethinking Functional Anisotropy in Circuit and Sheaf Discovery for LLMs12 May 2026
- 2026Interpretable Quantile Regression by Optimal Decision Trees22 Apr 2026
- 2026Position: Explainable AI is Causality in Disguise30 Mar 2026
- 2025CID: Measuring Feature Importance Through Counterfactual Distributions19 Nov 2025
- 2025ClinStructor: AI-Powered Structuring of Unstructured Clinical Texts14 Nov 2025
- 2025Counterfactual Explanation for Multivariate Time Series Forecasting with Exogenous Variables10 Nov 2025
38 more
- 2025Preliminary Quantitative Study on Explainability and Trust in AI Systems17 Oct 2025
- 2025Restricted Receptive Fields for Face Verification12 Oct 2025
- 2025TopInG: Topologically Interpretable Graph Learning via Persistent Rationale Filtration6 Oct 2025
- 2025TSKAN: Interpretable Machine Learning for QoE modeling over Time Series Data24 Sep 2025
- 2025Explainable Knowledge Graph Retrieval-Augmented Generation (KG-RAG) with KG-SMILE3 Sep 2025
- 2025L-XAIDS: A LIME-based eXplainable AI framework for Intrusion Detection Systems24 Aug 2025
- 2025Uppaal Coshy: Automatic Synthesis of Compact Shields for Hybrid Systems22 Aug 2025
- 2025Attribution Explanations for Deep Neural Networks: A Theoretical Perspective11 Aug 2025
- 2025A Taxonomy for Design and Evaluation of Prompt-Based Natural Language Explanations11 Jul 2025
- 2025Comprehensive Evaluation of Prototype Neural Networks9 Jul 2025
- 2025Graph Neural Networks in Modern AI-aided Drug Discovery7 Jun 2025
- 2025Explaining Large Language Models with gSMILE27 May 2025
- 2025Automatic and Structure-Aware Sparsification of Hybrid Neural ODEs25 May 2025
- 2025Interpretable Reinforcement Learning for Load Balancing using Kolmogorov-Arnold Networks20 May 2025
- 2025Concept-Level Explainability for Auditing & Steering LLM Responses12 May 2025
- 2025Model-Agnostic Policy Explanations with Large Language Models8 Apr 2025
- 2025A Semantic-based Optimization Approach for Repairing LLMs: Case Study on Code Generation17 Mar 2025
- 2025Can Large Language Models Simulate Human Responses? A Case Study of Stated Preference Experiments in the Context of Heating-related Choices7 Mar 2025
- 2025The Impact of Transparency in AI Systems on Users' Data-Sharing Intentions: A Scenario-Based Experiment27 Feb 2025
- 2025Self-Explaining Hypergraph Neural Networks for Diagnosis Prediction15 Feb 2025
- 2025iLOCO: Distribution-Free Inference for Feature Interactions10 Feb 2025
- 2025Explainability in Practice: A Survey of Explainable NLP Across Various Domains2 Feb 2025
- 2025Faithful Counterfactual Visual Explanations (FCVE)12 Jan 2025
- 2025Towards Counterfactual and Contrastive Explainability and Transparency of DCNN Image Classifiers12 Jan 2025
- 2024Comparative Analysis of Black-Box and White-Box Machine Learning Model in Phishing Detection3 Dec 2024
- 2024Reliable and scalable variable importance estimation via warm-start and early stopping2 Dec 2024
- 2024Learning Predictive Checklists with Probabilistic Logic Programming25 Nov 2024
- 2024Generative Fuzzy System for Sequence Generation21 Nov 2024
- 2024CRTRE: Causal Rule Generation with Target Trial Emulation Framework10 Nov 2024
- 2024Towards Trustworthy Machine Learning in Production: An Overview of the Robustness in MLOps Approach28 Oct 2024
- 2024A Review of Graph-Powered Data Quality Applications for IoT Monitoring Sensor Networks28 Oct 2024
- 2024Linking Model Intervention to Causal Interpretation in Model Explanation21 Oct 2024
- 2024Subversive Characters and Stereotyping Readers: Characterizing Queer Relationalities with Dialogue-Based Relation Extraction19 Oct 2024
- 2024XForecast: Evaluating Natural Language Explanations for Time Series Forecasting18 Oct 2024
- 2024SSET: Swapping-Sliding Explanation for Time Series Classifiers in Affect Detection16 Oct 2024
- 2024Navigating the Shortcut Maze: A Comprehensive Analysis of Shortcut Learning in Text Classification by Language Models26 Sep 2024
- 2024Local Explanations and Self-Explanations for Assessing Faithfulness in black-box LLMs18 Sep 2024
- 2024RuleExplorer: A Scalable Matrix Visualization for Understanding Tree Ensemble Classifiers5 Sep 2024
50 newest of 238 All 238 (JSON)
- 2022Maieutic Prompting: Logically Consistent Reasoning with Recursive Explanationscited by 159
- 2023Applying Large Language Models and Chain-of-Thought for Automatic Scoringcited by 69
- 2026All Circuits Lead to Rome: Rethinking Functional Anisotropy in Circuit and Sheaf Discovery for LLMscited by 9
- 2025Can Large Language Models Simulate Human Responses? A Case Study of Stated Preference Experiments in the Context of Heating-related Choicescited by 2
- 2026Assessing Alignment and Stability of Feature Importance Explanations via Weight of Evidencecited by 0
- 2026Assessing Alignment and Stability of Feature Importance Explanations via Weight of Evidence31 Aug 2026
- 2026All Circuits Lead to Rome: Rethinking Functional Anisotropy in Circuit and Sheaf Discovery for LLMs12 May 2026
- 2025Can Large Language Models Simulate Human Responses? A Case Study of Stated Preference Experiments in the Context of Heating-related Choices7 Mar 2025
- 2023Applying Large Language Models and Chain-of-Thought for Automatic Scoring30 Nov 2023
- 2022Maieutic Prompting: Logically Consistent Reasoning with Recursive Explanations24 May 2022
- 2025Interpretable Reinforcement Learning for Load Balancing using Kolmogorov-Arnold Networks20 May 2025
- 2024Interpretable Modeling of Deep Reinforcement Learning Driven Scheduling24 Mar 2024
- 2024XRL-Bench: A Benchmark for Evaluating and Comparing Explainable Reinforcement Learning Techniques20 Feb 2024
- 2021Distilling Interpretable Models into Human-Readable Codecited by 0
- 2021Distilling Interpretable Models into Human-Readable Code21 Jan 2021
- 2023Explainability for Large Language Models: A Surveycited by 333
- 2022Interpretable and Generalizable Graph Learning via Stochastic Attention Mechanismcited by 171
- 2021Post-hoc Interpretability for Neural NLP: A Surveycited by 156
- 2021Trustworthy AI: A Computational Perspectivecited by 93
- 2021A Comprehensive Taxonomy for Explainable Artificial Intelligence: A Systematic Survey of Surveys on Methods and Conceptscited by 91
- 2021Towards Interpreting and Mitigating Shortcut Learning Behavior of NLU Modelscited by 78
- 2021Unbox the Black-box for the Medical Explainable AI via Multi-modal and Multi-centre Data Fusion: A Mini-Review, Two Showcases and Beyondcited by 76
- 2021Explainable Deep Few-shot Anomaly Detection with Deviation Networkscited by 69
- 2021Graph-Based Deep Learning for Medical Diagnosis and Analysis: Past, Present and Futurecited by 67
- 2021Beyond Expertise and Roles: A Framework to Characterize the Stakeholders of Interpretable Machine Learning and their Needscited by 64
- 2021Fairness via Representation Neutralizationcited by 63
- 2024Explainable AI for Safe and Trustworthy Autonomous Driving: A Systematic Reviewcited by 53
12 most cited of 222 All 222 (JSON)
- 2026GFGE: Unifying Explainable AI Methods through an Interpretation Framework4 Oct 2026
- 2026A unified framework for global and local interpretability using adaptive derivative-ordered random explanation15 Sep 2026
- 2026The Mirror Agent Model: a Bayesian Architecture for Interpretable Agent Behavior4 Sep 2026
- 2026Measuring Explainer Stability via Attribution Separability3 Aug 2026
- 2026Counterfactual Optimal Action Trees (COAT): Interpretable Prescriptive Policies from Observational Data15 Jul 2026
- 2026Interpretable Quantile Regression by Optimal Decision Trees22 Apr 2026
- 2026Position: Explainable AI is Causality in Disguise30 Mar 2026
- 2025CID: Measuring Feature Importance Through Counterfactual Distributions19 Nov 2025
- 2025ClinStructor: AI-Powered Structuring of Unstructured Clinical Texts14 Nov 2025
- 2025Counterfactual Explanation for Multivariate Time Series Forecasting with Exogenous Variables10 Nov 2025
- 2025Preliminary Quantitative Study on Explainability and Trust in AI Systems17 Oct 2025
- 2025Restricted Receptive Fields for Face Verification12 Oct 2025
12 newest of 222 All 222 (JSON)