# Interpretability of machine learning based prediction models in healthcare

arXiv: https://arxiv.org/abs/2002.08596 · HTML: https://mlsanity.com/paper/2002.08596/

## Key facts

- Cited by 75 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 20 Feb 2020.

## Built on by (most cited first, 30 of 75)

- [Do Input Gradients Highlight Discriminative Features?](https://mlsanity.com/paper/2102.12781/) (2021)
- [QoQ-Med: Building Multimodal Clinical Foundation Models with Domain-Aware GRPO Training](https://mlsanity.com/paper/2506.00711/) (2025)
- [Trust in AI: Progress, Challenges, and Future Directions](https://mlsanity.com/paper/2403.14680/) (2024)
- [Deep Learning for Cross-Domain Data Fusion in Urban Computing: Taxonomy, Advances, and Outlook](https://mlsanity.com/paper/2402.19348/) (2024)
- [A Survey of Explainable Graph Neural Networks: Taxonomy and Evaluation Metrics](https://mlsanity.com/paper/2207.12599/) (2022)
- [Directive Explanations for Monitoring the Risk of Diabetes Onset: Introducing Directive Data-Centric Explanations and Combinations to Support What-If Explorations](https://mlsanity.com/paper/2302.10671/) (2023)
- [A scoping review on multimodal deep learning in biomedical images and texts](https://mlsanity.com/paper/2307.07362/) (2023)
- [Explainable AI for Bioinformatics: Methods, Tools, and Applications](https://mlsanity.com/paper/2212.13261/) (2022)
- [When and How to Fool Explainable Models (and Humans) with Adversarial Examples](https://mlsanity.com/paper/2107.01943/) (2021)
- [Provable concept learning for interpretable predictions using variational autoencoders](https://mlsanity.com/paper/2204.00492/) (2022)
- [Interpretability-Aware Vision Transformer](https://mlsanity.com/paper/2309.08035/) (2023)
- [Shapley variable importance clouds for interpretable machine learning](https://mlsanity.com/paper/2110.02484/) (2021)
- [I-SPLIT: Deep Network Interpretability for Split Computing](https://mlsanity.com/paper/2209.11607/) (2022)
- [Interpretable machine learning for time-to-event prediction in medicine and healthcare](https://mlsanity.com/paper/2303.09817/) (2023)
- [Improvement of a Prediction Model for Heart Failure Survival through Explainable Artificial Intelligence](https://mlsanity.com/paper/2108.10717/) (2021)
- [Designing explainable artificial intelligence with active inference: A framework for transparent introspection and decision-making](https://mlsanity.com/paper/2306.04025/) (2023)
- [Applications of Explainable AI for 6G: Technical Aspects, Use Cases, and Research Challenges](https://mlsanity.com/paper/2112.04698/) (2021)
- [A systematic review of biologically-informed deep learning models for cancer: fundamental trends for encoding and interpreting oncology data](https://mlsanity.com/paper/2207.00812/) (2022)
- [Applying Artificial Intelligence to Clinical Decision Support in Mental Health: What Have We Learned?](https://mlsanity.com/paper/2303.03511/) (2023)
- [Human Body Digital Twin: A Master Plan](https://mlsanity.com/paper/2307.09225/) (2023)
- [ECOR: Explainable CLIP for Object Recognition](https://mlsanity.com/paper/2404.12839/) (2024)
- [Multi-Scale Grouped Prototypes for Interpretable Semantic Segmentation](https://mlsanity.com/paper/2409.09497/) (2024)
- [Position: Machine Learning for Heart Transplant Allocation Policy Optimization Should Account for Incentives](https://mlsanity.com/paper/2602.04990/) (2026)
- [Development and evaluation of an Explainable Prediction Model for Chronic Kidney Disease Patients based on Ensemble Trees](https://mlsanity.com/paper/2105.10368/) (2021)
- [Policy Regularization for Legible Behavior](https://mlsanity.com/paper/2203.04303/) (2022)
- [BLIAM: Literature-based Data Synthesis for Synergistic Drug Combination Prediction](https://mlsanity.com/paper/2302.06860/) (2023)
- [Evaluative Item-Contrastive Explanations in Rankings](https://mlsanity.com/paper/2312.10094/) (2023)
- [Fast Calculation of Feature Contributions in Boosting Trees](https://mlsanity.com/paper/2407.03515/) (2024)
- [MoE-Enhanced Explainable Deep Manifold Transformation for Complex Data Embedding and Visualization](https://mlsanity.com/paper/2410.19504/) (2024)
- [Biological and Radiological Dictionary of Radiomics Features: Addressing Understandable AI Issues in Personalized Prostate Cancer; Dictionary Version PM1.0](https://mlsanity.com/paper/2412.10967/) (2024)

## Abstract (arXiv)

There is a need of ensuring machine learning models that are interpretable. Higher interpretability of the model means easier comprehension and explanation of future predictions for end-users. Further, interpretable machine learning models allow healthcare experts to make reasonable and data-driven decisions to provide personalized decisions that can ultimately lead to higher quality of service in healthcare. Generally, we can classify interpretability approaches in two groups where the first focuses on personalized interpretation (local interpretability) while the second summarizes prediction models on a population level (global interpretability). Alternatively, we can group interpretability methods into model-specific techniques, which are designed to interpret predictions generated by a specific model, such as a neural network, and model-agnostic approaches, which provide easy-to-understand explanations of predictions made by any machine learning model. Here, we give an overview of interpretability approaches and provide examples of practical interpretability of machine learning in different areas of healthcare, including prediction of health-related outcomes, optimizing treatments or improving the efficiency of screening for specific conditions. Further, we outline future directions for interpretable machine learning and highlight the importance of developing algorithmic solutions that can enable machine-learning driven decision making in high-stakes healthcare problems.