Learning to Predict with Supporting Evidence: Applications to Clinical Risk Prediction
Not on the map. Why?
Abstract (arXiv)
The impact of machine learning models on healthcare will depend on the degree of trust that healthcare professionals place in the predictions made by these models. In this paper, we present a method to provide people with clinical expertise with domain-relevant evidence about why a prediction should be trusted. We first design a probabilistic model that relates meaningful latent concepts to prediction targets and observed data. Inference of latent variables in this model corresponds to both making a prediction and providing supporting evidence for that prediction. We present a two-step process to efficiently approximate inference: (i) estimating model parameters using variational learning, and (ii) approximating maximum a posteriori estimation of latent variables in the model using a neural network, trained with an objective derived from the probabilistic model. We demonstrate the method on the task of predicting mortality risk for patients with cardiovascular disease. Specifically, using electrocardiogram and tabular data as input, we show that our approach provides appropriate domain-relevant supporting evidence for accurate predictions.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 20 of its 50 references that are in the map. First posted on arXiv 4 Mar 2021.
Builds on
20 of 50 references.
References · 20
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2017Axiomatic Attribution for Deep Networkscited by 3,350
- 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,348
- 2013Visualizing and Understanding Convolutional Networkscited by 2,278
- 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,309
- 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,201
- 2020Concept Bottleneck Modelscited by 1,022
- 2018Towards Robust Interpretability with Self-Explaining Neural Networkscited by 505
- 2016Rationalizing Neural Predictionscited by 281
- 2019DiffTaichi: Differentiable Programming for Physical Simulationcited by 248
- 2017Deep Learning for Case-Based Reasoning through Prototypes: A Neural Network that Explains Its Predictionscited by 234
8 more
- 2019What Clinicians Want: Contextualizing Explainable Machine Learning for Clinical End Usecited by 134
- 2019Human-Centered Tools for Coping with Imperfect Algorithms during Medical Decision-Makingcited by 109
- 2020A Case for Humans-in-the-Loop: Decisions in the Presence of Erroneous Algorithmic Scorescited by 74
- 2019Regularizing Black-box Models for Improved Interpretabilitycited by 35
- 2018TED: Teaching AI to Explain its Decisionscited by 33
- 2017Contextual Explanation Networkscited by 21
- 2019Deep neural networks can predict mortality from 12-lead electrocardiogram voltage datacited by 20
- 2019Unsupervised Deep Learning for Bayesian Brain MRI Segmentationcited by 20
Built on by
Citing papers per year: 2021: 2; 2022: 2; 2023: 2; 2024: 1.
7 papers.
- 2022Data Augmentation for Electrocardiogramscited by 12
- 2023Informing clinical assessment by contextualizing post-hoc explanations of risk prediction models in type-2 diabetescited by 8
- 2021Image Classification with Consistent Supporting Evidencecited by 3
- 2023Bayesian Generalization Error in Linear Neural Networks with Concept Bottleneck Structure and Multitask Formulationcited by 3
- 2022Context-dependent Explainability and Contestability for Trustworthy Medical Artificial Intelligence: Misclassification Identification of Morbidity Recognition Models in Preterm Infantscited by 1
- 2024Upper Bound of Bayesian Generalization Error in Partial Concept Bottleneck Model (CBM): Partial CBM outperforms naive CBMcited by 1
- 2021Leveraging Clinical Context for User-Centered Explainability: A Diabetes Use Casecited by 0
- 2024Upper Bound of Bayesian Generalization Error in Partial Concept Bottleneck Model (CBM): Partial CBM outperforms naive CBM14 Mar 2024
- 2023Bayesian Generalization Error in Linear Neural Networks with Concept Bottleneck Structure and Multitask Formulation16 Mar 2023
- 2023Informing clinical assessment by contextualizing post-hoc explanations of risk prediction models in type-2 diabetes11 Feb 2023
- 2022Context-dependent Explainability and Contestability for Trustworthy Medical Artificial Intelligence: Misclassification Identification of Morbidity Recognition Models in Preterm Infants17 Dec 2022
- 2022Data Augmentation for Electrocardiograms9 Apr 2022
- 2021Image Classification with Consistent Supporting Evidence13 Nov 2021
- 2021Leveraging Clinical Context for User-Centered Explainability: A Diabetes Use Case6 Jul 2021