Explainable AI for clinical and remote health applications: a survey on tabular and time series data
Not on the map. Why?
Abstract (arXiv)
Nowadays Artificial Intelligence (AI) has become a fundamental component of healthcare applications, both clinical and remote, but the best performing AI systems are often too complex to be self-explaining. Explainable AI (XAI) techniques are defined to unveil the reasoning behind the system's predictions and decisions, and they become even more critical when dealing with sensitive and personal health data. It is worth noting that XAI has not gathered the same attention across different research areas and data types, especially in healthcare. In particular, many clinical and remote health applications are based on tabular and time series data, respectively, and XAI is not commonly analysed on these data types, while computer vision and Natural Language Processing (NLP) are the reference applications. To provide an overview of XAI methods that are most suitable for tabular and time series data in the healthcare domain, this paper provides a review of the literature in the last 5 years, illustrating the type of generated explanations and the efforts provided to evaluate their relevance and quality. Specifically, we identify clinical validation, consistency assessment, objective and standardised quality evaluation, and human-centered quality assessment as key features to ensure effective explanations for the end users. Finally, we highlight the main research challenges in the field as well as the limitations of existing XAI methods.
Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). Builds on 64 of its 209 references that are in the map. First posted on arXiv 14 Sep 2022.
Builds on
64 of 209 references.
References · 64
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,827
- 2017Axiomatic Attribution for Deep Networkscited by 3,350
- 2015Learning Deep Features for Discriminative Localizationcited by 2,430
- 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,348
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
38 more
- 2013Visualizing and Understanding Convolutional Networkscited by 2,278
- 2016Equality of Opportunity in Supervised Learningcited by 2,000
- 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,543
- 2017Learning Important Features Through Propagating Activation Differencescited by 1,454
- 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,400
- 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,309
- 2017Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPRcited by 1,086
- 2014Striving for Simplicity: The All Convolutional Netcited by 983
- 2017Network Dissection: Quantifying Interpretability of Deep Visual Representationscited by 703
- 2019TabNet: Attentive Interpretable Tabular Learningcited by 640
- 2018Towards Robust Interpretability with Self-Explaining Neural Networkscited by 505
- 2018The UCR Time Series Archivecited by 421
- 2019A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAIcited by 403
- 2016RETAIN: An Interpretable Predictive Model for Healthcare using Reverse Time Attention Mechanismcited by 344
- 2017The (Un)reliability of saliency methodscited by 331
- 2018On the Robustness of Interpretability Methodscited by 310
- 2020Opportunities and Challenges in Explainable Artificial Intelligence (XAI): A Surveycited by 252
- 2019InterpretML: A Unified Framework for Machine Learning Interpretabilitycited by 243
- 2019On Completeness-aware Concept-Based Explanations in Deep Neural Networkscited by 239
- 2018Techniques for Interpretable Machine Learningcited by 237
- 2019Interpretable Counterfactual Explanations Guided by Prototypescited by 223
- 2016Visualizing the Effects of Predictor Variables in Black Box Supervised Learning Modelscited by 212
- 2019The What-If Tool: Interactive Probing of Machine Learning Modelscited by 207
- 2021Towards Causal Representation Learningcited by 207
- 2018Local Rule-Based Explanations of Black Box Decision Systemscited by 165
- 2019Explaining Classifiers with Causal Concept Effect (CaCE)cited by 135
- 2020The role of explainability in creating trustworthy artificial intelligence for health care: a comprehensive survey of the terminology, design choices, and evaluation strategiescited by 91
- 2021Explainable Artificial Intelligence (XAI) on TimeSeries Data: A Surveycited by 71
- 2017Beyond Sparsity: Tree Regularization of Deep Models for Interpretabilitycited by 68
- 2019Measuring the Quality of Explanations: The System Causability Scale (SCS). Comparing Human and Machine Explanationscited by 63
- 2018RetainVis: Visual Analytics with Interpretable and Interactive Recurrent Neural Networks on Electronic Medical Recordscited by 61
- 2019DLIME: A Deterministic Local Interpretable Model-Agnostic Explanations Approach for Computer-Aided Diagnosis Systemscited by 59
- 2019Explainable artificial intelligence model to predict acute critical illness from electronic health recordscited by 42
- 2019ALIME: Autoencoder Based Approach for Local Interpretabilitycited by 41
- 2021A Survey on the Robustness of Feature Importance and Counterfactual Explanationscited by 38
- 2014Interpreting Tree Ensembles with inTreescited by 37
- 2018TSViz: Demystification of Deep Learning Models for Time-Series Analysiscited by 25
- 2018A Human-Grounded Evaluation Benchmark for Local Explanations of Machine Learningcited by 21
50 most cited of 64 All 64 (JSON)
Built on by
Citing papers per year: 2022: 1; 2023: 7; 2024: 7; 2025: 5; 2026: 4.
24 papers.
Sort:
By area:
- 2025Representation Learning for Tabular Data: A Comprehensive Surveycited by 36
- 2023DIVERSIFY: A General Framework for Time Series Out-of-distribution Detection and Generalizationcited by 24
- 2025Out-of-Distribution Generalization in Time Series: A Surveycited by 15
- 2024A Survey of Explainable Artificial Intelligence (XAI) in Financial Time Series Forecastingcited by 14
- 2023Designing Interpretable ML System to Enhance Trust in Healthcare: A Systematic Review to Proposed Responsible Clinician-AI-Collaboration Frameworkcited by 11
- 2023Don't PANIC: Prototypical Additive Neural Network for Interpretable Classification of Alzheimer's Diseasecited by 7
- 2023Categorical Foundations of Explainable AI: A Unifying Theorycited by 7
- 2024FLEXtime: Filterbank learning to explain time seriescited by 6
- 2024Improve Fidelity and Utility of Synthetic Credit Card Transaction Time Series from Data-centric Perspectivecited by 5
- 2024Revisiting the robustness of post-hoc interpretability methodscited by 5
- 2024A Temporally Disentangled Contrastive Diffusion Model for Spatiotemporal Imputationcited by 4
- 2025Explainable AI for Clinical Outcome Prediction: A Survey of Clinician Perceptions and Preferencescited by 4
12 more
- 2023Interpretable Alzheimer's Disease Classification Via a Contrastive Diffusion Autoencodercited by 3
- 2022Context-dependent Explainability and Contestability for Trustworthy Medical Artificial Intelligence: Misclassification Identification of Morbidity Recognition Models in Preterm Infantscited by 1
- 2025Explainable AI for Infection Prevention and Control: Modeling CPE Acquisition and Patient Outcomes in an Irish Hospital with Transformerscited by 1
- 2026High Performance, Low Reliability: Uncertainty Benchmarking for Tabular Foundation Modelscited by 1
- 2023Explainable AI for Malnutrition Risk Prediction from m-Health and Clinical Datacited by 0
- 2023XAI for In-hospital Mortality Prediction via Multimodal ICU Datacited by 0
- 2024Tokenize features, enhancing tables: the FT-TABPFN model for tabular classificationcited by 0
- 2024An AI-Enabled Framework Within Reach for Enhancing Healthcare Sustainability and Fairnesscited by 0
- 2025Application of Sensitivity Analysis Methods for Studying Neural Network Modelscited by 0
- 2026Interpretability in Deep Time Series Models Demands Semantic Alignmentcited by 0
- 2026L2GTX: From Local to Global Time Series Explanationscited by 0
- 2026DeepL'evy: Learning Heavy-Tailed Uncertainty in Highly Volatile Time Seriescited by 0
- 2026High Performance, Low Reliability: Uncertainty Benchmarking for Tabular Foundation Models27 May 2026
- 2026DeepL'evy: Learning Heavy-Tailed Uncertainty in Highly Volatile Time Series11 May 2026
- 2026L2GTX: From Local to Global Time Series Explanations13 Mar 2026
- 2026Interpretability in Deep Time Series Models Demands Semantic Alignment2 Feb 2026
- 2025Explainable AI for Infection Prevention and Control: Modeling CPE Acquisition and Patient Outcomes in an Irish Hospital with Transformers18 Sep 2025
- 2025Application of Sensitivity Analysis Methods for Studying Neural Network Models21 Apr 2025
- 2025Representation Learning for Tabular Data: A Comprehensive Survey17 Apr 2025
- 2025Out-of-Distribution Generalization in Time Series: A Survey18 Mar 2025
- 2025Explainable AI for Clinical Outcome Prediction: A Survey of Clinician Perceptions and Preferences27 Feb 2025
- 2024FLEXtime: Filterbank learning to explain time series6 Nov 2024
- 2024Revisiting the robustness of post-hoc interpretability methods29 Jul 2024
- 2024A Survey of Explainable Artificial Intelligence (XAI) in Financial Time Series Forecasting22 Jul 2024
12 more
- 2024Tokenize features, enhancing tables: the FT-TABPFN model for tabular classification11 Jun 2024
- 2024An AI-Enabled Framework Within Reach for Enhancing Healthcare Sustainability and Fairness21 Apr 2024
- 2024A Temporally Disentangled Contrastive Diffusion Model for Spatiotemporal Imputation18 Feb 2024
- 2024Improve Fidelity and Utility of Synthetic Credit Card Transaction Time Series from Data-centric Perspective1 Jan 2024
- 2023XAI for In-hospital Mortality Prediction via Multimodal ICU Data29 Dec 2023
- 2023Designing Interpretable ML System to Enhance Trust in Healthcare: A Systematic Review to Proposed Responsible Clinician-AI-Collaboration Framework18 Nov 2023
- 2023DIVERSIFY: A General Framework for Time Series Out-of-distribution Detection and Generalization4 Aug 2023
- 2023Interpretable Alzheimer's Disease Classification Via a Contrastive Diffusion Autoencoder5 Jun 2023
- 2023Explainable AI for Malnutrition Risk Prediction from m-Health and Clinical Data31 May 2023
- 2023Categorical Foundations of Explainable AI: A Unifying Theory27 Apr 2023
- 2023Don't PANIC: Prototypical Additive Neural Network for Interpretable Classification of Alzheimer's Disease13 Mar 2023
- 2022Context-dependent Explainability and Contestability for Trustworthy Medical Artificial Intelligence: Misclassification Identification of Morbidity Recognition Models in Preterm Infants17 Dec 2022
- 2025Representation Learning for Tabular Data: A Comprehensive Surveycited by 36
- 2023DIVERSIFY: A General Framework for Time Series Out-of-distribution Detection and Generalizationcited by 24
- 2025Out-of-Distribution Generalization in Time Series: A Surveycited by 15
- 2024A Survey of Explainable Artificial Intelligence (XAI) in Financial Time Series Forecastingcited by 14
- 2023Designing Interpretable ML System to Enhance Trust in Healthcare: A Systematic Review to Proposed Responsible Clinician-AI-Collaboration Frameworkcited by 11
- 2023Don't PANIC: Prototypical Additive Neural Network for Interpretable Classification of Alzheimer's Diseasecited by 7
- 2023Categorical Foundations of Explainable AI: A Unifying Theorycited by 7
- 2024FLEXtime: Filterbank learning to explain time seriescited by 6
- 2024Improve Fidelity and Utility of Synthetic Credit Card Transaction Time Series from Data-centric Perspectivecited by 5
- 2024Revisiting the robustness of post-hoc interpretability methodscited by 5
- 2025Explainable AI for Clinical Outcome Prediction: A Survey of Clinician Perceptions and Preferencescited by 4
- 2023Interpretable Alzheimer's Disease Classification Via a Contrastive Diffusion Autoencodercited by 3
12 most cited of 23 All 23 (JSON)
- 2026High Performance, Low Reliability: Uncertainty Benchmarking for Tabular Foundation Models27 May 2026
- 2026DeepL'evy: Learning Heavy-Tailed Uncertainty in Highly Volatile Time Series11 May 2026
- 2026L2GTX: From Local to Global Time Series Explanations13 Mar 2026
- 2026Interpretability in Deep Time Series Models Demands Semantic Alignment2 Feb 2026
- 2025Explainable AI for Infection Prevention and Control: Modeling CPE Acquisition and Patient Outcomes in an Irish Hospital with Transformers18 Sep 2025
- 2025Application of Sensitivity Analysis Methods for Studying Neural Network Models21 Apr 2025
- 2025Representation Learning for Tabular Data: A Comprehensive Survey17 Apr 2025
- 2025Out-of-Distribution Generalization in Time Series: A Survey18 Mar 2025
- 2025Explainable AI for Clinical Outcome Prediction: A Survey of Clinician Perceptions and Preferences27 Feb 2025
- 2024FLEXtime: Filterbank learning to explain time series6 Nov 2024
- 2024Revisiting the robustness of post-hoc interpretability methods29 Jul 2024
- 2024A Survey of Explainable Artificial Intelligence (XAI) in Financial Time Series Forecasting22 Jul 2024
12 newest of 23 All 23 (JSON)