mlsanityData to 14 Oct 2026

Trustworthy AI in Digital Health: A Comprehensive Review of Robustness and Explainability

arXiv 2608.02238 ↗First posted 3 Aug 2026cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Ensuring trust in AI systems is essential for the safe and ethical integration of machine learning systems into high-stakes domains such as digital health. Key dimensions, including robustness, explainability, fairness, accountability, and privacy, need to be addressed throughout the AI lifecycle, from problem formulation and data collection to model deployment and human interaction. While various contributions address different aspects of trustworthy AI, a focused synthesis on robustness and explainability, especially tailored to the healthcare context, remains limited. This review addresses that need by organizing recent advancements into an accessible framework, highlighting both technical and practical considerations. We present a structured overview of methods, challenges, and solutions, aiming to support researchers and practitioners in developing reliable and explainable AI solutions for digital health. This review article is organized into three main parts. First, we introduce the pillars of trustworthy AI and discuss the technical and ethical challenges, particularly in the context of digital health. Second, we explore application-specific trust considerations across domains such as intensive care, neonatal health, and metabolic health, highlighting how robustness and explainability support trust. Lastly, we present recent advancements in techniques aimed at improving robustness under data scarcity and distributional shifts, as well as explainable AI methods ranging from feature attribution to gradient-based interpretations and counterfactual explanations. This paper is further enriched with detailed discussions of the contributions toward robustness and explainability in digital health, the development of trustworthy AI systems in the era of LLMs, and various evaluation metrics for measuring trust and related parameters such as validity, fidelity, and diversity.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 75 of its 202 references that are in the map. First posted on arXiv 3 Aug 2026.

Builds on

75 of 202 references.

References · 75

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  3. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  4. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
  5. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  6. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
  7. 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
  8. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
  9. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  10. 2017Axiomatic Attribution for Deep Networkscited by 3,384
  11. 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,223
  12. 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,371
38 more
  1. 2013Visualizing and Understanding Convolutional Networkscited by 2,290
  2. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
  3. 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,416
  4. 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 939
  5. 2021Show Your Work: Scratchpads for Intermediate Computation with Language Modelscited by 886
  6. 2016The Mythos of Model Interpretabilitycited by 721
  7. 2019Modeling Tabular data using Conditional GANcited by 699
  8. 2019Explaining Machine Learning Classifiers through Diverse Counterfactual Explanationscited by 614
  9. 2019UNet++: Redesigning Skip Connections to Exploit Multiscale Features in Image Segmentationcited by 586
  10. 2018e-SNLI: Natural Language Inference with Natural Language Explanationscited by 468
  11. 2023Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' Alignmentcited by 401
  12. 2021Domain Adaptation for Medical Image Analysis: A Surveycited by 352
  13. 2018Aleatoric uncertainty estimation with test-time augmentation for medical image segmentation with convolutional neural networkscited by 280
  14. 2022YOLOv6: A Single-Stage Object Detection Framework for Industrial Applicationscited by 275
  15. 2023Multimodal Deep Learningcited by 258
  16. 2021Trustworthy AI: From Principles to Practicescited by 207
  17. 2016Layer-wise Relevance Propagation for Neural Networks with Local Renormalization Layerscited by 199
  18. 2018Multimodal Explanations: Justifying Decisions and Pointing to the Evidencecited by 179
  19. 2025Llama-Nemotron: Efficient Reasoning Modelscited by 158
  20. 2020Multi-Objective Counterfactual Explanationscited by 157
  21. 2022From Attribution Maps to Human-Understandable Explanations through Concept Relevance Propagationcited by 141
  22. 2019What Clinicians Want: Contextualizing Explainable Machine Learning for Clinical End Usecited by 135
  23. 2022Bias Mitigation for Machine Learning Classifiers: A Comprehensive Surveycited by 125
  24. 2024HaloScope: Harnessing Unlabeled LLM Generations for Hallucination Detectioncited by 99
  25. 2024RLHF Deciphered: A Critical Analysis of Reinforcement Learning from Human Feedback for LLMscited by 90
  26. 2023Do Models Explain Themselves? Counterfactual Simulatability of Natural Language Explanationscited by 85
  27. 2021If Only We Had Better Counterfactual Explanations: Five Key Deficits to Rectify in the Evaluation of Counterfactual XAI Techniquescited by 82
  28. 2021Robust Counterfactual Explanations on Graph Neural Networkscited by 72
  29. 2018Mobile Sensor Data Anonymizationcited by 70
  30. 2018A Review of Challenges and Opportunities in Machine Learning for Healthcited by 68
  31. 2021NICE: An Algorithm for Nearest Instance Counterfactual Explanationscited by 62
  32. 2023Explaining black box text modules in natural language with language modelscited by 62
  33. 2019Quantifying Interpretability and Trust in Machine Learning Systemscited by 49
  34. 2018Protecting Sensory Data against Sensitive Inferencescited by 45
  35. 2024Improving LLM Reasoning through Scaling Inference Computation with Collaborative Verificationcited by 40
  36. 2024Unmasking and Quantifying Racial Bias of Large Language Models in Medical Report Generationcited by 31
  37. 2024DrHouse: An LLM-empowered Diagnostic Reasoning System through Harnessing Outcomes from Sensor Data and Expert Knowledgecited by 24
  38. 2021CALDA: Improving Multi-Source Time Series Domain Adaptation with Contrastive Adversarial Learningcited by 23

50 most cited of 75 All 75 (JSON)

Built on by

Not cited yet.