mlsanityData to 14 Oct 2026

A Design Framework for operationalizing Trustworthy Artificial Intelligence in Healthcare: Requirements, Tradeoffs and Challenges for its Clinical Adoption

arXiv 2504.19179 ↗First posted 27 Apr 2025cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

Artificial Intelligence (AI) holds great promise for transforming healthcare, particularly in disease diagnosis, prognosis, and patient care. The increasing availability of digital medical data, such as images, omics, biosignals, and electronic health records, combined with advances in computing, has enabled AI models to approach expert-level performance. However, widespread clinical adoption remains limited, primarily due to challenges beyond technical performance, including ethical concerns, regulatory barriers, and lack of trust. To address these issues, AI systems must align with the principles of Trustworthy AI (TAI), which emphasize human agency and oversight, algorithmic robustness, privacy and data governance, transparency, bias and discrimination avoidance, and accountability. Yet, the complexity of healthcare processes (e.g., screening, diagnosis, prognosis, and treatment) and the diversity of stakeholders (clinicians, patients, providers, regulators) complicate the integration of TAI principles. To bridge the gap between TAI theory and practical implementation, this paper proposes a design framework to support developers in embedding TAI principles into medical AI systems. Thus, for each stakeholder identified across various healthcare processes, we propose a disease-agnostic collection of requirements that medical AI systems should incorporate to adhere to the principles of TAI. Additionally, we examine the challenges and tradeoffs that may arise when applying these principles in practice. To ground the discussion, we focus on cardiovascular diseases, a field marked by both high prevalence and active AI innovation, and demonstrate how TAI principles have been applied and where key obstacles persist.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 32 of its 151 references that are in the map. First posted on arXiv 27 Apr 2025.

Builds on

32 of 151 references.

References · 32

  1. 2016Equality of Opportunity in Supervised Learningcited by 2,007
  2. 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,552
  3. 2017A Survey on Deep Learning in Medical Image Analysiscited by 1,186
  4. 2014Certifying and removing disparate impactcited by 715
  5. 2016Fair prediction with disparate impact: A study of bias in recidivism prediction instrumentscited by 672
  6. 2017Algorithmic decision making and the cost of fairnesscited by 403
  7. 2017Fairness in Criminal Justice Risk Assessments: The State of the Artcited by 315
  8. 2022From Anecdotal Evidence to Quantitative Evaluation Methods: A Systematic Review on Evaluating Explainable AIcited by 302
  9. 2018Path-Specific Counterfactual Fairnesscited by 181
  10. 2018Classification with Fairness Constraints: A Meta-Algorithm with Provable Guaranteescited by 146
  11. 2018A Unified Approach to Quantifying Algorithmic Unfairness: Measuring Individual & Group Unfairness via Inequality Indicescited by 97
  12. 2020The role of explainability in creating trustworthy artificial intelligence for health care: a comprehensive survey of the terminology, design choices, and evaluation strategiescited by 92
20 more
  1. 2022Survey on Federated Learning Threats: concepts, taxonomy on attacks and defences, experimental study and challengescited by 84
  2. 2021Transparency of Deep Neural Networks for Medical Image Analysis: A Review of Interpretability Methodscited by 83
  3. 2019Measuring the Quality of Explanations: The System Causability Scale (SCS). Comparing Human and Machine Explanationscited by 64
  4. 2018Online Learning with an Unknown Fairness Metriccited by 62
  5. 2023Connecting the Dots in Trustworthy Artificial Intelligence: From AI Principles, Ethics, and Key Requirements to Responsible AI Systems and Regulationcited by 61
  6. 2021Socially Responsible AI Algorithms: Issues, Purposes, and Challengescited by 56
  7. 2018Fairness Through Computationally-Bounded Awarenesscited by 55
  8. 2016Auditing Black-box Models for Indirect Influencecited by 41
  9. 2020FAE: A Fairness-Aware Ensemble Frameworkcited by 34
  10. 2021Unraveling the Hidden Environmental Impacts of AI Solutions for Environmentcited by 32
  11. 2022Handling missing values in healthcare data: A systematic review of deep learning-based imputation techniquescited by 25
  12. 2023A Review on Explainable Artificial Intelligence for Healthcare: Why, How, and When?cited by 24
  13. 2023Physical Adversarial Attacks For Camera-based Smart Systems: Current Trends, Categorization, Applications, Research Challenges, and Future Outlookcited by 20
  14. 2022Data Harmonisation for Information Fusion in Digital Healthcare: A State-of-the-Art Systematic Review, Meta-Analysis and Future Research Directionscited by 19
  15. 2024Can I trust my fake data -- A comprehensive quality assessment framework for synthetic tabular data in healthcarecited by 17
  16. 2022Trustworthy Federated Learning via Blockchaincited by 15
  17. 2023Designing Interpretable ML System to Enhance Trust in Healthcare: A Systematic Review to Proposed Responsible Clinician-AI-Collaboration Frameworkcited by 11
  18. 2022Holding AI to Account: Challenges for the Delivery of Trustworthy AI in Healthcarecited by 9
  19. 2021Improvement of a Prediction Model for Heart Failure Survival through Explainable Artificial Intelligencecited by 6
  20. 2021Identifying Roles, Requirements and Responsibilities in Trustworthy AI Systemscited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.