Never trust, always verify : a roadmap for Trustworthy AI?
Not on the map. Why?
Abstract (arXiv)
Artificial Intelligence (AI) is becoming the corner stone of many systems used in our daily lives such as autonomous vehicles, healthcare systems, and unmanned aircraft systems. Machine Learning is a field of AI that enables systems to learn from data and make decisions on new data based on models to achieve a given goal. The stochastic nature of AI models makes verification and validation tasks challenging. Moreover, there are intrinsic biaises in AI models such as reproductibility bias, selection bias (e.g., races, genders, color), and reporting bias (i.e., results that do not reflect the reality). Increasingly, there is also a particular attention to the ethical, legal, and societal impacts of AI. AI systems are difficult to audit and certify because of their black-box nature. They also appear to be vulnerable to threats; AI systems can misbehave when untrusted data are given, making them insecure and unsafe. Governments, national and international organizations have proposed several principles to overcome these challenges but their applications in practice are limited and there are different interpretations in the principles that can bias implementations. In this paper, we examine trust in the context of AI-based systems to understand what it means for an AI system to be trustworthy and identify actions that need to be undertaken to ensure that AI systems are trustworthy. To achieve this goal, we first review existing approaches proposed for ensuring the trustworthiness of AI systems, in order to identify potential conceptual gaps in understanding what trustworthy AI is. Then, we suggest a trust (resp. zero-trust) model for AI and suggest a set of properties that should be satisfied to ensure the trustworthiness of AI systems.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 17 of its 50 references that are in the map. First posted on arXiv 23 Jun 2022.
Builds on
17 of 50 references.
References · 17
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2016Deep Learning with Differential Privacycited by 2,728
- 2019A Survey on Bias and Fairness in Machine Learningcited by 1,917
- 2018Model Cards for Model Reportingcited by 1,080
- 2019Green AIcited by 627
- 2020On Adaptive Attacks to Adversarial Example Defensescited by 555
- 2020Human-Centered Artificial Intelligence: Reliable, Safe & Trustworthycited by 183
- 2020Formalizing Trust in Artificial Intelligence: Prerequisites, Causes and Goals of Human Trust in AIcited by 167
- 2020Toward Trustworthy AI Development: Mechanisms for Supporting Verifiable Claimscited by 165
- 2020Backdoor Attacks and Countermeasures on Deep Learning: A Comprehensive Reviewcited by 123
- 2016Towards the Science of Security and Privacy in Machine Learningcited by 89
5 more
- 2020Trustworthy AIcited by 62
- 2021A Review of Formal Methods applied to Machine Learningcited by 33
- 2022Towards a Roadmap on Software Engineering for Responsible AIcited by 9
- 2018VerIDeep: Verifying Integrity of Deep Neural Networks through Sensitive-Sample Fingerprintingcited by 8
- 2022The Different Faces of AI Ethics Across the World: A Principle-Implementation Gap Analysiscited by 1
Built on by
Citing papers per year: 2022: 1; 2023: 2; 2024: 0; 2025: 1.
4 papers.
- 2025Edge-Cloud Collaborative Computing on Distributed Intelligence and Model Optimization: A Surveycited by 14
- 2022Threat Assessment in Machine Learning based Systemscited by 9
- 2023Model Reporting for Certifiable AI: A Proposal from Merging EU Regulation into AI Developmentcited by 6
- 2023Responsible Design Patterns for Machine Learning Pipelinescited by 4
- 2025Edge-Cloud Collaborative Computing on Distributed Intelligence and Model Optimization: A Survey3 May 2025
- 2023Model Reporting for Certifiable AI: A Proposal from Merging EU Regulation into AI Development21 Jul 2023
- 2023Responsible Design Patterns for Machine Learning Pipelines31 May 2023
- 2022Threat Assessment in Machine Learning based Systems30 Jun 2022