Designing for Responsible Trust in AI Systems: A Communication Perspective
Not on the map. Why?
Abstract (arXiv)
Current literature and public discourse on "trust in AI" are often focused on the principles underlying trustworthy AI, with insufficient attention paid to how people develop trust. Given that AI systems differ in their level of trustworthiness, two open questions come to the fore: how should AI trustworthiness be responsibly communicated to ensure appropriate and equitable trust judgments by different users, and how can we protect users from deceptive attempts to earn their trust? We draw from communication theories and literature on trust in technologies to develop a conceptual model called MATCH, which describes how trustworthiness is communicated in AI systems through trustworthiness cues and how those cues are processed by people to make trust judgments. Besides AI-generated content, we highlight transparency and interaction as AI systems' affordances that present a wide range of trustworthiness cues to users. By bringing to light the variety of users' cognitive processes to make trust judgments and their potential limitations, we urge technology creators to make conscious decisions in choosing reliable trustworthiness cues for target users and, as an industry, to regulate this space and prevent malicious use. Towards these goals, we define the concepts of warranted trustworthiness cues and expensive trustworthiness cues, and propose a checklist of requirements to help technology creators identify appropriate cues to use. We present a hypothetical use case to illustrate how practitioners can use MATCH to design AI systems responsibly, and discuss future directions for research and industry efforts aimed at promoting responsible trust in AI.
Key facts. Cited by 48 papers in the map (data through 7 Oct 2026). Builds on 16 of its 72 references that are in the map. First posted on arXiv 29 Apr 2022.
Builds on
16 of 72 references.
References · 16
- 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,400
- 2018Model Cards for Model Reportingcited by 1,068
- 2018A Survey Of Methods For Explaining Black Box Modelscited by 970
- 2020Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performancecited by 396
- 2020Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditingcited by 380
- 2020Effect of Confidence and Explanation on Accuracy and Trust Calibration in AI-Assisted Decision Makingcited by 281
- 2018Metrics for Explainable AI: Challenges and Prospectscited by 257
- 2020Formalizing Trust in Artificial Intelligence: Prerequisites, Causes and Goals of Human Trust in AIcited by 166
- 2019Principles alone cannot guarantee ethical AIcited by 134
- 2021Expanding Explainability: Towards Social Transparency in AI systemscited by 124
- 2021Human-Centered Explainable AI (XAI): From Algorithms to User Experiencescited by 123
- 2021Towards a Science of Human-AI Decision Making: A Survey of Empirical Studiescited by 85
4 more
- 2019The relationship between trust in AI and trustworthy machine learning technologiescited by 78
- 2020Misplaced Trust: Measuring the Interference of Machine Learning in Human Decision-Makingcited by 25
- 2021The Sanction of Authority: Promoting Public Trust in AIcited by 19
- 2019Experiences with Improving the Transparency of AI Models and Servicescited by 14
Built on by
Citing papers per year: 2023: 9; 2024: 13; 2025: 11; 2026: 15.
48 papers.
Sort:
By area:
- 2024Who Validates the Validators? Aligning LLM-Assisted Evaluation of LLM Outputs with Human Preferencescited by 142
- 2024Homogenization Effects of Large Language Models on Human Creative Ideationcited by 127
- 2023AI Transparency in the Age of LLMs: A Human-Centered Research Roadmapcited by 119
- 2023ChainForge: A Visual Toolkit for Prompt Engineering and LLM Hypothesis Testingcited by 88
- 2023Better to Ask in English: Cross-Lingual Evaluation of Large Language Models for Healthcare Queriescited by 82
- 2023Understanding the Role of Human Intuition on Reliance in Human-AI Decision-Making with Explanationscited by 73
- 2024Calibrating Large Language Models Using Their Generations Onlycited by 63
- 2025Plan-Then-Execute: An Empirical Study of User Trust and Team Performance When Using LLM Agents As A Daily Assistantcited by 54
- 2025Fostering Appropriate Reliance on Large Language Models: The Role of Explanations, Sources, and Inconsistenciescited by 39
- 2023Selective Explanations: Leveraging Human Input to Align Explainable AIcited by 29
- 2024Towards interactive evaluations for interaction harms in human-AI systemscited by 27
- 2023A Systematic Review on Fostering Appropriate Trust in Human-AI Interactioncited by 21
36 more
- 2023Humans, AI, and Context: Understanding End-Users' Trust in a Real-World Computer Vision Applicationcited by 14
- 2024Characterizing and modeling harms from interactions with design patterns in AI interfacescited by 11
- 2024Social Intelligence Data Infrastructure: Structuring the Present and Navigating the Futurecited by 10
- 2024Towards More Trustworthy and Interpretable LLMs for Code through Syntax-Grounded Explanationscited by 10
- 2025Understanding AI Trustworthiness: A Scoping Review of AIES & FAccT Articlescited by 6
- 2023A Systematic Literature Review of Human-Centered, Ethical, and Responsible AIcited by 5
- 2023Certification Labels for Trustworthy AI: Insights From an Empirical Mixed-Method Studycited by 5
- 2024(Un)making AI Magic: a Design Taxonomycited by 5
- 2024An Empirical Exploration of Trust Dynamics in LLM Supply Chainscited by 5
- 2025A Framework for Responsible AI Systems: Building Societal Trust through Domain Definition, Trustworthy AI Design, Auditability, Accountability, and Governancecited by 5
- 2024Thoughtful Adoption of NLP for Civic Participation: Understanding Differences Among Policymakerscited by 3
- 2026Label Effects: Shared Heuristic Reliance in Trust Assessment by Humans and LLM-as-a-Judgecited by 3
- 2024The AI-DEC: A Card-based Design Method for User-centered AI Explanationscited by 2
- 2024Predicting Trust In Autonomous Vehicles: Modeling Young Adult Psychosocial Traits, Risk-Benefit Attitudes, And Driving Factors With Machine Learningcited by 2
- 2024Contextualized AI for Cyber Defense: An Automated Survey using LLMscited by 1
- 2025Mapping Trustworthiness in Large Language Models: A Bibliometric Analysis Bridging Theory to Practicecited by 1
- 2025The Variance Paradox: How AI Reduces Diversity but Increases Noveltycited by 1
- 2025NeuroBridge: Using Generative AI to Bridge Cross-neurotype Communication Differences through Neurotypical Perspective-takingcited by 1
- 2025Towards Meaningful Transparency in Civic AI Systemscited by 1
- 2026A Checklist for Trustworthy, Safe, and User-Friendly Mental Health Chatbotscited by 1
- 2026Beyond Abstract Compliance: Operationalising trust in AI as a moral relationshipcited by 1
- 2026A Methodology for Auditable Trustworthiness Levels in AI Lifecycle Governancecited by 1
- 2025Mapping the Trust Terrain: LLMs in Software Engineering -- Insights and Perspectivescited by 0
- 2025"Even explanations will not help in trusting [this] fundamentally biased system": A Predictive Policing Case-Studycited by 0
- 2025Cracking CodeWhisperer: Analyzing Developers' Interactions and Patterns During Programming Taskscited by 0
- 2026Visual or Textual: Effects of Explanation Format and Personal Characteristics on the Perception of Explanations in an Educational Recommender Systemcited by 0
- 2026Trust Stack for Mental Health AI: A Survey of Calibration across Human, Interaction, and AI Layerscited by 0
- 2026Investigating the Effects of Different Levels of User Control in an Interactive Educational Recommender Systemcited by 0
- 2026Less Interaction But More Explanation: A Communication Perspective on Agentic AI Interfacescited by 0
- 2026A Compound AI Agent for Conversational Grant Discoverycited by 0
- 2026AI Adoption Across a Multinational Workforce: Sociotechnical Conditions for GenAI Acceptance in Human Resourcescited by 0
- 2026Design Theater: Evaluating the Gap Between User-Facing Design Reasoning and Implementation in Generative UI Toolscited by 0
- 2026Epistemic Trustworthiness in Generative AI: A Normative Framework for Warranted Reliance in High-Stakes Workflowscited by 0
- 2026Visualizing Uncertainty-to-Action Composition for Human Oversightcited by 0
- 2026When Trust Meets Truth: Trust-Truth Separability in LLM-as-Judgecited by 0
- 2026Assessing the Applicability of Existing Design Recommendations to AI Companion Design: A Multi-Method Studycited by 0
- 2026Assessing the Applicability of Existing Design Recommendations to AI Companion Design: A Multi-Method Study13 Sep 2026
- 2026When Trust Meets Truth: Trust-Truth Separability in LLM-as-Judge21 Aug 2026
- 2026Visualizing Uncertainty-to-Action Composition for Human Oversight17 Aug 2026
- 2026Epistemic Trustworthiness in Generative AI: A Normative Framework for Warranted Reliance in High-Stakes Workflows6 Aug 2026
- 2026Design Theater: Evaluating the Gap Between User-Facing Design Reasoning and Implementation in Generative UI Tools24 Jul 2026
- 2026A Methodology for Auditable Trustworthiness Levels in AI Lifecycle Governance17 Jul 2026
- 2026AI Adoption Across a Multinational Workforce: Sociotechnical Conditions for GenAI Acceptance in Human Resources16 Jun 2026
- 2026A Compound AI Agent for Conversational Grant Discovery4 May 2026
- 2026Less Interaction But More Explanation: A Communication Perspective on Agentic AI Interfaces2 May 2026
- 2026Investigating the Effects of Different Levels of User Control in an Interactive Educational Recommender System2 May 2026
- 2026Trust Stack for Mental Health AI: A Survey of Calibration across Human, Interaction, and AI Layers22 Apr 2026
- 2026Label Effects: Shared Heuristic Reliance in Trust Assessment by Humans and LLM-as-a-Judge7 Apr 2026
36 more
- 2026Visual or Textual: Effects of Explanation Format and Personal Characteristics on the Perception of Explanations in an Educational Recommender System26 Mar 2026
- 2026Beyond Abstract Compliance: Operationalising trust in AI as a moral relationship30 Jan 2026
- 2026A Checklist for Trustworthy, Safe, and User-Friendly Mental Health Chatbots21 Jan 2026
- 2025Understanding AI Trustworthiness: A Scoping Review of AIES & FAccT Articles24 Oct 2025
- 2025Cracking CodeWhisperer: Analyzing Developers' Interactions and Patterns During Programming Tasks13 Oct 2025
- 2025Towards Meaningful Transparency in Civic AI Systems9 Oct 2025
- 2025NeuroBridge: Using Generative AI to Bridge Cross-neurotype Communication Differences through Neurotypical Perspective-taking27 Sep 2025
- 2025The Variance Paradox: How AI Reduces Diversity but Increases Novelty20 Aug 2025
- 2025"Even explanations will not help in trusting [this] fundamentally biased system": A Predictive Policing Case-Study15 Apr 2025
- 2025Mapping the Trust Terrain: LLMs in Software Engineering -- Insights and Perspectives18 Mar 2025
- 2025Mapping Trustworthiness in Large Language Models: A Bibliometric Analysis Bridging Theory to Practice27 Feb 2025
- 2025Fostering Appropriate Reliance on Large Language Models: The Role of Explanations, Sources, and Inconsistencies12 Feb 2025
- 2025A Framework for Responsible AI Systems: Building Societal Trust through Domain Definition, Trustworthy AI Design, Auditability, Accountability, and Governance4 Feb 2025
- 2025Plan-Then-Execute: An Empirical Study of User Trust and Team Performance When Using LLM Agents As A Daily Assistant3 Feb 2025
- 2024Thoughtful Adoption of NLP for Civic Participation: Understanding Differences Among Policymakers30 Oct 2024
- 2024Contextualized AI for Cyber Defense: An Automated Survey using LLMs20 Sep 2024
- 2024Predicting Trust In Autonomous Vehicles: Modeling Young Adult Psychosocial Traits, Risk-Benefit Attitudes, And Driving Factors With Machine Learning13 Sep 2024
- 2024Towards More Trustworthy and Interpretable LLMs for Code through Syntax-Grounded Explanations12 Jul 2024
- 2024The AI-DEC: A Card-based Design Method for User-centered AI Explanations26 May 2024
- 2024An Empirical Exploration of Trust Dynamics in LLM Supply Chains25 May 2024
- 2024Towards interactive evaluations for interaction harms in human-AI systems17 May 2024
- 2024Who Validates the Validators? Aligning LLM-Assisted Evaluation of LLM Outputs with Human Preferences18 Apr 2024
- 2024Characterizing and modeling harms from interactions with design patterns in AI interfaces17 Apr 2024
- 2024(Un)making AI Magic: a Design Taxonomy22 Mar 2024
- 2024Calibrating Large Language Models Using Their Generations Only9 Mar 2024
- 2024Social Intelligence Data Infrastructure: Structuring the Present and Navigating the Future28 Feb 2024
- 2024Homogenization Effects of Large Language Models on Human Creative Ideation2 Feb 2024
- 2023A Systematic Review on Fostering Appropriate Trust in Human-AI Interaction8 Nov 2023
- 2023Better to Ask in English: Cross-Lingual Evaluation of Large Language Models for Healthcare Queries19 Oct 2023
- 2023ChainForge: A Visual Toolkit for Prompt Engineering and LLM Hypothesis Testing17 Sep 2023
- 2023AI Transparency in the Age of LLMs: A Human-Centered Research Roadmap2 Jun 2023
- 2023Certification Labels for Trustworthy AI: Insights From an Empirical Mixed-Method Study15 May 2023
- 2023Humans, AI, and Context: Understanding End-Users' Trust in a Real-World Computer Vision Application15 May 2023
- 2023A Systematic Literature Review of Human-Centered, Ethical, and Responsible AI10 Feb 2023
- 2023Selective Explanations: Leveraging Human Input to Align Explainable AI23 Jan 2023
- 2023Understanding the Role of Human Intuition on Reliance in Human-AI Decision-Making with Explanations18 Jan 2023
- 2025Plan-Then-Execute: An Empirical Study of User Trust and Team Performance When Using LLM Agents As A Daily Assistantcited by 54
- 2026Less Interaction But More Explanation: A Communication Perspective on Agentic AI Interfacescited by 0
- 2026A Compound AI Agent for Conversational Grant Discoverycited by 0
- 2026A Compound AI Agent for Conversational Grant Discovery4 May 2026
- 2026Less Interaction But More Explanation: A Communication Perspective on Agentic AI Interfaces2 May 2026
- 2025Plan-Then-Execute: An Empirical Study of User Trust and Team Performance When Using LLM Agents As A Daily Assistant3 Feb 2025
- 2024Homogenization Effects of Large Language Models on Human Creative Ideationcited by 127
- 2023AI Transparency in the Age of LLMs: A Human-Centered Research Roadmapcited by 119
- 2023ChainForge: A Visual Toolkit for Prompt Engineering and LLM Hypothesis Testingcited by 88
- 2023Better to Ask in English: Cross-Lingual Evaluation of Large Language Models for Healthcare Queriescited by 82
- 2023Understanding the Role of Human Intuition on Reliance in Human-AI Decision-Making with Explanationscited by 73
- 2024Calibrating Large Language Models Using Their Generations Onlycited by 63
- 2025Fostering Appropriate Reliance on Large Language Models: The Role of Explanations, Sources, and Inconsistenciescited by 39
- 2023Selective Explanations: Leveraging Human Input to Align Explainable AIcited by 29
- 2024Towards interactive evaluations for interaction harms in human-AI systemscited by 27
- 2023A Systematic Review on Fostering Appropriate Trust in Human-AI Interactioncited by 21
- 2023Humans, AI, and Context: Understanding End-Users' Trust in a Real-World Computer Vision Applicationcited by 14
- 2024Characterizing and modeling harms from interactions with design patterns in AI interfacescited by 11
12 most cited of 44 All 44 (JSON)
- 2026Assessing the Applicability of Existing Design Recommendations to AI Companion Design: A Multi-Method Study13 Sep 2026
- 2026When Trust Meets Truth: Trust-Truth Separability in LLM-as-Judge21 Aug 2026
- 2026Visualizing Uncertainty-to-Action Composition for Human Oversight17 Aug 2026
- 2026Epistemic Trustworthiness in Generative AI: A Normative Framework for Warranted Reliance in High-Stakes Workflows6 Aug 2026
- 2026Design Theater: Evaluating the Gap Between User-Facing Design Reasoning and Implementation in Generative UI Tools24 Jul 2026
- 2026A Methodology for Auditable Trustworthiness Levels in AI Lifecycle Governance17 Jul 2026
- 2026AI Adoption Across a Multinational Workforce: Sociotechnical Conditions for GenAI Acceptance in Human Resources16 Jun 2026
- 2026Investigating the Effects of Different Levels of User Control in an Interactive Educational Recommender System2 May 2026
- 2026Trust Stack for Mental Health AI: A Survey of Calibration across Human, Interaction, and AI Layers22 Apr 2026
- 2026Label Effects: Shared Heuristic Reliance in Trust Assessment by Humans and LLM-as-a-Judge7 Apr 2026
- 2026Visual or Textual: Effects of Explanation Format and Personal Characteristics on the Perception of Explanations in an Educational Recommender System26 Mar 2026
- 2026Beyond Abstract Compliance: Operationalising trust in AI as a moral relationship30 Jan 2026
12 newest of 44 All 44 (JSON)