"Dave...I can assure you...that it's going to be all right..." -- A definition, case for, and survey of algorithmic assurances in human-autonomy trust relationships
Not on the map. Why?
Abstract (arXiv)
People who design, use, and are affected by autonomous artificially intelligent agents want to be able to trust such agents -- that is, to know that these agents will perform correctly, to understand the reasoning behind their actions, and to know how to use them appropriately. Many techniques have been devised to assess and influence human trust in artificially intelligent agents. However, these approaches are typically ad hoc, and have not been formally related to each other or to formal trust models. This paper presents a survey of algorithmic assurances, i.e. programmed components of agent operation that are expressly designed to calibrate user trust in artificially intelligent agents. Algorithmic assurances are first formally defined and classified from the perspective of formally modeled human-artificially intelligent agent trust relationships. Building on these definitions, a synthesis of research across communities such as machine learning, human-computer interaction, robotics, e-commerce, and others reveals that assurance algorithms naturally fall along a spectrum in terms of their impact on an agent's core functionality, with seven notable classes ranging from integral assurances (which impact an agent's core functionality) to supplemental assurances (which have no direct effect on agent performance). Common approaches within each of these classes are identified and discussed; benefits and drawbacks of different approaches are also investigated.
Key facts. Cited by 22 papers in the map (data through 14 Oct 2026). First posted on arXiv 8 Nov 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 7; 2023: 4; 2024: 2; 2025: 0; 2026: 2.
22 papers.
Sort:
By area:
- 2021Explainable Artificial Intelligence for Autonomous Driving: A Comprehensive Overview and Field Guide for Future Research Directionscited by 73
- 2024Explainable Artificial Intelligence: A Survey of Needs, Techniques, Applications, and Future Directioncited by 46
- 2021A Survey on AI Assurancecited by 16
- 2021Interpretable Model-based Hierarchical Reinforcement Learning using Inductive Logic Programmingcited by 8
- 2022Competency Assessment for Autonomous Agents using Deep Generative Modelscited by 6
- 2023Learning to Forecast Aleatoric and Epistemic Uncertainties over Long Horizon Trajectoriescited by 6
- 2022Uncertainty Quantification for Competency Assessment of Autonomous Agentscited by 2
- 2023DCNFIS: Deep Convolutional Neuro-Fuzzy Inference Systemcited by 2
- 2022A Factor-Based Framework for Decision-Making Competency Self-Assessmentcited by 1
- 2023Explanation through Reward Model Reconciliation using POMDP Tree Searchcited by 1
- 2024Qualitative Approaches to Voice UXcited by 1
- 2021Comprehensive systematic review into combinations of artificial intelligence, human factors, and automationcited by 0
10 more
- 2021SINGA-Easy: An Easy-to-Use Framework for MultiModal Analysiscited by 0
- 2021VisualTextRank: Unsupervised Graph-based Content Extraction for Automating Ad Text to Image Searchcited by 0
- 2021Text is NOT Enough: Integrating Visual Impressions into Open-domain Dialogue Generationcited by 0
- 2022Discovering Personalized Semantics for Soft Attributes in Recommender Systems using Concept Activation Vectorscited by 0
- 2022Reinforced MOOCs Concept Recommendation in Heterogeneous Information Networkscited by 0
- 2022Explanation-Guided Fairness Testing through Genetic Algorithmcited by 0
- 2022Using Graph Neural Networks for Program Terminationcited by 0
- 2023Tribe or Not? Critical Inspection of Group Differences Using TribalGramcited by 0
- 2026A Survey on Quantitative Modeling of Trust in Online Social Networkscited by 0
- 2026Robotics-Inspired Guardrails for Foundation Models in Socially Sensitive Domainscited by 0
- 2026Robotics-Inspired Guardrails for Foundation Models in Socially Sensitive Domains19 May 2026
- 2026A Survey on Quantitative Modeling of Trust in Online Social Networks26 Feb 2026
- 2024Explainable Artificial Intelligence: A Survey of Needs, Techniques, Applications, and Future Direction30 Aug 2024
- 2024Qualitative Approaches to Voice UX23 Apr 2024
- 2023DCNFIS: Deep Convolutional Neuro-Fuzzy Inference System11 Aug 2023
- 2023Explanation through Reward Model Reconciliation using POMDP Tree Search1 May 2023
- 2023Tribe or Not? Critical Inspection of Group Differences Using TribalGram16 Mar 2023
- 2023Learning to Forecast Aleatoric and Epistemic Uncertainties over Long Horizon Trajectories17 Feb 2023
- 2022Using Graph Neural Networks for Program Termination28 Jul 2022
- 2022Uncertainty Quantification for Competency Assessment of Autonomous Agents21 Jun 2022
- 2022Explanation-Guided Fairness Testing through Genetic Algorithm16 May 2022
- 2022Competency Assessment for Autonomous Agents using Deep Generative Models23 Mar 2022
10 more
- 2022A Factor-Based Framework for Decision-Making Competency Self-Assessment22 Mar 2022
- 2022Reinforced MOOCs Concept Recommendation in Heterogeneous Information Networks8 Mar 2022
- 2022Discovering Personalized Semantics for Soft Attributes in Recommender Systems using Concept Activation Vectors6 Feb 2022
- 2021Explainable Artificial Intelligence for Autonomous Driving: A Comprehensive Overview and Field Guide for Future Research Directions21 Dec 2021
- 2021A Survey on AI Assurance15 Nov 2021
- 2021Text is NOT Enough: Integrating Visual Impressions into Open-domain Dialogue Generation13 Sep 2021
- 2021VisualTextRank: Unsupervised Graph-based Content Extraction for Automating Ad Text to Image Search5 Aug 2021
- 2021SINGA-Easy: An Easy-to-Use Framework for MultiModal Analysis3 Aug 2021
- 2021Interpretable Model-based Hierarchical Reinforcement Learning using Inductive Logic Programming21 Jun 2021
- 2021Comprehensive systematic review into combinations of artificial intelligence, human factors, and automation9 Apr 2021
- 2024Explainable Artificial Intelligence: A Survey of Needs, Techniques, Applications, and Future Directioncited by 46
- 2021A Survey on AI Assurancecited by 16
- 2021Interpretable Model-based Hierarchical Reinforcement Learning using Inductive Logic Programmingcited by 8
- 2022Uncertainty Quantification for Competency Assessment of Autonomous Agentscited by 2
- 2023DCNFIS: Deep Convolutional Neuro-Fuzzy Inference Systemcited by 2
- 2022A Factor-Based Framework for Decision-Making Competency Self-Assessmentcited by 1
- 2024Qualitative Approaches to Voice UXcited by 1
- 2021Comprehensive systematic review into combinations of artificial intelligence, human factors, and automationcited by 0
- 2021SINGA-Easy: An Easy-to-Use Framework for MultiModal Analysiscited by 0
- 2021VisualTextRank: Unsupervised Graph-based Content Extraction for Automating Ad Text to Image Searchcited by 0
- 2021Text is NOT Enough: Integrating Visual Impressions into Open-domain Dialogue Generationcited by 0
- 2022Discovering Personalized Semantics for Soft Attributes in Recommender Systems using Concept Activation Vectorscited by 0
12 most cited of 17 All 17 (JSON)
- 2026A Survey on Quantitative Modeling of Trust in Online Social Networks26 Feb 2026
- 2024Explainable Artificial Intelligence: A Survey of Needs, Techniques, Applications, and Future Direction30 Aug 2024
- 2024Qualitative Approaches to Voice UX23 Apr 2024
- 2023DCNFIS: Deep Convolutional Neuro-Fuzzy Inference System11 Aug 2023
- 2023Tribe or Not? Critical Inspection of Group Differences Using TribalGram16 Mar 2023
- 2022Using Graph Neural Networks for Program Termination28 Jul 2022
- 2022Uncertainty Quantification for Competency Assessment of Autonomous Agents21 Jun 2022
- 2022Explanation-Guided Fairness Testing through Genetic Algorithm16 May 2022
- 2022A Factor-Based Framework for Decision-Making Competency Self-Assessment22 Mar 2022
- 2022Reinforced MOOCs Concept Recommendation in Heterogeneous Information Networks8 Mar 2022
- 2022Discovering Personalized Semantics for Soft Attributes in Recommender Systems using Concept Activation Vectors6 Feb 2022
- 2021A Survey on AI Assurance15 Nov 2021
12 newest of 17 All 17 (JSON)