Fiduciary Responsibility: Facilitating Public Trust in Automated Decision Making
Not on the map. Why?
Abstract (arXiv)
Automated decision-making systems are being increasingly deployed and affect the public in a multitude of positive and negative ways. Governmental and private institutions use these systems to process information according to certain human-devised rules in order to address social problems or organizational challenges. Both research and real-world experience indicate that the public lacks trust in automated decision-making systems and the institutions that deploy them. The recreancy theorem argues that the public is more likely to trust and support decisions made or influenced by automated decision-making systems if the institutions that administer them meet their fiduciary responsibility. However, often the public is never informed of how these systems operate and resultant institutional decisions are made. A ``black box'' effect of automated decision-making systems reduces the public's perceptions of integrity and trustworthiness. The result is that the public loses the capacity to identify, challenge, and rectify unfairness or the costs associated with the loss of public goods or benefits. The current position paper defines and explains the role of fiduciary responsibility within an automated decision-making system. We formulate an automated decision-making system as a data science lifecycle (DSL) and examine the implications of fiduciary responsibility within the context of the DSL. Fiduciary responsibility within DSLs provides a methodology for addressing the public's lack of trust in automated decision-making systems and the institutions that employ them to make decisions affecting the public. We posit that fiduciary responsibility manifests in several contexts of a DSL, each of which requires its own mitigation of sources of mistrust. To instantiate fiduciary responsibility, a Los Angeles Police Department (LAPD) predictive policing case study is examined.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 107 references that are in the map. First posted on arXiv 6 Jan 2023.
Builds on
16 of 107 references.
References · 16
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2017Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPRcited by 1,086
- 2020Formalizing Trust in Artificial Intelligence: Prerequisites, Causes and Goals of Human Trust in AIcited by 166
- 2018Explaining Explanations in AIcited by 136
- 2019Artificial Intelligence: the global landscape of ethics guidelinescited by 107
- 2017Runaway Feedback Loops in Predictive Policingcited by 97
- 2019The relationship between trust in AI and trustworthy machine learning technologiescited by 78
- 2016Evaluation of a Tree-based Pipeline Optimization Tool for Automating Data Sciencecited by 73
- 2019Assuring the Machine Learning Lifecycle: Desiderata, Methods, and Challengescited by 39
- 2018From Fair Decision Making to Social Equalitycited by 36
- 2018FactSheets: Increasing Trust in AI Services through Supplier's Declarations of Conformitycited by 31
- 2021The Sanction of Authority: Promoting Public Trust in AIcited by 19
4 more
- 2021The Art and Practice of Data Science Pipelines: A Comprehensive Study of Data Science Pipelines In Theory, In-The-Small, and In-The-Largecited by 17
- 2020A Methodology for Creating AI FactSheetscited by 15
- 2018A Broader View on Bias in Automated Decision-Making: Reflecting on Epistemology and Dynamicscited by 10
- 2022"Explanation" is Not a Technical Term: The Problem of Ambiguity in XAIcited by 4
Built on by
Not cited yet.