Taking Training Seriously: Human Guidance and Management-Based Regulation of Artificial Intelligence
Not on the map. Why?
Abstract (arXiv)
Fervent calls for more robust governance of the harms associated with artificial intelligence (AI) are leading to the adoption around the world of what regulatory scholars have called a management-based approach to regulation. Recent initiatives in the United States and Europe, as well as the adoption of major self-regulatory standards by the International Organization for Standardization, share in common a core management-based paradigm. These management-based initiatives seek to motivate an increase in human oversight of how AI tools are trained and developed. Refinements and systematization of human-guided training techniques will thus be needed to fit within this emerging era of management-based regulatory paradigm. If taken seriously, human-guided training can alleviate some of the technical and ethical pressures on AI, boosting AI performance with human intuition as well as better addressing the needs for fairness and effective explainability. In this paper, we discuss the connection between the emerging management-based regulatory frameworks governing AI and the need for human oversight during training. We broadly cover some of the technical components involved in human-guided training and then argue that the kinds of high-stakes use cases for AI that appear of most concern to regulators should lean more on human-guided training than on data-only training. We hope to foster a discussion between legal scholars and computer scientists involving how to govern a domain of technology that is vast, heterogenous, and dynamic in its applications and risks.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 26 of its 55 references that are in the map. First posted on arXiv 13 Feb 2024.
Builds on
26 of 55 references.
References · 26
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2015Learning Deep Features for Discriminative Localizationcited by 2,430
- 2018Sanity Checks for Saliency Mapscited by 1,149
- 2018RISE: Randomized Input Sampling for Explanation of Black-box Modelscited by 825
- 2016The Mythos of Model Interpretabilitycited by 716
- 2019A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAIcited by 403
- 2020Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performancecited by 396
- 2017The (Un)reliability of saliency methodscited by 331
- 2021CUAD: An Expert-Annotated NLP Dataset for Legal Contract Reviewcited by 232
- 2018To Trust Or Not To Trust A Classifiercited by 205
14 more
- 2016Multifaceted Feature Visualization: Uncovering the Different Types of Features Learned By Each Neuron in Deep Neural Networkscited by 106
- 2019The relationship between trust in AI and trustworthy machine learning technologiescited by 78
- 2021Improving Deep Learning Interpretability by Saliency Guided Trainingcited by 68
- 2022Harmonizing the object recognition strategies of deep neural networks with humanscited by 59
- 2021CYBORG: Blending Human Saliency Into the Loss Improves Deep Learningcited by 33
- 2021Human-Aided Saliency Maps Improve Generalization of Deep Learningcited by 27
- 2018Domain-Specific Human-Inspired Binarized Statistical Image Features for Iris Recognitioncited by 24
- 2022Shortcomings of Top-Down Randomization-Based Sanity Checks for Evaluations of Deep Neural Network Explanationscited by 22
- 2020How Much Can We Really Trust You? Towards Simple, Interpretable Trust Quantification Metrics for Deep Neural Networkscited by 19
- 2022Human Saliency-Driven Patch-based Matching for Interpretable Post-mortem Iris Recognitioncited by 11
- 2023Explain To Me: Salience-Based Explainability for Synthetic Face Detection Modelscited by 8
- 2023Teaching AI to Teach: Leveraging Limited Human Salience Data Into Unlimited Saliency-Based Trainingcited by 8
- 2020Where Does Trust Break Down? A Quantitative Trust Analysis of Deep Neural Networks via Trust Matrix and Conditional Trust Densitiescited by 7
- 2022Measuring Human Perception to Improve Open Set Recognitioncited by 7
Built on by
Citing papers per year: 2024: 1; 2025: 2.
3 papers.