mlsanityData to 14 Oct 2026

AI and Human Oversight: A Risk-Based Framework for Alignment

arXiv 2510.09090 ↗First posted 10 Oct 2025cs.CY cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

As Artificial Intelligence (AI) technologies continue to advance, protecting human autonomy and promoting ethical decision-making are essential to fostering trust and accountability. Human agency (the capacity of individuals to make informed decisions) should be actively preserved and reinforced by AI systems. This paper examines strategies for designing AI systems that uphold fundamental rights, strengthen human agency, and embed effective human oversight mechanisms. It discusses key oversight models, including Human-in-Command (HIC), Human-in-the-Loop (HITL), and Human-on-the-Loop (HOTL), and proposes a risk-based framework to guide the implementation of these mechanisms. By linking the level of AI model risk to the appropriate form of human oversight, the paper underscores the critical role of human involvement in the responsible deployment of AI, balancing technological innovation with the protection of individual values and rights. In doing so, it aims to ensure that AI technologies are used responsibly, safeguarding individual autonomy while maximizing societal benefits.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 14 of its 86 references that are in the map. First posted on arXiv 10 Oct 2025.

Builds on

14 of 86 references.

References · 14

  1. 2021Can Machines Learn Morality? The Delphi Experimentcited by 141
  2. 2022Explanations Can Reduce Overreliance on AI Systems During Decision-Makingcited by 111
  3. 2021The Flaws of Policies Requiring Human Oversight of Government Algorithmscited by 44
  4. 2022Worldwide AI Ethics: a review of 200 guidelines and recommendations for AI governancecited by 28
  5. 2024On the Quest for Effectiveness in Human Oversight: Interdisciplinary Perspectivescited by 28
  6. 2023Positioning Political Texts with Large Language Models by Asking and Averagingcited by 13
  7. 2025HumanAgencyBench: Scalable Evaluation of Human Agency Support in AI Assistantscited by 11
  8. 2025Formalising Human-in-the-Loop: Computational Reductions, Failure Modes, and Legal-Moral Responsibilitycited by 8
  9. 2024The Fundamental Rights Impact Assessment (FRIA) in the AI Act: Roots, legal obligations and key elements for a model templatecited by 7
  10. 2023How to design an AI ethics boardcited by 6
  11. 2024AI Act and Large Language Models (LLMs): When critical issues and privacy impact require human and ethical oversightcited by 6
  12. 2024Human-In-The-Loop Machine Learning for Safe and Ethical Autonomous Vehicles: Principles, Challenges, and Opportunitiescited by 6
2 more
  1. 2024Bank Loan Prediction Using Machine Learning Techniquescited by 2
  2. 2024Towards An Automated AI Act FRIA Tool That Can Reuse GDPR's DPIAcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 2.

4 papers.

  1. 2025Levers of Power in the Field of AIcited by 0
  2. 2025The SMART+ Framework for AI Systemscited by 0
  3. 2026Simulating Meaning, Nevermore! Introducing ICR: A Semiotic-Hermeneutic Metric for Evaluating Meaning in LLM Text Summariescited by 0
  4. 2026Exploring Human-in-the-Loop Themes in AI Application Development: An Empirical Thematic Analysiscited by 0