# On the Complexities of Testing for Compliance with Human Oversight Requirements in AI Regulation

arXiv: https://arxiv.org/abs/2504.03300 · HTML: https://mlsanity.com/paper/2504.03300/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 4 Apr 2025.

## Built on by (most cited first, 2 of 2)

- [Keeping an Eye on AI: A Framework for Effective Human Oversight of AI Systems](https://mlsanity.com/paper/2605.16278/) (2026)
- [An Empirical Study and Assessment of EU AI Act Compliance Checkers](https://mlsanity.com/paper/2609.36228/) (2026)

## Abstract (arXiv)

Human oversight requirements are a core component of the European AI Act and in AI governance. In this paper, we highlight key challenges in testing for compliance with these requirements. A central difficulty lies in balancing simple, but potentially ineffective checklist-based approaches with resource-intensive and context-sensitive empirical testing of the effectiveness of human oversight of AI. Questions regarding when to update compliance testing, the context-dependent nature of human oversight requirements, and difficult-to-operationalize standards further complicate compliance testing. We argue that these challenges illustrate broader challenges in the future of sociotechnical AI governance, i.e. a future that shifts from ensuring good technological products to good sociotechnical systems.