mlsanityData to 7 Oct 2026

When Should a Human Take Back Control? Optimal Delegation under Turbulent AI Risk

arXiv 2609.32083 ↗First posted 25 Sep 2026cs.LG cs.AI math.OCcited by 0

Not on the map. Why?

Abstract (arXiv)

Deploying AI systems requires deciding when to delegate tasks and when humans should intervene to monitor and mitigate risk induced by AI operations. These decisions are challenging when failures cluster: a hallucination or harmful output can trigger further errors, creating periods of elevated risk. We introduce a continuous-time framework for learning adaptive human oversight under such turbulent AI risk. Existing oversight and delegation formulations condition on history but do not model incident clustering, or its suppression by supervision effort, jointly with the delegation decision and this study fixes this gap. The self-exciting dynamics capture how risk events increase the likelihood of subsequent events, making their timing and history central to decision-making. We formulate a stochastic control problem combining human actions, monitoring effort, and switching between human-AI-assisted operation and full AI delegation, balancing operational rewards against oversight costs, and cascading AI-failures and induced uncertainty. Human participation is an endogenous component of risk management: the policy determines both when oversight is needed and how much effort to allocate. We study a relaxed switching formulation and propose Hawkes-PPO, a policy-gradient method that uses a bank of exponential filters of observed incident times. In a synthetic environment it attains a higher risk-adjusted objective than either fixed regime and approaches an approximate full-information oracle. We illustrate our results with numerical simulations by examining how cascade risks influence intervention and delegation, connecting reinforcement learning with adaptive human oversight of AI systems. In particular, we illustrate the benefit of our switching strategy and Hawkes-PPO algorithm to monitor the project efficiently along time, reducing turbulent risks occurrences and costs.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 31 of its 52 references that are in the map. First posted on arXiv 25 Sep 2026.

Builds on

31 of 52 references.

References · 31

  1. 2017Proximal Policy Optimization Algorithmscited by 14,441
  2. 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,635
  3. 2015Continuous control with deep reinforcement learningcited by 3,279
  4. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
  5. 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
  6. 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 965
  7. 2017DGM: A deep learning algorithm for solving partial differential equationscited by 674
  8. 2025Why Do Multi-Agent LLM Systems Fail?cited by 559
  9. 2023Ragas: Automated Evaluation of Retrieval Augmented Generationcited by 408
  10. 2024AgentHarm: A Benchmark for Measuring Harmfulness of LLM Agentscited by 406
  11. 2023How Language Model Hallucinations Can Snowballcited by 310
  12. 2020Consistent Estimators for Learning to Defer to an Expertcited by 262
19 more
  1. 2017Predict Responsibly: Improving Fairness and Accuracy by Learning to Defercited by 228
  2. 2023AI Control: Improving Safety Despite Intentional Subversioncited by 207
  3. 2023Is Self-Repair a Silver Bullet for Code Generation?cited by 191
  4. 2025OpenAgentSafety: A Comprehensive Framework for Evaluating Real-World AI Agent Safetycited by 71
  5. 2025The Illusion of Diminishing Returns: Measuring Long Horizon Execution in LLMscited by 62
  6. 2025Ctrl-Z: Controlling AI Agents via Resamplingcited by 40
  7. 2025Scaling Laws For Scalable Oversightcited by 18
  8. 2026AgentHallu: Benchmarking Automated Hallucination Attribution of LLM-based Agentscited by 15
  9. 2026Hallucination Cascade: Analyzing Error Propagation in Multi-Agent LLM Systemscited by 12
  10. 2024Control randomisation approach for policy gradient and application to reinforcement learning in optimal switchingcited by 7
  11. 2025Deterministic Policy Gradient for Reinforcement Learning with Continuous Time and Statecited by 7
  12. 2024Learning to Defer in Congested Systems: The AI-Human Interplaycited by 5
  13. 2024Optimizing Delegation in Collaborative Human-AI Hybrid Teamscited by 3
  14. 2025Markov approximation for controlled Hawkes Jump-Diffusions with general kernelscited by 2
  15. 2023Randomisation with moral hazard: a path to existence of optimal contractscited by 1
  16. 2024Optimal Impulse Control for Cyber Risk Managementcited by 1
  17. 2025Agency Problems and Adversarial Bilevel Optimization under Uncertainty and Cyber Threatscited by 1
  18. 2026Open Problems in Frontier AI Risk Managementcited by 1
  19. 2026Continuous-Time Reinforcement Learning for Controlled Hawkes Jump-Diffusionscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025The Oversight Game: Learning to Cooperatively Balance an AI Agent's Safety and Autonomy
  2. 2026Anticipatory Human Oversight of Agentic AI: A Philosophical Account
  3. 2026Oversight Has a Capacity: Calibrating Agent Guards to a Subjective, Fatiguing Human
  4. 2026Calibrating Conservatism for Scalable Oversight
  5. 2026Intelligent AI Delegation
  6. 2026A Contextual-Bandit Oversight Game with Two-Sided Informational Asymmetry
  7. 2026Calibration Is Not Control: Why LLM-Agent Oversight Needs Intervention
  8. 2025From Refusal to Recovery: A Control-Theoretic Approach to Generative AI Guardrails