mlsanityData to 7 Oct 2026

Safe Bilevel Delegation (SBD): A Formal Framework for Runtime Delegation Safety in Multi-Agent Systems

arXiv 2604.27358 ↗First posted 30 Apr 2026cs.AIcited by 0

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

As large language model (LLM) agents are deployed in high-stakes environments, the question of how safely to delegate subtasks to specialized sub-agents becomes critical. Existing work addresses multi-agent architecture selection at design time or provides broad empirical guidelines, but neither provides a runtime mechanism that dynamically adjusts the safety-efficiency trade-off as task context changes during execution. We propose Safe Bilevel Delegation (SBD), a formal framework for runtime delegation safety in hierarchical multi-agent systems. SBD formulates task delegation as a bilevel optimization problem: an outer meta-weight network phi learns context-dependent safety-efficiency weights lambda(s) in [0,1]; an inner loop optimizes the delegation policy pi subject to a probabilistic safety constraint P(safe) >= 1-delta. The continuous delegation degree alpha in [0, 1] controls how much decision authority is transferred to each sub-agent, interpolating smoothly between full human override (alpha=0) and fully autonomous execution (alpha=1). We establish three theoretical results: (1) Safety Monotonicity--higher outer safety weight produces a weakly safer inner policy; (2) Inner Policy Convergence--projected gradient descent on the inner problem converges linearly under standard smoothness assumptions; (3) an Accountability Propagation bound that distributes responsibility across multi-hop delegation chains with a provable per-agent ceiling. We instantiate SBD in three high-stakes domains--medical AI (MIMIC-III), financial risk control (S and P 500), and educational agent supervision (ASSISTments)--specifying datasets, safety constraint sets, baselines, and evaluation protocols. This manuscript presents the formal framework and theoretical results in full; empirical validation following the protocols described herein is planned and will be reported in a forthcoming revision.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 26 of its 32 references that are in the map. First posted on arXiv 30 Apr 2026.

Builds on

26 of 32 references.

Closest ancestors · 4

Same direction, newest first

  1. 2026The Provenance Paradox in Multi-Agent LLM Routing: Delegation Contracts and Attested Identity in LDP15 Mar
  2. 2026LDP: An Identity-Aware Protocol for Multi-Agent LLM Systems9 Mar
  3. 2026Agent Skills in the Wild: An Empirical Study of Security Vulnerabilities at Scale15 Jan
  4. 2025Agent Skills Enable a New Class of Realistic and Trivially Simple Prompt Injections30 Oct

Other references · 22

  1. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
  2. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
  3. 2018DARTS: Differentiable Architecture Searchcited by 1,782
  4. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
  5. 2017Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environmentscited by 1,519
  6. 2017Constrained Policy Optimizationcited by 928
  7. 2024The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructionscited by 441
  8. 2018Bilevel Programming for Hyperparameter Optimization and Meta-Learningcited by 403
  9. 2019Optimizing Millions of Hyperparameters by Implicit Differentiationcited by 303
  10. 2018A Lyapunov-based Approach to Safe Reinforcement Learningcited by 278
  11. 2025ReasoningBank: Scaling Agent Self-Evolving with Reasoning Memorycited by 253
  12. 2025Multi-agent Architecture Search via Agentic Supernetcited by 164
10 more
  1. 2025Where LLM Agents Fail and How They can Learn From Failurescited by 118
  2. 2019Generalized Inner Loop Meta-Learningcited by 92
  3. 2026Meta Context Engineering via Agentic Skill Evolutioncited by 42
  4. 2025Reinforcement Learning with Verifiable yet Noisy Rewards under Imperfect Verifierscited by 40
  5. 2026When Single-Agent with Skills Replace Multi-Agent Systems and When They Failcited by 34
  6. 2026Noisy but Valid: Robust Statistical Evaluation of LLMs with Imperfect Judgescited by 23
  7. 2026Adaptive Collaboration with Humans: Metacognitive Policy Optimization for Multi-Agent LLMs with Continual Learningcited by 9
  8. 2026AgentCollab: A Self-Evaluation-Driven Collaboration Paradigm for Efficient LLM Agentscited by 4
  9. 2026Bilevel Optimization of Agent Skills via Monte Carlo Tree Searchcited by 2
  10. 2026HiveMind: OS-Inspired Scheduling for Concurrent LLM Agent Workloadscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Delegated Misalignment: How Multi-Agent Structures Amplify LLM Safety Risks
  2. 2026SafeAgent: A Runtime Protection Architecture for Agentic Systems
  3. 2026DecisionBench: A Benchmark for Emergent Delegation in Long-Horizon Agentic Workflows
  4. 2026S3: Improving Agent Safety through Multi-Stage Defense
  5. 2026Operational Reframing and Approval-Framed Delegation in Multi-Agent LLM Safety
  6. 2026Delegation Without Trust: An Empirical Gap Analysis of Identity, Authorization, and Runtime Governance in Multi-Agent LLM Systems
  7. 2026Task-Aware Delegation Cues for LLM Agents
  8. 2026Intelligent AI Delegation