mlsanityData to 7 Oct 2026

Selection as Power: Constrained Reinforcement for Bounded Decision Authority

arXiv 2603.02019 ↗First posted 2 Mar 2026cs.MA cs.AI cs.CEcited by 0

On the map: LLM agents and tool use → Reinforcement learning for LLM agents

Abstract (arXiv)

Selection as Power argued that upstream selection authority, rather than internal objective misalignment, constitutes a primary source of risk in high-stakes agentic systems. However, the original framework was static: governance constraints bounded selection power but did not adapt over time. In this work, we extend the framework to dynamic settings by introducing incentivized selection governance, where reinforcement updates are applied to scoring and reducer parameters under externally enforced sovereignty constraints. We formalize selection as a constrained reinforcement process in which parameter updates are projected onto governance-defined feasible sets, preventing concentration beyond prescribed bounds. Across multiple regulated financial scenarios, unconstrained reinforcement consistently collapses into deterministic dominance under repeated feedback, especially at higher learning rates. In contrast, incentivized governance enables adaptive improvement while maintaining bounded selection concentration. Projection-based constraints transform reinforcement from irreversible lock-in into controlled adaptation, with governance debt quantifying the tension between optimization pressure and authority bounds. These results demonstrate that learning dynamics can coexist with structural diversity when sovereignty constraints are enforced at every update step, offering a principled approach to integrating reinforcement into high-stakes agentic systems without surrendering bounded selection authority.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Reinforcement learning for LLM agents, one of 16 directions in LLM agents and tool use. Builds on 9 of its 23 references that are in the map. First posted on arXiv 2 Mar 2026.

Builds on

9 of 23 references.

References · 9

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2017Deep reinforcement learning from human preferencescited by 3,846
  3. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
  4. 2021Convex optimizationcited by 2,479
  5. 2017Counterfactual Multi-Agent Policy Gradientscited by 733
  6. 2019Multi-Agent Reinforcement Learning: A Selective Overview of Theories and Algorithmscited by 555
  7. 2017Safe Reinforcement Learning via Shieldingcited by 427
  8. 2018Incomplete Contracting and AI Alignmentcited by 60
  9. 2026Towards Selection as Power: Bounding Decision Authority in Autonomous Agentscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Emergent Risk Awareness in Rational Agents under Resource Constraints
  2. 2026What Capable Agents Must Know: Selection Theorems for Robust Decision-Making under Uncertainty
  3. 2026ARISE: Adapting to Evolving Capability Gaps in Agentic Reinforcement Learning
  4. 2019Bayesian policy selection using active inference
  5. 2026Agentic Pressure: The Endogenous Entropy of Reliable Autonomy
  6. 2026Evolving in the Agent Jungle via History-Informed Opponent Awareness
  7. 2026Increasing intelligence in AI agents can worsen collective outcomes
  8. 2026APEX: Autonomous Policy Exploration for Self-Evolving LLM Agents