mlsanityData to 7 Oct 2026

The Informational Cost of Agency: A Bounded Measure of Interaction Efficiency for Deployed Reinforcement Learning

arXiv 2603.01283 ↗First posted 1 Mar 2026cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Deployed reinforcement learning systems lack a principled runtime reliability theory. We close this gap by introducing Bipredictability, P, a closed form information theoretic metric that quantifies how efficiently a closed loop interaction between agent and environment converts uncertainty into shared predictability. P admits a provable classical bound P equal, smaller than 0.5, derived from Shannon entropy subadditivity, and responsive agency necessarily suppresses P below this ceiling, a structural prediction we term the informational cost of agency. Across 21 trained continuous control agents, we confirm this prediction empirically at P = 0.33 plus minus 0.02. The same suppression signature reproduces in language model dialogue, convolutional vision systems, and classical mechanical baselines, indicating that P captures a substrate independent property of agentic interaction rather than an algorithm specific artifact. The Information Digital Twin, IDT, a model agnostic architecture that computes P from the external interaction stream, detects 89.3% of coupling degradations against 44.0% for reward based monitoring, with 4.4 times lower latency. P provides the missing measurement layer for runtime reliability and closed loop self regulation in deployed autonomous systems.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 28 references that are in the map. First posted on arXiv 1 Mar 2026.

Builds on

13 of 28 references.

References · 13

  1. 2017Proximal Policy Optimization Algorithmscited by 14,441
  2. 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,635
  3. 2020Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problemscited by 1,873
  4. 2020WILDS: A Benchmark of in-the-Wild Distribution Shiftscited by 1,366
  5. 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,325
  6. 2015Variational Information Maximisation for Intrinsically Motivated Reinforcement Learningcited by 142
  7. 2023Real-World Humanoid Locomotion with Reinforcement Learningcited by 132
  8. 2022Legged Locomotion in Challenging Terrains using Egocentric Visioncited by 131
  9. 2013Empowerment -- an Introductioncited by 65
  10. 2024Unsupervised Concept Drift Detection from Deep Learning Representations in Real-timecited by 16
  11. 2025Entropy-Based Non-Invasive Reliability Monitoring of Convolutional Neural Networkscited by 3
  12. 2025Mutual Information Tracks Policy Coherence in Reinforcement Learningcited by 3
1 more
  1. 2026A Mathematical Theory of Agency and Intelligencecited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Toward Efficient Agents: Memory, Tool learning, and Planning
  2. 2026Tool-Aware Optimization with Entropy Guidance for Efficient Agentic Reinforcement Learning
  3. 2026Agent-BRACE: Decoupling Beliefs from Actions in Long-Horizon Tasks via Verbalized State Uncertainty
  4. 2025An Information Theoretic Perspective on Agentic System Design
  5. 2026Learning to Act under Noise: Enhancing Agent Robustness via Noisy Environments
  6. 2026A Theory of LLM Information Susceptibility
  7. 2026Causal Retention in Interactive Agents: Interface Factorization and Selective Adaptation
  8. 2026Thinking Outside the Box: Can Language Models Rely on External Guidance Selectively?