The Informational Cost of Agency: A Bounded Measure of Interaction Efficiency for Deployed Reinforcement Learning
Not on the map. Why?
Abstract (arXiv)
Deployed reinforcement learning systems lack a principled runtime reliability theory. We close this gap by introducing Bipredictability, P, a closed form information theoretic metric that quantifies how efficiently a closed loop interaction between agent and environment converts uncertainty into shared predictability. P admits a provable classical bound P equal, smaller than 0.5, derived from Shannon entropy subadditivity, and responsive agency necessarily suppresses P below this ceiling, a structural prediction we term the informational cost of agency. Across 21 trained continuous control agents, we confirm this prediction empirically at P = 0.33 plus minus 0.02. The same suppression signature reproduces in language model dialogue, convolutional vision systems, and classical mechanical baselines, indicating that P captures a substrate independent property of agentic interaction rather than an algorithm specific artifact. The Information Digital Twin, IDT, a model agnostic architecture that computes P from the external interaction stream, detects 89.3% of coupling degradations against 44.0% for reward based monitoring, with 4.4 times lower latency. P provides the missing measurement layer for runtime reliability and closed loop self regulation in deployed autonomous systems.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 28 references that are in the map. First posted on arXiv 1 Mar 2026.
Builds on
13 of 28 references.
References · 13
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,635
- 2020Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problemscited by 1,873
- 2020WILDS: A Benchmark of in-the-Wild Distribution Shiftscited by 1,366
- 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,325
- 2015Variational Information Maximisation for Intrinsically Motivated Reinforcement Learningcited by 142
- 2023Real-World Humanoid Locomotion with Reinforcement Learningcited by 132
- 2022Legged Locomotion in Challenging Terrains using Egocentric Visioncited by 131
- 2013Empowerment -- an Introductioncited by 65
- 2024Unsupervised Concept Drift Detection from Deep Learning Representations in Real-timecited by 16
- 2025Entropy-Based Non-Invasive Reliability Monitoring of Convolutional Neural Networkscited by 3
- 2025Mutual Information Tracks Policy Coherence in Reinforcement Learningcited by 3
1 more
- 2026A Mathematical Theory of Agency and Intelligencecited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Toward Efficient Agents: Memory, Tool learning, and Planning
- 2026Tool-Aware Optimization with Entropy Guidance for Efficient Agentic Reinforcement Learning
- 2026Agent-BRACE: Decoupling Beliefs from Actions in Long-Horizon Tasks via Verbalized State Uncertainty
- 2025An Information Theoretic Perspective on Agentic System Design
- 2026Learning to Act under Noise: Enhancing Agent Robustness via Noisy Environments
- 2026A Theory of LLM Information Susceptibility
- 2026Causal Retention in Interactive Agents: Interface Factorization and Selective Adaptation
- 2026Thinking Outside the Box: Can Language Models Rely on External Guidance Selectively?