Complexity as Advantage: A Regret-Based Perspective on Emergent Structure
Not on the map. Why?
Abstract (arXiv)
We introduce Complexity as Advantage (CAA), a framework that defines the complexity of a system relative to a family of observers. Instead of measuring complexity as an intrinsic property, we evaluate how much predictive regret a system induces for different observers attempting to model it. A system is complex when it is easy for some observers and hard for others, creating an information advantage. We show that this formulation unifies several notions of emergent behavior, including multiscale entropy, predictive information, and observer-dependent structure. The framework suggests that "interesting" systems are those positioned to create differentiated regret across observers, providing a quantitative grounding for why complexity can be functionally valuable. We demonstrate the idea through simple dynamical models and discuss implications for learning, evolution, and artificial agents.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 9 of its 19 references that are in the map. First posted on arXiv 6 Nov 2025.
Builds on
9 of 19 references.
References · 9
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2017Curiosity-driven Exploration by Self-supervised Predictioncited by 1,173
- 2018Exploration by Random Network Distillationcited by 966
- 2018Stronger generalization bounds for deep nets via a compression approachcited by 306
- 2020Measuring the Algorithmic Efficiency of Neural Networkscited by 51
- 2019Where is the Information in a Deep Neural Network?cited by 40
- 2017Efficient-UCBV: An Almost Optimal Algorithm using Variance Estimatescited by 20
- 2023Data-Driven Online Model Selection With Regret Guaranteescited by 11
- 2024How Does Variance Shape the Regret in Contextual Bandits?cited by 9
Built on by
Not cited yet.