Compositional Symmetry as Compression: Lie Pseudogroup Structure in Algorithmic Agents
Not on the map. Why?
Abstract (arXiv)
In the algorithmic (Kolmogorov) view, agents are programs that track and compress sensory streams using generative programs. We propose a framework where the relevant structural prior is simplicity (Solomonoff) understood as compositional symmetry: natural streams are well described by (local) actions of finite-parameter Lie pseudogroups on geometrically and topologically complex low-dimensional configuration manifolds (latent spaces). Modeling the agent as a generic neural dynamical system coupled to such streams, we show that accurate world-tracking imposes (i) structural constraints -- equivariance of the agent's constitutive equations and readouts -- and (ii) dynamical constraints: under static inputs, symmetry induces conserved quantities (Noether-style labels) in the agent dynamics and confines trajectories to reduced invariant manifolds; under slow drift, these manifolds move but remain low-dimensional. This yields a hierarchy of reduced manifolds aligned with the compositional factorization of the pseudogroup, providing a geometric account of the ``blessing of compositionality'' in deep models. We connect these ideas to the Spencer formalism for Lie pseudogroups and formulate a symmetry-based, self-contained version of predictive coding in which higher layers receive only coarse-grained residual transformations (prediction-error coordinates) along symmetry directions unresolved at lower layers.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 6 of its 31 references that are in the map. First posted on arXiv 12 Oct 2025.
Builds on
6 of 31 references.
References · 6
- 2016Why and When Can Deep -- but Not Shallow -- Networks Avoid the Curse of Dimensionality: a Reviewcited by 155
- 2019Theoretical Issues in Deep Networks: Approximation, Optimization and Generalizationcited by 72
- 2022LieGG: Studying Learned Lie Group Generatorscited by 31
- 2024Hardness of Learning Neural Networks under the Manifold Hypothesiscited by 18
- 2024Symmetry Discovery for Different Data Typescited by 8
- 2016Models, networks and algorithmic complexitycited by 1
Built on by
Not cited yet.