mlsanityData to 14 Oct 2026

Compositional Symmetry as Compression: Lie Pseudogroup Structure in Algorithmic Agents

arXiv 2510.10586 ↗First posted 12 Oct 2025cs.LG cs.AI cs.ITcited by 0

Not on the map. Why?

Abstract (arXiv)

In the algorithmic (Kolmogorov) view, agents are programs that track and compress sensory streams using generative programs. We propose a framework where the relevant structural prior is simplicity (Solomonoff) understood as compositional symmetry: natural streams are well described by (local) actions of finite-parameter Lie pseudogroups on geometrically and topologically complex low-dimensional configuration manifolds (latent spaces). Modeling the agent as a generic neural dynamical system coupled to such streams, we show that accurate world-tracking imposes (i) structural constraints -- equivariance of the agent's constitutive equations and readouts -- and (ii) dynamical constraints: under static inputs, symmetry induces conserved quantities (Noether-style labels) in the agent dynamics and confines trajectories to reduced invariant manifolds; under slow drift, these manifolds move but remain low-dimensional. This yields a hierarchy of reduced manifolds aligned with the compositional factorization of the pseudogroup, providing a geometric account of the ``blessing of compositionality'' in deep models. We connect these ideas to the Spencer formalism for Lie pseudogroups and formulate a symmetry-based, self-contained version of predictive coding in which higher layers receive only coarse-grained residual transformations (prediction-error coordinates) along symmetry directions unresolved at lower layers.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 6 of its 31 references that are in the map. First posted on arXiv 12 Oct 2025.

Builds on

6 of 31 references.

References · 6

  1. 2016Why and When Can Deep -- but Not Shallow -- Networks Avoid the Curse of Dimensionality: a Reviewcited by 155
  2. 2019Theoretical Issues in Deep Networks: Approximation, Optimization and Generalizationcited by 72
  3. 2022LieGG: Studying Learned Lie Group Generatorscited by 31
  4. 2024Hardness of Learning Neural Networks under the Manifold Hypothesiscited by 18
  5. 2024Symmetry Discovery for Different Data Typescited by 8
  6. 2016Models, networks and algorithmic complexitycited by 1

Built on by

Not cited yet.