A Differentiable Measure of Algebraic Complexity: Provably Exact Discovery of Group Structures
Not on the map. Why?
Abstract (arXiv)
Discovering discrete algebraic rules from data is a fundamental challenge in machine learning. We formalize this problem through Cayley-table completion -- an algebraic counterpart to classical matrix completion -- where the degree of associativity violation replaces linear rank as the intrinsic measure of complexity. We provide a rigorous landscape analysis of HyperCube, an operator-valued tensor factorization, on the fully observed target table δ, proving that its global infimum Hinf(δ) := infTheta ∈ Fδ H(Theta) implicitly defines an exact differentiable measure for this complexity. We show that HyperCube's native objective H(Theta) decomposes into two components: geometric alignment (collinearity) and an inverse ℓ2 penalty. We establish that these continuous variational pressures induce core discrete properties: collinearity enforces associativity (Collinearity--Associativity Equivalence), and the inverse ℓ2 penalty reduces to an exact inverse rank penalty within the collinear manifold, driving the parameters toward full-rank unitarity. Consequently, we derive an absolute lower bound H(Theta) ≥ Hinf(δ) ≥ 3 , |δ|, where |δ| is the target table size. We prove this absolute floor is attained if and only if the target is isotopic to a group, and characterize the global minimizer as the regular representation of the underlying group (up to unitary gauge), resolving the central open conjecture of Huh (2025). This work serves as an existence proof that certain discrete algebraic structures can be exactly characterized by differentiable measures, enabling gradient-based discovery without the need for combinatorial search. All theoretical results are mechanically verified in Lean 4 and confirmed via small-scale experiments.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 12 of its 20 references that are in the map. First posted on arXiv 28 Nov 2025.
Builds on
12 of 20 references.
References · 12
- 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,131
- 2020Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuningcited by 658
- 2022Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasetscited by 599
- 2019Deep Learning for Symbolic Mathematicscited by 266
- 2021A Practical Method for Constructing Equivariant Multilayer Perceptrons for Arbitrary Matrix Groupscited by 185
- 2018Deep learning generalizes because the parameter-function map is biased towards simple functionscited by 180
- 2021The Low-Rank Simplicity Bias in Deep Networkscited by 150
- 2021Neural Algorithmic Reasoningcited by 92
- 2021Automatic Symmetry Discovery with Lie Algebra Convolutional Networkcited by 82
- 2022Bispectral Neural Networkscited by 17
- 2020Disentangling images with Lie group transformations and sparse codingcited by 14
- 2025Bridging Kolmogorov Complexity and Deep Learning: Asymptotically Optimal Description Length Objectives for Transformerscited by 6
Built on by
Citing papers per year: 2026: 1.
1 paper.