Open Problem: Separating Geometric and Algorithmic Compression via Cayley-Table Completion
Not on the map. Why?
Abstract (arXiv)
Modern statistical learning theory and deep learning characterize generalization primarily in terms of continuous capacity control (e.g., norm-based regularization, margin maximization, low-rank bias). While highly successful in continuous domains, deep learning consistently fails to extrapolate exact algorithmic or discrete algebraic rules, reflecting a missing inductive bias toward algorithmic complexity minimization. We propose the Cayley-table completion as the canonical testbed for this missing bias, serving as the discrete algebraic counterpart to matrix completion. Just as matrix factorization combined with weight decay yields an implicit geometric bias toward low linear rank, recent results demonstrate that operator-valued tensor factorizations paired with a flatness prior yield an implicit algorithmic bias toward exact discrete associativity. We pose the open problem of establishing formal exact recovery bounds for Cayley-table completion, and challenge the community to generalize continuous flatness priors to autonomously discover broader discrete algorithmic axioms without combinatorial search.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 25 references that are in the map. First posted on arXiv 28 May 2026.
Builds on
13 of 25 references.
References · 13
- 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,167
- 2016Group Equivariant Convolutional Networkscited by 1,165
- 2020Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuningcited by 671
- 2022Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasetscited by 629
- 2019Neural Probabilistic Logic Programming in DeepProbLogcited by 394
- 2017Implicit Regularization in Matrix Factorizationcited by 322
- 2019Intrinsic dimension of data representations in deep neural networkscited by 282
- 2018Implicit Bias of Gradient Descent on Linear Convolutional Networkscited by 251
- 2022Neural Networks and the Chomsky Hierarchycited by 217
- 2021The Low-Rank Simplicity Bias in Deep Networkscited by 154
- 2021Can You Learn an Algorithm? Generalizing from Easy to Hard Problems with Recurrent Networkscited by 117
- 2023Simplicity Bias in 1-Hidden Layer Neural Networkscited by 26
Built on by
Not cited yet.