mlsanityData to 14 Oct 2026

Structural Learning Theory: A Metric-Topology Factorization Approach

arXiv 2602.07974 ↗First posted 8 Feb 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Learning in structured, multi-context, or non-stationary environments involves two orthogonal difficulties. The first is metric: once the correct context is known, how hard is prediction within it? This is the domain of Statistical Learning Theory (SLT). The second is structural: how many local contexts are required, and how can they be discovered from data? This paper develops Structural Learning Theory (StrLT) for the structural axis. We introduce width, the minimum number of jointly contractive and low-risk cells needed to cover a learning problem. Width is incomparable with VC dimension: either can diverge while the other remains bounded. We show that width induces a phase transition: if the allocated number of cells (K<w), learning suffers an irreducible structural error floor; if (K≥ w), the problem reduces to ordinary within-cell statistical learning. To estimate width, we introduce the contractive-similarity (CS) operator, a task-adaptive graph kernel combining geometric locality with predictive compatibility. Its CS Laplacian exposes contractive basins through spectral separation. We further develop the metric slingshot, which reuses low-dimensional latent contraction maps to reduce funnel-learning cost. Together, width, CS estimation, and the slingshot decompose learning into trap discovery and funnel generalization, with deep implications for continual and lifelong learning in an open-ended environment.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 56 references that are in the map. First posted on arXiv 8 Feb 2026.

Builds on

9 of 56 references.

References · 9

  1. 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
  2. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
  3. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,073
  4. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
  5. 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,330
  6. 2020In Search of Lost Domain Generalizationcited by 1,054
  7. 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 872
  8. 2015The Benefit of Multitask Representation Learningcited by 195
  9. 2023On the Stability-Plasticity Dilemma of Class-Incremental Learningcited by 56

Built on by

Not cited yet.