mlsanityData to 7 Oct 2026

Structural Decoupling: A Scaffold-Flow Theory of Generalization and Alignment

arXiv 2506.20699 ↗First posted 25 Jun 2025cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Learning in non-stationary and multi-context environments requires more than ordinary within-task generalization. A system must also discover which contexts exist, route inputs to the correct context, preserve old contexts, and revise the context library when the environment changes. This paper presents Structural Learning Theory (StrLT) as a framework of filling this missing structural gap. StrLT complements Vapnik's Statistical Learning Theory (SLT): SLT governs the funnel, prediction or control within a fixed regime; while StrLT governs the trap, the discovery and maintenance of structural regimes. The core StrLT object is width, the minimum number of locally feasible contexts needed to cover a problem. We summarize three basic results: width is incomparable with VC dimension; learning exhibits a phase transition at the true width; and width can be estimated by a contractive-similarity (CS) operator that converts task-induced non-contractivity into spectral separation. Under the StrLT framework, we explain how fixed-class structural learnability leads to a structural decoupling principle: the mechanisms that maintain the structural scaffold should not be trained by the same gradients that optimize within-context flow. This principle motivates a scaffold-flow model in which alignment and generalization separate architecturally. Finally, we argue that several safety failures, including hallucination, reward-model boundary errors, and deceptive alignment, can be interpreted as scaffold-resolution or scaffold-preservation failures rather than merely output-level prediction errors.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 61 references that are in the map. First posted on arXiv 25 Jun 2025.

Builds on

30 of 61 references.

References · 30

  1. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  2. 2020Scaling Laws for Neural Language Modelscited by 6,411
  3. 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
  4. 2017Deep reinforcement learning from human preferencescited by 3,846
  5. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
  6. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
  7. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
  8. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
  9. 2022Training Compute-Optimal Large Language Modelscited by 2,927
  10. 2022Survey of Hallucination in Natural Language Generationcited by 2,056
  11. 2020The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalizationcited by 1,842
  12. 2020WILDS: A Benchmark of in-the-Wild Distribution Shiftscited by 1,366
18 more
  1. 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,313
  2. 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 860
  3. 2023Progress measures for grokking via mechanistic interpretabilitycited by 822
  4. 2022Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasetscited by 599
  5. 2015Causal inference using invariant prediction: identification and confidence intervalscited by 533
  6. 2019A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAIcited by 403
  7. 2019A Survey of Autonomous Driving: Common Practices and Emerging Technologiescited by 373
  8. 2023A Survey of Hallucination in Large Foundation Modelscited by 365
  9. 2021Unsolved Problems in ML Safetycited by 291
  10. 2019Risks from Learned Optimization in Advanced Machine Learning Systemscited by 250
  11. 2022Towards Understanding Grokking: An Effective Theory of Representation Learningcited by 229
  12. 2021Goal Misgeneralization in Deep Reinforcement Learningcited by 122
  13. 2022Goal Misgeneralization: Why Correct Specifications Aren't Enough For Correct Goalscited by 120
  14. 2019Optimal Policies Tend to Seek Powercited by 115
  15. 2022The Slingshot Mechanism: An Empirical Study of Adaptive Optimizers and the Grokking Phenomenoncited by 90
  16. 2024Theory on Mixture-of-Experts in Continual Learningcited by 50
  17. 2025AI Safety for Everyonecited by 14
  18. 2025An alignment safety case sketch based on debatecited by 12

Built on by

Not cited yet.