mlsanityData to 13 Oct 2026

Towards Error Centric Intelligence I, Beyond Observational Learning

arXiv 2510.15128 ↗First posted 16 Oct 2025cs.AI cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

We argue that progress toward AGI is theory limited rather than data or scale limited. Building on the critical rationalism of Popper and Deutsch, we challenge the Platonic Representation Hypothesis. Observationally equivalent worlds can diverge under interventions, so observational adequacy alone cannot guarantee interventional competence. We begin by laying foundations, definitions of knowledge, learning, intelligence, counterfactual competence and AGI, and then analyze the limits of observational learning that motivate an error centric shift. We recast the problem as three questions about how explicit and implicit errors evolve under an agent's actions, which errors are unreachable within a fixed hypothesis space, and how conjecture and criticism expand that space. From these questions we propose Causal Mechanics, a mechanisms first program in which hypothesis space change is a first class operation and probabilistic structure is used when useful rather than presumed. We advance structural principles that make error discovery and correction tractable, including a differential Locality and Autonomy Principle for modular interventions, a gauge invariant form of Independent Causal Mechanisms for separability, and the Compositional Autonomy Principle for analogy preservation, together with actionable diagnostics. The aim is a scaffold for systems that can convert unreachable errors into reachable ones and correct them.

Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Builds on 21 of its 52 references that are in the map. First posted on arXiv 16 Oct 2025.

Builds on

21 of 52 references.

References · 21

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,231
  2. 2016Overcoming catastrophic forgetting in neural networkscited by 4,753
  3. 2016Learning without Forgettingcited by 2,479
  4. 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,323
  5. 2017Gradient Episodic Memory for Continual Learningcited by 1,882
  6. 2016Progressive Neural Networkscited by 1,347
  7. 2020Gradient Surgery for Multi-Task Learningcited by 1,225
  8. 2017Continual Learning with Deep Generative Replaycited by 1,155
  9. 2017Memory Aware Synapses: Learning what (not) to forgetcited by 1,099
  10. 2018Efficient Lifelong Learning with A-GEMcited by 1,053
  11. 2022Toy Models of Superpositioncited by 950
  12. 2020Dark Experience for General Continual Learning: a Strong, Simple Baselinecited by 901
9 more
  1. 2017PackNet: Adding Multiple Tasks to a Single Network by Iterative Pruningcited by 891
  2. 2020AdapterFusion: Non-Destructive Task Composition for Transfer Learningcited by 785
  3. 2018Learning to Learn without Forgetting by Maximizing Transfer and Minimizing Interferencecited by 514
  4. 2024The Platonic Representation Hypothesiscited by 369
  5. 2019Orthogonal Gradient Descent for Continual Learningcited by 364
  6. 2019Learn to Grow: A Continual Structure Learning Framework for Overcoming Catastrophic Forgettingcited by 302
  7. 2019LAMOL: LAnguage MOdeling for Lifelong Language Learningcited by 158
  8. 2021The Causal-Neural Connection: Expressiveness, Learnability, and Inferencecited by 97
  9. 2025Questioning Representational Optimism in Deep Learning: The Fractured Entangled Representation Hypothesiscited by 20

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.