mlsanityData to 14 Oct 2026

Counterfactual Basis Extension and Representational Geometry: An MDL-Constrained Model of Conceptual Growth

arXiv 2512.18732 ↗First posted 21 Dec 2025cs.AI cs.LG stat.MLcited by 1

Not on the map. Why?

Abstract (arXiv)

Concept learning becomes possible only when existing representations fail to account for experience. Most models of learning and inference, however, presuppose a fixed representational basis within which belief updating occurs. In this paper, I address a prior question: under what structural conditions can the representational basis itself expand in a principled and selective way? I propose a geometric framework in which conceptual growth is modeled as admissible basis extension evaluated under a Minimum Description Length (MDL) criterion. Experience, whether externally observed or internally simulated, is represented as vectors relative to a current conceptual subspace. Residual components capture systematic representational failure, and candidate conceptual extensions are restricted to low-rank, admissible transformations. I show that any MDL-accepted extension can be chosen so that its novel directions lie entirely within the residual span induced by experience, while extensions orthogonal to this span strictly increase description length and are therefore rejected. This yields a conservative account of imagination and conceptual innovation. Internally generated counterfactual representations contribute to learning only insofar as they expose or amplify structured residual error, and cannot introduce arbitrary novelty. I further distinguish representational counterfactuals--counterfactuals over an agent's conceptual basis--from causal or value-level counterfactuals, and show how MDL provides a normative selection principle governing representational change. Overall, the framework characterizes conceptual development as an error-driven, geometry-constrained process of basis extension, clarifying both the role and the limits of imagination in learning and theory change.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 4 of its 22 references that are in the map. First posted on arXiv 21 Dec 2025.

Builds on

4 of 22 references.

References · 4

  1. 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,336
  2. 2020Data and its (dis)contents: A survey of dataset development and use in machine learning researchcited by 260
  3. 2018A mathematical theory of semantic development in deep neural networkscited by 186
  4. 2019Identifying Linear Models in Multi-Resolution Population Data using Minimum Description Length Principle to Predict Household Incomecited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.