mlsanityData to 7 Oct 2026

When Should an In-Context Learner Expand Its Hypothesis Space?

arXiv 2610.09471 ↗First posted 7 Oct 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Learning systems adapt quickly inside a familiar family of models. The harder step comes earlier: deciding, from observations that could be noise, an exception, a change within the family or structure outside it, whether opening a richer family is worth its cost. We treat this as a costly sequential decision: prediction failure must be turned into structural evidence, evidence into a value of expansion, and value into action. The Structural Revision Environment produces matched failures from each source, varies the price of expansion and the remaining horizon independently of the evidence, and admits exact Bayesian calculations and an exact normative solution of the one-shot decision. Its solution shows that revision is a value boundary and not an evidence threshold: one history has different optimal actions under different prices, horizons and announced queries, the boundary between local repair and expansion is set by the inputs a rule predicts and a repair cannot cover, and belief in the richer family crosses long before the decision does. Transformers trained in the environment reproduce this boundary from utility alone. Language models of three post-training lineages carry a failure-sensitive signal in their predictions that is not reflected in their revision decisions, and given the gain of expanding they read it without weighing it against price and horizon. Three models allowed to reason weigh the stated gain in the reference's proportions and still do not turn the history into an estimate of what expansion would buy. Controlled post-training of the meta-trained learners moves the prior and the sharpness of predictions, and neither moves the criterion.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 48 references that are in the map. First posted on arXiv 7 Oct 2026.

Builds on

11 of 48 references.

References · 11

  1. 2024Rational Metareasoning for Large Language Modelscited by 20
  2. 2026Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world modelscited by 6
  3. 2026In-Context Learning Under Regime Changecited by 1
  4. 2026Thinking Hard, Not Smart: Reasoning Models Fail to Ration Test-Time Compute Across Questionscited by 1
  5. 2026Beyond the Clock: Measuring the Value of Adaptive Revisioncited by 1
  6. 2026Measuring the Value of World-Model Updates: A Counterfactual Utility Protocol for Continual Adaptationcited by 1
  7. 2026When is Test-Time Adaptation Identifiable From Unlabeled Evidence?cited by 1
  8. 2026Measuring the Assistant's Harmlessness Preferences on the User Turncited by 1
  9. 2026The Limits of Simulated Societies: How Post-Training and Survey Fine-Tuning Erase Cross-Cultural Variancecited by 1
  10. 2026Return or Revise? Learning When Revision Helps Retrieval-Augmented QAcited by 1
  11. 2026Erased, Rerouted, or Rescaled? Post-Training and the Causal Quotient of a Language Model's Belief Statecited by 1

Built on by

Not cited yet.