mlsanityData to 14 Oct 2026

What Iterated Self-Feeding Probes of Language Models Measure, and a test that separates the construction from the model

arXiv 2608.10986 ↗First posted 11 Aug 2026cs.CL cs.LGcited by 3

On the map: LLM reasoning → Test-time compute and efficient thinking

also in 1 more
Abstract (arXiv)

A growing class of methods probes a language model by feeding it its own output: self-consistency, iterated refinement, agentic loops. We ask what such a probe measures, in a construction chosen to make the question sharp: a ring of token cells resampled in place by the model's own windowed conditional p_r(x_i | x_{i+-r}). The substrate is Glauber dynamics on token sequences and is not new; what we change is the coupling. Advancing two rings that differ in one token under common random numbers makes undamaged copies diverge by exactly zero, so damage spreading becomes measurable where a maximal coupling gives mixing times instead. The answer is that it measures two different things at once, in readings that look alike. Some quantities are fixed by the construction: the damage light cone is kinematic, and the radius scaling of the token-space Lyapunov exponent lambda_ca(r) is model-invariant across 19 models and two scale ladders spanning 70x. Others genuinely track the model: lambda_ca crosses zero at a reproducible point in training, and the attractor share ranks models consistently however the lattice is built. Left undistinguished, the first kind is readily mistaken for the second -- we did so ourselves for four months, and report a phase transition we measured to three decimal places that belongs to the probe rather than to any language model. We give the test that separates them: hold the construction fixed and vary the model, or hold the model fixed and vary the construction, and see which readings move. We validate the instrument by reproduction first, recovering a Domany-Kinzel damage field bit-exactly against an independent prediction, and we report the estimator failures that this discipline caught -- four retracted verdicts, each on a quantity that looked like a measurement. The methodology ships as a package.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 10 of its 17 references that are in the map. First posted on arXiv 11 Aug 2026.

Builds on

10 of 17 references.

References · 10

  1. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  2. 2023The Hydra Effect: Emergent Self-repair in Language Model Computationscited by 156
  3. 2024Model Equality Testing: Which Model Is This API Serving?cited by 47
  4. 2024Explorations of Self-Repair in Language Modelscited by 39
  5. 2024When LLMs Play the Telephone Game: Cultural Attractors as Conceptual Tools to Evaluate LLMs in Multi-turn Settingscited by 17
  6. 2025Unveiling Attractor Cycles in Large Language Models: A Dynamical Systems View of Successive Paraphrasingcited by 15
  7. 2024Phase Transitions in the Output Distribution of Large Language Modelscited by 7
  8. 2026Which Model Is Actually Serving You? IRIS: Budgeted Black-Box Auditing of Model Substitution and Routing Dilution in LLM Gatewayscited by 3
  9. 2026Mixing Times of Glauber Dynamics on Masked Language Modelscited by 2
  10. 2026Auditing Question-Order Effects in Large Language Models with the QQ Equality: Mechanism Characterization and a Saturation Caveatcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Towards Better Exploration in Sequential Test-Time Scaling
  2. 2025Geometric Dynamics of Agentic Loops in Large Language Models
  3. 2024Observational Scaling Laws and the Predictability of Language Model Performance
  4. 2026Measuring Collective Semantic Change in Populations of Language Model Agents
  5. 2026Towards Physical Intuitions for Alignment Dynamics: A Case Study With Randomness Crystallization
  6. 2024Monitoring Latent World States in Language Models with Propositional Probes
  7. 2026A geometric relation of the error introduced by sampling a language model's output distribution to its internal state
  8. 2026How Much Can Language Models Gain from Test-Time Computation?