mlsanityData to 14 Oct 2026

Operational Proto-Introspection in Looped Language Models: Process-Quality Taps, Executable Branching, and the Readout-Control Boundary

arXiv 2607.18553 ↗First posted 20 Jul 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Can a language model read the quality of its ongoing computation, and can an external intervention turn that readout into better outcomes? We test both questions in a frozen 2.6B looped transformer, Ouro-RLTT. On GSM8K, a strict pre-answer probe excludes the answer region and gold value yet predicts success: hidden states plus length/log-probability features reach AUROC 0.797 versus 0.731 for those surface features alone (increment +0.066; task-clustered 95% CI [+0.021,+0.112]; 170 tasks). On Horizon Logic, a prospectively extended task-disjoint study gives an increment of +0.111 (CI [+0.056,+0.169]), independently replicated on the new cohort (+0.095) and robust to an adversarial malformed-sibling shortcut. Recurrence also moves candidate-quality readability to progressively earlier physical depth; the trend replicates across the Ouro family and qualitatively in out-of-family Huginn, although their transfer geometry differs. The readout converts into validated decision-level gains. Hidden-state-based scores improve risk-coverage over shortcut-only scores in four sealed selective-prediction arms, and terminal selection beats matched random even when every candidate is well formed (27/32 correct selections versus 64.8% expected; p = 0.0086). Generative control does not convert: directional steering is negative, a branch screen is bounded, and exact-compute loop allocation and minimal LoRA direction-binding detect no gain. These tests run through bit-exact branch/carry/prune machinery over Ouro's 192-slot recurrent cache, including a suffix-recompute splice saving up to 88% of per-branch layer passes. We call this decision-usable but not generatively controllable property operational proto-introspection. All load-bearing values use source-item-disjoint splits and antisymmetrized pairwise evaluation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 31 references that are in the map. First posted on arXiv 20 Jul 2026.

Builds on

23 of 31 references.

References · 23

  1. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  2. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  3. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  4. 2023Let's Verify Step by Stepcited by 3,789
  5. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
  6. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  7. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
  8. 2023SGLang: Efficient Execution of Structured Language Model Programscited by 1,141
  9. 2024Refusal in Language Models Is Mediated by a Single Directioncited by 1,032
  10. 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 797
  11. 2023The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasetscited by 712
  12. 2025Scaling up Test-Time Compute with Latent Reasoning: A Recurrent Depth Approachcited by 415
11 more
  1. 2025Chain of Thought Monitorability: A New and Fragile Opportunity for AI Safetycited by 249
  2. 2025Reasoning with Latent Thoughts: On the Power of Looped Transformerscited by 240
  3. 2025Scaling Latent Reasoning via Looped Language Modelscited by 165
  4. 2024Looking Inward: Language Models Can Learn About Themselves by Introspectioncited by 113
  5. 2025Tell me about yourself: LLMs are aware of their learned behaviorscited by 91
  6. 2025Language Models Are Capable of Metacognitive Monitoring and Control of Their Internal Activationscited by 41
  7. 2025Privileged Self-Access Matters for Introspection in AIcited by 22
  8. 2026Latent Introspection: Models Can Detect Prior Concept Injectionscited by 14
  9. 2025Evaluating Control Protocols for Untrusted AI Agentscited by 11
  10. 2024Unlocking Decoding-time Controllability: Gradient-Free Multi-Objective Alignment with Contrastive Promptscited by 9
  11. 2026Relational Preference Encoding in Looped Transformer Internal Statescited by 2

Built on by

Not cited yet.