mlsanityData to 7 Oct 2026

Steering Recurrent Reasoners at Inference Time with Readout Feedback

arXiv 2608.24136 ↗First posted 25 Aug 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Recurrent models, which repeatedly update latent states with shared computation blocks, have emerged as powerful architectures for solving complex reasoning tasks. Existing inference-time methods scale computation by running more steps or sampling more trajectories, but ignore information revealed within each trajectory. Here we show that recurrent models can be improved at inference time by using their own readout probabilities to steer latent dynamics without retraining. We introduce Readout Feedback (RoFB), a test-time intervention that converts intermediate predictions into token-wise pairwise coupling forces injected into the latent dynamics. Across three recurrent models (AKOrN, ItrSA++, TRM) on Sudoku and Maze, RoFB yields clear gains in four of six model-task pairs and a small gain in one. The four positive pairs achieve performance unattainable by merely running more steps or selecting from multiple trajectories, at comparable or lower computational cost. These results suggest that closed-loop steering of latent dynamics can serve as a complementary inference-time control mechanism for recurrent reasoning models.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 44 of its 54 references that are in the map. First posted on arXiv 25 Aug 2026.

Builds on

44 of 54 references.

References · 44

  1. 2017Attention Is All You Needcited by 59,932
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  4. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  5. 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
  6. 2019Root Mean Square Layer Normalizationcited by 1,425
  7. 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,397
  8. 2015Unsupervised Deep Embedding for Clustering Analysiscited by 763
  9. 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 763
  10. 2019Deep Equilibrium Modelscited by 603
  11. 2018Invariant Information Clustering for Unsupervised Image Classification and Segmentationcited by 454
  12. 2025Scaling up Test-Time Compute with Latent Reasoning: A Recurrent Depth Approachcited by 372
32 more
  1. 2020SCAN: Learning to Classify Images without Labelscited by 351
  2. 2025Reasoning with Latent Thoughts: On the Power of Looped Transformerscited by 223
  3. 2015Conditional Random Fields as Recurrent Neural Networkscited by 213
  4. 2018A System for Massively Parallel Hyperparameter Tuningcited by 201
  5. 2021Exploiting the Intrinsic Neighborhood Structure for Source-free Domain Adaptationcited by 176
  6. 2025ARC-AGI-2: A New Challenge for Frontier AI Reasoning Systemscited by 171
  7. 2025Hierarchical Reasoning Modelcited by 167
  8. 2023A mathematical perspective on Transformerscited by 160
  9. 2025The Unreasonable Effectiveness of Entropy Minimization in LLM Reasoningcited by 160
  10. 2025Scaling Latent Reasoning via Looped Language Modelscited by 145
  11. 2023Looped Transformers are Better at Learning Learning Algorithmscited by 135
  12. 2025Soft Thinking: Unlocking the Reasoning Potential of LLMs in Continuous Concept Spacecited by 109
  13. 2022Attracting and Dispersing: A Simple Approach for Source-free Domain Adaptationcited by 93
  14. 2023Tell Your Model Where to Attend: Post-hoc Attention Steering for LLMscited by 82
  15. 2023GTA: A Geometry-Aware Attention Mechanism for Multi-View Transformerscited by 75
  16. 2024Relaxed Recursive Transformers: Effective Parameter Sharing with Layer-wise LoRAcited by 72
  17. 2024Dynamic metastability in the self-attention modelcited by 42
  18. 2024Artificial Kuramoto Oscillatory Neuronscited by 37
  19. 2026A Mechanistic Analysis of Looped Reasoning Language Modelscited by 27
  20. 2025Latent Chain-of-Thought? Decoding the Depth-Recurrent Transformercited by 24
  21. 2019Adaptively Truncating Backpropagation Through Time to Control Gradient Biascited by 22
  22. 2026Probabilistic Tiny Recursive Modelcited by 16
  23. 2023Recurrent Attention Networks for Long-text Modelingcited by 12
  24. 2025Universal Reasoning Modelcited by 11
  25. 2025Understanding and Steering the Cognitive Behaviors of Reasoning Models at Test-Timecited by 10
  26. 2026Are Your Reasoning Models Reasoning or Guessing? A Mechanistic Analysis of Hierarchical Reasoning Modelscited by 9
  27. 2026Adaptive Test-Time Compute Allocation for Reasoning LLMs via Constrained Policy Optimizationcited by 8
  28. 2026ATLAS: Verifier-Guided Adaptive Latent Activation Steering for Efficient LLM Reasoningcited by 6
  29. 2025DISCO: Disentangled Communication Steering for Large Language Modelscited by 5
  30. 2025Attention-Aligned Reasoning for Large Language Modelscited by 2
  31. 2026Source-Free Domain Adaptation by Optimizing Batch-Wise Cosine Similaritycited by 1
  32. 2026C-voting: Confidence-Based Test-Time Voting without Explicit Energy Functionscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Boosting Inference with Guided Reasoning: Stochastic Exploration for Recursive Models
  2. 2026RecurTrace: Adaptive Latent Reasoning with Loop-Time Memory
  3. 2026Scheduling Recursive Reasoning in Looped Transformers
  4. 2026Penelope: Localized Latent Recurrence for Efficient Structured Reasoning
  5. 2026Latent Recurrent Thoughts: Recurrent Refinement of Proposed Latents for Reasoning with Frozen LLMs
  6. 2026Energy-guided Recursive Model
  7. 2026Can We Break LLMs Out of Self-Loops? Fine-Grained Reasoning Control with Activation Steering
  8. 2026Recurrent Reasoning on Symbolic Puzzles with Sequence Models