Intrinsic Stability Limits of Autoregressive Reasoning: Structural Consequences for Long-Horizon Execution
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Large language models (LLMs) demonstrate remarkable reasoning capabilities, yet their performance often deteriorates sharply in long-horizon tasks, exhibiting systematic breakdown beyond certain scales. Conventional explanations primarily attribute this phenomenon to task complexity, such as combinatorial search explosion or long-term credit assignment challenges. In this work, we argue that these explanations are incomplete: even in linear, unbranched tasks without semantic ambiguity, autoregressive execution is subject to an intrinsic stability limit. We propose that the fundamental constraint on long-horizon reasoning arises from process-level instability in autoregressive generation rather than solely from search or task complexity, reframing long-horizon reasoning as a problem of structural governance. We derive Theorem~A, showing that decision advantage in single-path autoregressive reasoning decays exponentially with execution length, imposing a fundamental bound on maintainable reasoning chains. This result implies a structural consequence: stable long-horizon reasoning requires discrete segmentation, naturally inducing graph-like execution structures such as directed acyclic graphs (DAGs). Empirical studies in both synthetic environments and real TextWorld tasks reveal observable performance cliffs consistent with theoretical predictions. Our findings provide a dynamical perspective on long-horizon reasoning failure and suggest new limitations on maintaining long-term coherence under purely autoregressive architectures. Furthermore, we highlight that short-horizon evaluation protocols may obscure structural instability, indicating a potential shift from scaling toward structured governance in future reasoning systems.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 9 of its 19 references that are in the map. First posted on arXiv 6 Feb 2026.
Builds on
9 of 19 references.
Closest ancestors · 1
Same direction, newest first
Other references · 8
- 2017Attention Is All You Needcited by 59,932
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2019The Curious Case of Neural Text Degenerationcited by 2,881
- 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 873
- 2018TextWorld: A Learning Environment for Text-based Gamescited by 304
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026SAGE: Mitigating Long-Horizon Reasoning Biases via Topological Guidance
- 2026Quantifying the Stability of Multi-Step Reasoning via Error Amplification
- 2026Dissecting Failure Dynamics in Large Language Model Reasoning
- 2025Beyond Surface Reasoning: Unveiling the True Long Chain-of-Thought Capacity of Diffusion Large Language Models
- 2025Beyond Exponential Decay: Rethinking Error Accumulation in Large Language Models
- 2026When to Re-Plan: Subgoal Persistence in Hierarchical Latent Reasoning
- 2025Real-Time Progress Prediction in Reasoning Language Models
- 2026Empirical Evidence of Complexity-Induced Limits in Large Language Models on Finite Discrete State-Space Problems with Explicit Validity Constraints