mlsanityData to 7 Oct 2026

Think Fast: Estimating No-CoT Task-Completion Time Horizons of Frontier AI Models

arXiv 2606.07157 ↗First posted 5 Jun 2026cs.AIcited by 12

On the map: LLM reasoning → Prompting and chain-of-thought reasoning

Abstract (arXiv)

Many efforts to ensure frontier AI models are safe rely on monitoring their chain-of-thought (CoT) reasoning. If models become able to perform sufficiently complex reasoning internally, without explicit thinking tokens, this would undermine such oversight. We measure how well frontier models reason without CoT across a suite of over 30,000 questions spanning 43 benchmarks in domains including math, coding, puzzles, causality, theory-of-mind, and strategic reasoning. To compare models against humans, we estimate the 50%-task-completion time horizon (TH): the human time required for tasks a model completes with 50% success rate. We complement this with a 50% reasoning token horizon: the minimum number of o3-mini reasoning tokens needed for tasks a model solves with 50% success rate. We find that the no-CoT 50% TH of frontier models has been doubling roughly every year over the past six years, with GPT-5.5's TH reaching over 3 minutes and reasoning token horizon exceeding 1,500 tokens. Our median estimates predict that frontier no-CoT THs could exceed 7 minutes by 2028, and 25 minutes by 2030, though these projections carry substantial uncertainty. We recommend frontier developers track this explicitly.

Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Placed in Prompting and chain-of-thought reasoning, one of 17 directions in LLM reasoning. First posted on arXiv 5 Jun 2026.

Builds on

0 of 0 references.

No references here yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 12.

12 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026The Horizon Gap: Planning, Memory, Execution, Training, and Evaluation for Long-Horizon LLM Agents
  2. 2026Capable yet Parsimonious: Extracting and Characterizing Hidden Chain-of-Thought in Frontier Models
  3. 2026LongCoT: Benchmarking Long-Horizon Chain-of-Thought Reasoning
  4. 2025Investigating CoT Monitorability in Large Reasoning Models
  5. 2025ReasoningWeekly: A General Knowledge and Verbal Reasoning Challenge for Large Language Models
  6. 2025Why Does Reasoning Length Converge? Unveiling the Underfitting-Overfitting Trade-off in Chain-of-Thought
  7. 2026How Far Ahead Do LLMs Plan? Uncovering the Latent Horizon in Chain-of-Thought Reasoning
  8. 2025R-Horizon: How Far Can Your Large Reasoning Model Really Go in Breadth and Depth?