Think Fast: Estimating No-CoT Task-Completion Time Horizons of Frontier AI Models
On the map: LLM reasoning → Prompting and chain-of-thought reasoning
Abstract (arXiv)
Many efforts to ensure frontier AI models are safe rely on monitoring their chain-of-thought (CoT) reasoning. If models become able to perform sufficiently complex reasoning internally, without explicit thinking tokens, this would undermine such oversight. We measure how well frontier models reason without CoT across a suite of over 30,000 questions spanning 43 benchmarks in domains including math, coding, puzzles, causality, theory-of-mind, and strategic reasoning. To compare models against humans, we estimate the 50%-task-completion time horizon (TH): the human time required for tasks a model completes with 50% success rate. We complement this with a 50% reasoning token horizon: the minimum number of o3-mini reasoning tokens needed for tasks a model solves with 50% success rate. We find that the no-CoT 50% TH of frontier models has been doubling roughly every year over the past six years, with GPT-5.5's TH reaching over 3 minutes and reasoning token horizon exceeding 1,500 tokens. Our median estimates predict that frontier no-CoT THs could exceed 7 minutes by 2028, and 25 minutes by 2030, though these projections carry substantial uncertainty. We recommend frontier developers track this explicitly.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Placed in Prompting and chain-of-thought reasoning, one of 17 directions in LLM reasoning. First posted on arXiv 5 Jun 2026.
Builds on
0 of 0 references.
No references here yet.
Built on by
Citing papers per year: 2026: 12.
12 papers.
- 2026MirrorCode: AI can rebuild entire programs from behavior alonecited by 4
- 2026How Transparent is DiffusionGemma?cited by 2
- 2026BixBench3: Benchmarking AI agents on research-study-scale computational biology taskscited by 1
- 2026Building Comparative Motivation Profiles with Instrumental Interventionscited by 0
- 2026Bootstrapped Monitoring: Leveraging Transparent Reasoning to Oversee Stronger AI Agentscited by 0
- 2026Agentic systems for breast cancer treatment recommendationscited by 0
- 2026Hardware Mechanisms to Dynamically Throttle AI Performancecited by 0
- 2026Economic Evaluations of Language Modelscited by 0
- 2026SysEvolve: An AI-native, safe, autonomous adversarial attack-defense co-evolutionary systemcited by 0
- 2026Resource Constraints and Performance in Agentic AI Systemscited by 0
- 2026Math for AI safety: an invitation for mathematicianscited by 0
- 2026Caught in the Act: Probes Effectively Detect Sabotage and Catch Unverbalized Deceptioncited by 0
- 2026Caught in the Act: Probes Effectively Detect Sabotage and Catch Unverbalized Deception8 Oct 2026
- 2026Math for AI safety: an invitation for mathematicians14 Sep 2026
- 2026Resource Constraints and Performance in Agentic AI Systems28 Aug 2026
- 2026BixBench3: Benchmarking AI agents on research-study-scale computational biology tasks26 Aug 2026
- 2026SysEvolve: An AI-native, safe, autonomous adversarial attack-defense co-evolutionary system15 Aug 2026
- 2026Hardware Mechanisms to Dynamically Throttle AI Performance20 Jul 2026
- 2026Agentic systems for breast cancer treatment recommendations13 Jul 2026
- 2026MirrorCode: AI can rebuild entire programs from behavior alone29 Jun 2026
- 2026Economic Evaluations of Language Models26 Jun 2026
- 2026How Transparent is DiffusionGemma?18 Jun 2026
- 2026Bootstrapped Monitoring: Leveraging Transparent Reasoning to Oversee Stronger AI Agents10 Jun 2026
- 2026Building Comparative Motivation Profiles with Instrumental Interventions6 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026The Horizon Gap: Planning, Memory, Execution, Training, and Evaluation for Long-Horizon LLM Agents
- 2026Capable yet Parsimonious: Extracting and Characterizing Hidden Chain-of-Thought in Frontier Models
- 2026LongCoT: Benchmarking Long-Horizon Chain-of-Thought Reasoning
- 2025Investigating CoT Monitorability in Large Reasoning Models
- 2025ReasoningWeekly: A General Knowledge and Verbal Reasoning Challenge for Large Language Models
- 2025Why Does Reasoning Length Converge? Unveiling the Underfitting-Overfitting Trade-off in Chain-of-Thought
- 2026How Far Ahead Do LLMs Plan? Uncovering the Latent Horizon in Chain-of-Thought Reasoning
- 2025R-Horizon: How Far Can Your Large Reasoning Model Really Go in Breadth and Depth?