mlsanityData to 14 Oct 2026

ARC Prize 2025: Technical Report

arXiv 2601.10904 ↗First posted 15 Jan 2026cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

The ARC-AGI benchmark series serves as a critical measure of few-shot generalization on novel tasks, a core aspect of intelligence. The ARC Prize 2025 global competition targeted the newly released ARC-AGI-2 dataset, which features greater task complexity compared to its predecessor. The Kaggle competition attracted 1,455 teams and 15,154 entries, with the top score reaching 24% on the ARC-AGI-2 private evaluation set. Paper submissions nearly doubled year-over-year to 90 entries, reflecting the growing research interest in fluid intelligence and abstract reasoning. The defining theme of 2025 is the emergence of the refinement loop -- a per-task iterative program optimization loop guided by a feedback signal. Refinement loops come in a variety of forms, in particular evolutionary program synthesis approaches and application-layer refinements to commercial AI systems. Such refinement loops are also possible in weight space, as evidenced by zero-pretraining deep learning methods which are now achieving competitive performance with remarkably small networks (7M parameters). In parallel, four frontier AI labs (Anthropic, Google DeepMind, OpenAI, and xAI) reported ARC-AGI performance in public model cards in 2025, establishing ARC-AGI as an industry standard benchmark for AI reasoning. However, our analysis indicates that current frontier AI reasoning performance remains fundamentally constrained to knowledge coverage, giving rise to new forms of benchmark contamination. In this paper, we survey the top-performing methods, examine the role of refinement loops in AGI progress, discuss knowledge-dependent overfitting, and preview ARC-AGI-3, which introduces interactive reasoning challenges that require exploration, planning, memory, goal acquisition, and alignment capabilities.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 8 of its 25 references that are in the map. First posted on arXiv 15 Jan 2026.

Builds on

8 of 25 references.

References · 8

  1. 2025Hierarchical Reasoning Modelcited by 177
  2. 2025Self-Improving Language Models for Evolutionary Program Synthesis: A Case Study on ARC-AGIcited by 36
  3. 2025Product of Experts with LLMs: Boosting Performance on ARC Is a Matter of Perspectivecited by 17
  4. 2025ARC-NCA: Towards Developmental Solutions to the Abstraction and Reasoning Corpuscited by 10
  5. 2025Don't throw the baby out with the bathwater: How and why deep learning for ARCcited by 7
  6. 2025Test-time Adaptation of Tiny Recursive Modelscited by 5
  7. 2025Rethinking Visual Intelligence: Insights from Video Pretrainingcited by 3
  8. 2025Vector Symbolic Algebras for the Abstraction and Reasoning Corpuscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.