mlsanityData to 7 Oct 2026

Tiny Recursive Models on ARC-AGI-1: Inductive Biases, Identity Conditioning, and Test-Time Compute

arXiv 2512.11847 ↗First posted 4 Dec 2025cs.LG cs.AIcited by 9

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

Tiny Recursive Models (TRM) were proposed as a parameter-efficient alternative to large language models for solving Abstraction and Reasoning Corpus (ARC) style tasks. The original work reports strong performance and suggests that recursive latent updates enable non-trivial reasoning, but it remains unclear how much of this performance stems from architecture, test-time compute, or task-specific priors. In this technical note, we empirically analyze the ARC Prize TRM checkpoint on ARC-AGI-1 and report four behavioral findings and an efficiency comparison. First, we show that test-time augmentation and majority-vote ensembling account for a substantial fraction of reported performance: the 1000-sample voting pipeline improves Pass@1 by about 11 percentage points over single-pass canonical inference. Second, a puzzle-identity ablation reveals strict dependence on task identifiers: replacing the correct puzzle ID with a blank or random token yields zero accuracy. Third, a recursion trajectory analysis shows that most of the final accuracy is achieved at the first recursion step and that performance saturates after few latent updates, indicating shallow effective recursion. Fourth, early-stage training experiments under canonical versus heavy augmentation regimes suggest that heavy augmentation broadens the distribution of candidate solutions and improves multi-sample success. Finally, we compare TRM with a naive QLoRA fine-tune of Llama 3 8B on canonical ARC-AGI-1, finding that TRM's non-autoregressive design achieves much higher throughput and substantially lower memory usage in this setting. Overall, TRM's ARC-AGI-1 performance appears to arise from an interaction between efficiency, task-specific conditioning, and aggressive test-time compute rather than deep internal reasoning.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 8 of its 11 references that are in the map. First posted on arXiv 4 Dec 2025.

Builds on

8 of 11 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025ARC-AGI-2: A New Challenge for Frontier AI Reasoning Systems17 May

Other references · 7

  1. 2024The Llama 3 Herd of Modelscited by 14,192
  2. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
  3. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,928
  4. 2025Hierarchical Reasoning Modelcited by 167
  5. 2019On the Measure of Intelligencecited by 129
  6. 2025Less is More: Recursive Reasoning with Tiny Networkscited by 38
  7. 2025Test-time Adaptation of Tiny Recursive Modelscited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 9.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Product of Experts with LLMs: Boosting Performance on ARC Is a Matter of Perspective
  2. 2026ARC-TGI: Human-Validated Task Generators with Reasoning Chain Templates for ARC-AGI
  3. 2025Recursive Self-Aggregation Unlocks Deep Thinking in Large Language Models
  4. 2026What Limits Recursive Reasoning Models: Optimization, Architecture and Test-Time Scaling
  5. 2026A Systematic Study of Small Language Models on Abstract Reasoning Tasks
  6. 2026Modality-Driven Search with Holistic Trace Judging for ARC-AGI-2
  7. 2023LLMs and the Abstraction and Reasoning Corpus: Successes, Failures, and the Importance of Object-based Representations
  8. 2026DiARC: Distinguishing Positive and Negative Samples Helps Improving ARC-like Reasoning Ability of Large Language Models