mlsanityData to 7 Oct 2026

Kepler: Auditable World Models for ARC-AGI-3

arXiv 2610.00834 ↗First posted 30 Sep 2026cs.AI cs.MAcited by 0

On the map: World models → World models for language agents also fits: World model security and GUI agents

Abstract (arXiv)

ARC-AGI-3 evaluates agents in interactive environments whose rules and objectives must be inferred from observation. We present Kepler, an open-source harness that represents hypotheses as executable world models and validates them through retrospective transition checks and conditional prediction checks. Under one frozen Claude Opus 5 configuration, Kepler obtained a server-verified 100.00 RHAE on all 25 public games, with no per-game model selection or score-conditioned reruns. On 181 of 183 completed levels, the final Opus attempt used no more actions than the corresponding median-human baseline. The retained board runs used 8,256 environment actions, of which 7,292 occurred in scored levels. Retained local provider-session records yield 858.0 million tokens, 97.37% cache reads, and a 777.72 cost at September 1, 2026 API list-equivalent rates. We also report three evaluation failures: source-code leakage that produced an invalid perfect run, agents reconstructing a removed harness in a control condition, and autonomous repair masking a broken planner. A single-game observation case study showed that animation frames contained task-relevant information absent from settled text grids. Across the final Claude Opus 5 and GPT-5.6 Sol boards, 48 of 50 game-model cells reached 100. These results indicate that public-set score alone has limited discriminative value and motivate first-attempt, cost-conditioned, and verification-aware reporting.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 7 of its 17 references that are in the map. First posted on arXiv 30 Sep 2026.

Builds on

7 of 17 references.

Closest ancestors · 4

Same direction, newest first

  1. 2026Twin: Playing an Unknown Game with a Test-Time Digital Twin14 Aug
  2. 2026Tycho: Active Abstraction with Programmatic World Models for ARC-AGI-330 Jul
  3. 2026When a Verified World Model Still Loses: Play-Adequacy vs Prediction-Accuracy in LLM-Synthesized Code World Models15 Jul
  4. 2026OPINE-World: Programmatic World Modeling with Ontology-error-Prioritized Interactive Exploration for ARC-AGI-31 Jul

Other references · 3

  1. 2019On the Measure of Intelligencecited by 129
  2. 2026ARC-AGI-3: A New Challenge for Frontier Agentic Intelligencecited by 29
  3. 2026Prime Agent: A Self-Improving RLM Harnesscited by 8

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Executable World Models for ARC-AGI-3 in the Era of Coding Agents
  2. 2026Do Coding Agents Need Executable World Models, Simplification, and Verification to Solve ARC-AGI-3?
  3. 2026Mind-Studio: Executable World Models with Lookahead Evaluation for Partially Observable Games
  4. 2026Auto: The AGI Compiler
  5. 2026AutoWorldModel-Bench: A State-Centric Benchmark for Automated World-Model Research
  6. 2025Graph-Based Exploration for ARC-AGI-3 Interactive Reasoning Tasks
  7. 2026PlayWorld: Benchmarking World Models with Agent Players over Long-Horizon Objectives
  8. 2026GameLogicBench: Evaluating Coding Agents on Runtime Game Logic with Tick-Level State Assertions