mlsanityData to 14 Oct 2026

Executable World Models for ARC-AGI-3 in the Era of Coding Agents

arXiv 2605.05138 ↗First posted 6 May 2026cs.AIcited by 14

On the map: World models → World models for language agents

also in 1 more
Abstract (arXiv)

We evaluate an initial coding-agent system for ARC-AGI-3 in which the agent maintains an executable Python world model, verifies it against previous observations, refactors it toward simpler abstractions as a practical proxy for an MDL-like simplicity bias, and plans through the model before acting. The system is intentionally direct: it uses a scripted controller, predefined world-model interfaces, verifier programs, and a plan executor, but no hand-coded game-specific logic. The agent-facing prompts, workspace, and controller contain no game-specific code, game-specific prompts, hand-coded heuristics, hidden solutions, or other game-specific information; the same agent and prompts are used across games. Because the coding agent has broad system access, we audit unintended information channels, describe earlier vulnerable harnesses, and explain how the current harness closes observed leakage channels while reducing benchmark-specific information exposure. We report results on the 25 public ARC-AGI-3 games. Each playthrough starts from a fresh agent instance and clean workspace, with no access to files or conversation state from earlier playthroughs. With GPT-5.5 high reasoning effort, the agent fully solved 15 games and achieved a mean per-game RHAE of 58.12%. With GPT-5.4 high reasoning effort, it fully solved 8 games and achieved a mean per-game RHAE of 41.29%. Performance on the private validation set, which is not yet available to us, remains to be tested. Overall, the results provide preliminary evidence that verifier-driven executable world models are a promising approach for ARC-AGI-3 agents. Full run artifacts are released with the code at https://github.com/astroseger/arc-3-agents-baseline1.

Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 6 of its 13 references that are in the map. First posted on arXiv 6 May 2026.

Builds on

6 of 13 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024Generating Code World Models with Large Language Models Guided by Monte Carlo Tree Search24 May
  2. 2024WorldCoder, a Model-Based LLM Agent: Building World Models by Writing Code and Interacting with the Environment19 Feb

Other references · 4

  1. 2018World Modelscited by 1,513
  2. 2022Competition-Level Code Generation with AlphaCodecited by 1,462
  3. 2020DreamCoder: Growing generalizable, interpretable knowledge with wake-sleep Bayesian program learningcited by 161
  4. 2023LILO: Learning Interpretable Libraries by Compressing and Documenting Codecited by 49

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 14.

14 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2026Do Coding Agents Need Executable World Models, Simplification, and Verification to Solve ARC-AGI-3?
  2. 2026Kepler: Auditable World Models for ARC-AGI-3
  3. 2026ARC-AGI-3: A New Challenge for Frontier Agentic Intelligence
  4. 2026Auto: The AGI Compiler
  5. 2026AutoWorldModel-Bench: A State-Centric Benchmark for Automated World-Model Research
  6. 2026Compiled Agency: Frontier General-Purpose Coding Agents Build Winning Game Players from Bare Interaction - from Flappy Bird to StarCraft II and Civilization
  7. 2026Tracing the Thoughts of a Coding Agent Playing ARC-AGI-3: Lessons for Continual Learning
  8. 2026Mind-Studio: Executable World Models with Lookahead Evaluation for Partially Observable Games