mlsanityData to 14 Oct 2026

RSIGame: Autonomous Agentic Game Development with Recursive Self-improvement

arXiv 2609.39045 ↗First posted 30 Sep 2026cs.CL cs.GT cs.LGcited by 1

On the map: LLM agents and tool use → Reinforcement learning for LLM agents also fits: Software engineering coding agents

also in 1 more
Abstract (arXiv)

Recent advances in large language models have made automatic game generation increasingly feasible, yet reliably improving generated games beyond a playable version remains challenging. Naive iterative refinement can easily overfit a small set of test cases, producing fragile games with unresolved bugs, missing behaviors, and poor generalization to broader player interactions. We introduce RSIGame, an autonomous agentic game development framework with recursive self-improvement. RSIGame organizes development into complementary local and global loops. Concretely, a local explore-diagnose-improve loop broadly explores the executable game, diagnoses and prioritizes discovered issues, and performs evidence-grounded revision, where an evolving checklist continually accumulates new testing and improvement guidance. A global loop tracks overall quality, preserves the best checkpoint, and detects saturation or regression over long-horizon development. Beyond test-time improvement, RSIGame further internalizes successful development experience into the generator through training. Across 140 GameCraft-Bench tasks, two game engines, and five generators, RSIGame consistently improves game quality under matched development budgets. Notably, experience internalization enables Qwen3.8-27B to reach 61.38 on Godot and 58.53 on Phaser, exceeding GPT-5.5 one-shot scores while reducing Qwen's generation tokens by 11 times.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Reinforcement learning for LLM agents, one of 16 directions in LLM agents and tool use. Builds on 18 of its 33 references that are in the map. First posted on arXiv 30 Sep 2026.

Builds on

18 of 33 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023Reflexion: Language Agents with Verbal Reinforcement Learning20 Mar

Other references · 17

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  3. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  4. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  5. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
  6. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
  7. 2023Teaching Large Language Models to Self-Debugcited by 988
  8. 2022STaR: Bootstrapping Reasoning With Reasoningcited by 940
  9. 2024Meta-Rewarding Language Models: Self-Improving Alignment with LLM-as-a-Meta-Judgecited by 204
  10. 2025Co-Evolving LLM Coder and Unit Tester via Reinforcement Learningcited by 56
  11. 2026GameDevBench: Evaluating Agentic Capabilities Through Game Developmentcited by 28
  12. 2024Game Generation via Large Language Modelscited by 25
5 more
  1. 2026GameGen-Verifier: Parallel Keypoint-Based Verification for LLM-Generated Games via Runtime State Injectioncited by 11
  2. 2026RSIAgent: Autonomous Exploration for Recursive Self-improvement in New Environmentscited by 8
  3. 2026StructAgent: Harness Long-horizon Digital Agents with Unified Causal Structurecited by 7
  4. 2026CreativeGame:Toward Mechanic-Aware Creative Game Generationcited by 3
  5. 2026The Verifier is the Curriculum: Precision Sets the Return on Search in Code Self-Distillationcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026GameASG-Bench: Benchmarking Autonomous Software Generation for Game Development
  2. 2026OpenGame: Open Agentic Coding for Games
  3. 2026OpenGameEval: Benchmarking Agentic Programming and Exploration in a Stateful Game Engine
  4. 2026GameLogicBench: Evaluating Coding Agents on Runtime Game Logic with Tick-Level State Assertions
  5. 2026GameCraft-Bench: Can Agents Build Playable Games End-to-End in a Real Game Engine?
  6. 2026A2Z GameSpec-Bench: How Faithfully Can Coding Agents Generate Games from Game Design Specifications?
  7. 2026GameXpert-Bench: How Far Are Coding Agents from Expert Game Development?
  8. 2026RSIGym: A Flexible Environment for Recursive Self-Improvement