mlsanityData to 14 Oct 2026

Game Development as Human-LLM Interaction

arXiv 2408.09386 ↗First posted 18 Aug 2024cs.AI cs.CL cs.HCcited by 4

Not on the map. Why?

Abstract (arXiv)

Game development is a highly specialized task that relies on a complex game engine powered by complex programming languages, preventing many gaming enthusiasts from handling it. This paper introduces the Chat Game Engine (ChatGE) powered by LLM, which allows everyone to develop a custom game using natural language through Human-LLM interaction. To enable an LLM to function as a ChatGE, we instruct it to perform the following processes in each turn: (1) Pscript: configure the game script segment based on the user's input; (2) Pcode: generate the corresponding code snippet based on the game script segment; (3) Putter: interact with the user, including guidance and feedback. We propose a data synthesis pipeline based on LLM to generate game script-code pairs and interactions from a few manually crafted seed data. We propose a three-stage progressive training strategy to transfer the dialogue-based LLM to our ChatGE smoothly. We construct a ChatGE for poker games as a case study and comprehensively evaluate it from two perspectives: interaction quality and code correctness.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 28 of its 44 references that are in the map. First posted on arXiv 18 Aug 2024.

Builds on

28 of 44 references.

References · 28

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2022Training language models to follow instructions with human feedbackcited by 15,971
  4. 2024The Llama 3 Herd of Modelscited by 14,715
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  6. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  7. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  8. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  9. 2013Playing Atari with Deep Reinforcement Learningcited by 3,274
  10. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
  11. 2022MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledgecited by 478
  12. 2023Character-LLM: A Trainable Agent for Role-Playingcited by 339
16 more
  1. 2023Principle-Driven Self-Alignment of Language Models from Scratch with Minimal Human Supervisioncited by 318
  2. 2023PandaLM: An Automatic Evaluation Benchmark for LLM Instruction Tuning Optimizationcited by 316
  3. 2023MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedbackcited by 297
  4. 2022Language Models are Realistic Tabular Data Generatorscited by 294
  5. 2023Exploring Large Language Models for Communication Games: An Empirical Study on Werewolfcited by 241
  6. 2023Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Biascited by 232
  7. 2023Evaluating Large Language Models: A Comprehensive Surveycited by 202
  8. 2020The NetHack Learning Environmentcited by 198
  9. 2021Generating Datasets with Pretrained Language Modelscited by 193
  10. 2024Large Language Models and Games: A Survey and Roadmapcited by 93
  11. 2021Medically Aware GPT-3 as a Data Generator for Medical Dialogue Summarizationcited by 76
  12. 2024From Role-Play to Drama-Interaction: An LLM Solutioncited by 42
  13. 2024DuetSim: Building User Simulator with Dual Large Language Models for Task-Oriented Dialoguescited by 24
  14. 2023In-Context Learning User Simulators for Task-Oriented Dialog Systemscited by 19
  15. 2023Empower Nested Boolean Logic via Self-Supervised Curriculum Learningcited by 7
  16. 2023Complexity-Guided Curriculum Learning for Text Graphscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

  1. 2026MAGIC: Transition-Aware Generation of Navigable Multi-Scene Game Worlds with Large Language Modelscited by 1
  2. 2026GameASG-Bench: Benchmarking Autonomous Software Generation for Game Developmentcited by 1
  3. 2026Disentangling Curriculum Learning in NLP: Towards a Unifying Taxonomycited by 0
  4. 2026MedGame: Storytelling Gamification Empowered by Large Language Models for Medical Educationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024LLMs May Not Be Human-Level Players, But They Can Be Testers: Measuring Game Difficulty with LLM Agents
  2. 2025Real-Time World Crafting: Generating Structured Game Behaviors from Natural Language with Large Language Models
  3. 2024GameArena: Evaluating LLM Reasoning through Live Computer Games
  4. 2023Clembench: Using Game Play to Evaluate Chat-Optimized Language Models as Conversational Agents
  5. 2024clembench-2024: A Challenging, Dynamic, Complementary, Multilingual Benchmark and Underlying Flexible Framework for LLMs as Multi-Action Agents
  6. 2025Time to Talk: LLM Agents for Asynchronous Group Communication in Mafia Games
  7. 2023Can Large Language Models Play Text Games Well? Current State-of-the-Art and Open Questions
  8. 2026GameXpert-Bench: How Far Are Coding Agents from Expert Game Development?