mlsanityData to 7 Oct 2026

Instruction-Driven Game Engines on Large Language Models

arXiv 2404.00276 ↗First posted 30 Mar 2024cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

The Instruction-Driven Game Engine (IDGE) project aims to democratize game development by enabling a large language model (LLM) to follow free-form game rules and autonomously generate game-play processes. The IDGE allows users to create games by issuing simple natural language instructions, which significantly lowers the barrier for game development. We approach the learning process for IDGEs as a Next State Prediction task, wherein the model autoregressively predicts in-game states given player actions. It is a challenging task because the computation of in-game states must be precise; otherwise, slight errors could disrupt the game-play. To address this, we train the IDGE in a curriculum manner that progressively increases the model's exposure to complex scenarios. Our initial progress lies in developing an IDGE for Poker, a universally cherished card game. The engine we've designed not only supports a wide range of poker variants but also allows for high customization of rules through natural language inputs. Furthermore, it also favors rapid prototyping of new games from minimal samples, proposing an innovative paradigm in game development that relies on minimal prompt and data engineering. This work lays the groundwork for future advancements in instruction-driven game creation, potentially transforming how games are designed and played.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 29 of its 42 references that are in the map. First posted on arXiv 30 Mar 2024.

Builds on

29 of 42 references.

References · 29

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2023GPT-4 Technical Reportcited by 18,132
  4. 2022Training language models to follow instructions with human feedbackcited by 15,712
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  6. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  7. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  8. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  9. 2020Longformer: The Long-Document Transformercited by 3,362
  10. 2013Playing Atari with Deep Reinforcement Learningcited by 3,211
  11. 2023Efficient Streaming Language Models with Attention Sinkscited by 2,115
  12. 2023Code Llama: Open Foundation Models for Codecited by 2,105
17 more
  1. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  2. 2023Baichuan 2: Open Large-scale Language Modelscited by 664
  3. 2020GraphCodeBERT: Pre-training Code Representations with Data Flowcited by 600
  4. 2022MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledgecited by 469
  5. 2023Role-Play with Large Language Modelscited by 290
  6. 2017StarCraft II: A New Challenge for Reinforcement Learningcited by 268
  7. 2019FreeLB: Enhanced Adversarial Training for Natural Language Understandingcited by 261
  8. 2023Exploring Large Language Models for Communication Games: An Empirical Study on Werewolfcited by 238
  9. 2020The NetHack Learning Environmentcited by 196
  10. 2024Large Language Models and Games: A Survey and Roadmapcited by 91
  11. 2024Scaling Instructable Agents Across Many Simulated Worldscited by 67
  12. 2020Code Summarization with Structure-induced Transformercited by 29
  13. 2023Are ChatGPT and GPT-4 Good Poker Players? -- A Pre-Flop Analysiscited by 20
  14. 2023Toward Adversarial Training on Contextualized Language Representationcited by 10
  15. 2023Empower Nested Boolean Logic via Self-Supervised Curriculum Learningcited by 7
  16. 2023PokerKit: A Comprehensive Python Library for Fine-Grained Multi-Variant Poker Game Simulationscited by 3
  17. 2023Complexity-Guided Curriculum Learning for Text Graphscited by 3

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 2.

3 papers.