General Video Game AI: a Multi-Track Framework for Evaluating Agents, Games and Content Generation Algorithms
Not on the map. Why?
Abstract (arXiv)
General Video Game Playing (GVGP) aims at designing an agent that is capable of playing multiple video games with no human intervention. In 2014, The General Video Game AI (GVGAI) competition framework was created and released with the purpose of providing researchers a common open-source and easy to use platform for testing their AI methods with potentially infinity of games created using Video Game Description Language (VGDL). The framework has been expanded into several tracks during the last few years to meet the demand of different research directions. The agents are required either to play multiple unknown games with or without access to game simulations, or to design new game levels or rules. This survey paper presents the VGDL, the GVGAI framework, existing tracks, and reviews the wide use of GVGAI framework in research, education and competitions five years after its birth. A future plan of framework improvements is also described.
Key facts. Cited by 45 papers in the map (data through 14 Oct 2026). First posted on arXiv 28 Feb 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 14; 2022: 9; 2023: 5; 2024: 1; 2025: 10; 2026: 6.
45 papers.
Sort:
By area:
- 2022Evolving Curricula with Regret-Based Environment Designcited by 173
- 2021A Survey of Zero-shot Generalisation in Deep Reinforcement Learningcited by 170
- 2021MiniHack the Planet: A Sandbox for Open-Ended Reinforcement Learning Researchcited by 97
- 2025lmgame-Bench: How Good are LLMs at Playing Games?cited by 55
- 2021Learning Controllable Content Generatorscited by 40
- 2021Experience-Driven PCG via Reinforcement Learning: A Super Mario Bros Studycited by 25
- 2024Game Generation via Large Language Modelscited by 25
- 2025Graphs Meet AI Agents: Taxonomy, Progress, and Future Opportunitiescited by 23
- 2025Assessing Adaptive World Models in Machines with Novel Gamescited by 20
- 2023Games for Artificial Intelligence Research: A Review and Perspectivescited by 14
- 2026AI Gamestore: Scalable, Open-Ended Evaluation of Machine General Intelligence with Human Gamescited by 12
- 2026WebGameBench: Requirement-to-Application Evaluation for Coding Agents via Browser-Native Gamescited by 12
33 more
- 2021Discovering User-Interpretable Capabilities of Black-Box Planning Agentscited by 10
- 2022Mutation Models: Learning to Generate Levels by Imitating Evolutioncited by 9
- 2025GVGAI-LLM: Evaluating Large Language Model Agents with Infinite Gamescited by 9
- 2021Procedural Content Generation: Better Benchmarks for Transfer Reinforcement Learningcited by 7
- 2023RaidEnv: Exploring New Challenges in Automated Content Balancing for Boss Raid Gamescited by 7
- 2021Generating Diverse and Competitive Play-Styles for Strategy Gamescited by 6
- 2022Transfer Dynamics in Emergent Evolutionary Curriculacited by 6
- 2023DanZero+: Dominating the GuanDan Game through Reinforcement Learningcited by 6
- 2025The Procedural Content Generation Benchmark: An Open-source Testbed for Generative Challenges in Gamescited by 6
- 2022DanZero: Mastering GuanDan Game with Reinforcement Learningcited by 5
- 2025LatticeWorld: A Multimodal Large Language Model-Empowered Framework for Interactive Complex World Generationcited by 5
- 2022GriddlyJS: A Web IDE for Reinforcement Learningcited by 4
- 2025PuzzleJAX: A Benchmark for Reasoning and Learningcited by 4
- 2021Multi-Agent Deep Reinforcement Learning using Attentive Graph Neural Architectures for Real-Time Strategy Gamescited by 3
- 2021Adversarial Random Forest Classifier for Automated Game Designcited by 3
- 2022The Ludii Game Description Language is Universalcited by 3
- 2026AI for Games in the Foundation Model Eracited by 3
- 2021Playtesting: What is Beyond Personascited by 2
- 2021Automatic Generation of Board Game Manualscited by 2
- 2022Start Small: Training Controllable Game Level Generators without Training Data by Learning at Multiple Sizescited by 2
- 2023Procedural Content Generation via Knowledge Transformation (PCG-KT)cited by 2
- 2025ScriptDoctor: Automatic Generation of PuzzleScript Games via Large Language Models and Tree Searchcited by 2
- 2021Game Mechanic Alignment Theory and Discoverycited by 1
- 2021Portfolio Search and Optimization for General Strategy Game-Playingcited by 1
- 2022Developing a Successful Bomberman Agentcited by 1
- 2023PyTAG: Challenges and Opportunities for Reinforcement Learning in Tabletop Gamescited by 1
- 2026Spatial Reasoning in LLM Game Agents: Impact of Causal Context and Multi-Step Planningcited by 1
- 2021Ordinal Monte Carlo Tree Searchcited by 0
- 2022Extended Intelligencecited by 0
- 2025A modular framework for automated evaluation of procedural content generation in serious games with deep reinforcement learning agentscited by 0
- 2025Ludax: A GPU-Accelerated Domain Specific Language for Board Gamescited by 0
- 2026Procedural Generation of First Person Shooter Maps using Map-Elitescited by 0
- 2026Knowledge-Conditioned, Single-Pass LLM Synthesis of Executable Unity Game Scenes: A Compiler Error Census across 26 Goal Playable Conceptscited by 0
- 2026AI for Games in the Foundation Model Era15 Sep 2026
- 2026Spatial Reasoning in LLM Game Agents: Impact of Causal Context and Multi-Step Planning22 Jul 2026
- 2026Knowledge-Conditioned, Single-Pass LLM Synthesis of Executable Unity Game Scenes: A Compiler Error Census across 26 Goal Playable Concepts11 Jul 2026
- 2026Procedural Generation of First Person Shooter Maps using Map-Elites28 May 2026
- 2026WebGameBench: Requirement-to-Application Evaluation for Coding Agents via Browser-Native Games17 May 2026
- 2026AI Gamestore: Scalable, Open-Ended Evaluation of Machine General Intelligence with Human Games19 Feb 2026
- 2025LatticeWorld: A Multimodal Large Language Model-Empowered Framework for Interactive Complex World Generation5 Sep 2025
- 2025PuzzleJAX: A Benchmark for Reasoning and Learning22 Aug 2025
- 2025GVGAI-LLM: Evaluating Large Language Model Agents with Infinite Games11 Aug 2025
- 2025Assessing Adaptive World Models in Machines with Novel Games17 Jul 2025
- 2025Ludax: A GPU-Accelerated Domain Specific Language for Board Games27 Jun 2025
- 2025Graphs Meet AI Agents: Taxonomy, Progress, and Future Opportunities22 Jun 2025
33 more
- 2025ScriptDoctor: Automatic Generation of PuzzleScript Games via Large Language Models and Tree Search6 Jun 2025
- 2025A modular framework for automated evaluation of procedural content generation in serious games with deep reinforcement learning agents22 May 2025
- 2025lmgame-Bench: How Good are LLMs at Playing Games?21 May 2025
- 2025The Procedural Content Generation Benchmark: An Open-source Testbed for Generative Challenges in Games27 Mar 2025
- 2024Game Generation via Large Language Models11 Apr 2024
- 2023DanZero+: Dominating the GuanDan Game through Reinforcement Learning5 Dec 2023
- 2023PyTAG: Challenges and Opportunities for Reinforcement Learning in Tabletop Games19 Jul 2023
- 2023RaidEnv: Exploring New Challenges in Automated Content Balancing for Boss Raid Games4 Jul 2023
- 2023Procedural Content Generation via Knowledge Transformation (PCG-KT)1 May 2023
- 2023Games for Artificial Intelligence Research: A Review and Perspectives26 Apr 2023
- 2022DanZero: Mastering GuanDan Game with Reinforcement Learning31 Oct 2022
- 2022Start Small: Training Controllable Game Level Generators without Training Data by Learning at Multiple Sizes29 Sep 2022
- 2022Extended Intelligence15 Sep 2022
- 2022GriddlyJS: A Web IDE for Reinforcement Learning13 Jul 2022
- 2022Mutation Models: Learning to Generate Levels by Imitating Evolution11 Jun 2022
- 2022The Ludii Game Description Language is Universal1 May 2022
- 2022Developing a Successful Bomberman Agent17 Mar 2022
- 2022Transfer Dynamics in Emergent Evolutionary Curricula3 Mar 2022
- 2022Evolving Curricula with Regret-Based Environment Design2 Mar 2022
- 2021A Survey of Zero-shot Generalisation in Deep Reinforcement Learning18 Nov 2021
- 2021MiniHack the Planet: A Sandbox for Open-Ended Reinforcement Learning Research27 Sep 2021
- 2021Automatic Generation of Board Game Manuals20 Sep 2021
- 2021Discovering User-Interpretable Capabilities of Black-Box Planning Agents28 Jul 2021
- 2021Adversarial Random Forest Classifier for Automated Game Design26 Jul 2021
- 2021Playtesting: What is Beyond Personas26 Jul 2021
- 2021Experience-Driven PCG via Reinforcement Learning: A Super Mario Bros Study30 Jun 2021
- 2021Procedural Content Generation: Better Benchmarks for Transfer Reinforcement Learning31 May 2021
- 2021Multi-Agent Deep Reinforcement Learning using Attentive Graph Neural Architectures for Real-Time Strategy Games21 May 2021
- 2021Learning Controllable Content Generators6 May 2021
- 2021Portfolio Search and Optimization for General Strategy Game-Playing21 Apr 2021
- 2021Generating Diverse and Competitive Play-Styles for Strategy Games17 Apr 2021
- 2021Game Mechanic Alignment Theory and Discovery20 Feb 2021
- 2021Ordinal Monte Carlo Tree Search26 Jan 2021
- 2022Evolving Curricula with Regret-Based Environment Designcited by 173
- 2021A Survey of Zero-shot Generalisation in Deep Reinforcement Learningcited by 170
- 2021MiniHack the Planet: A Sandbox for Open-Ended Reinforcement Learning Researchcited by 97
- 2025lmgame-Bench: How Good are LLMs at Playing Games?cited by 55
- 2021Learning Controllable Content Generatorscited by 40
- 2021Experience-Driven PCG via Reinforcement Learning: A Super Mario Bros Studycited by 25
- 2024Game Generation via Large Language Modelscited by 25
- 2023Games for Artificial Intelligence Research: A Review and Perspectivescited by 14
- 2026AI Gamestore: Scalable, Open-Ended Evaluation of Machine General Intelligence with Human Gamescited by 12
- 2021Discovering User-Interpretable Capabilities of Black-Box Planning Agentscited by 10
- 2022Mutation Models: Learning to Generate Levels by Imitating Evolutioncited by 9
- 2021Procedural Content Generation: Better Benchmarks for Transfer Reinforcement Learningcited by 7
12 most cited of 36 All 36 (JSON)
- 2026Knowledge-Conditioned, Single-Pass LLM Synthesis of Executable Unity Game Scenes: A Compiler Error Census across 26 Goal Playable Concepts11 Jul 2026
- 2026Procedural Generation of First Person Shooter Maps using Map-Elites28 May 2026
- 2026AI Gamestore: Scalable, Open-Ended Evaluation of Machine General Intelligence with Human Games19 Feb 2026
- 2025Ludax: A GPU-Accelerated Domain Specific Language for Board Games27 Jun 2025
- 2025ScriptDoctor: Automatic Generation of PuzzleScript Games via Large Language Models and Tree Search6 Jun 2025
- 2025lmgame-Bench: How Good are LLMs at Playing Games?21 May 2025
- 2025The Procedural Content Generation Benchmark: An Open-source Testbed for Generative Challenges in Games27 Mar 2025
- 2024Game Generation via Large Language Models11 Apr 2024
- 2023DanZero+: Dominating the GuanDan Game through Reinforcement Learning5 Dec 2023
- 2023PyTAG: Challenges and Opportunities for Reinforcement Learning in Tabletop Games19 Jul 2023
- 2023RaidEnv: Exploring New Challenges in Automated Content Balancing for Boss Raid Games4 Jul 2023
- 2023Procedural Content Generation via Knowledge Transformation (PCG-KT)1 May 2023
12 newest of 36 All 36 (JSON)