mlsanityData to 7 Oct 2026

An Exploratory Case Study of LLM-Assisted Refactoring and Gameplay Feature Generation in an Endless Runner Game

arXiv 2606.21171 ↗First posted 19 Jun 2026cs.SE cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) are increasingly used to support software development, but their practical usefulness in applied game-development settings remains underexplored, especially when generated code must be integrated into an existing game software system. This paper presents an exploratory empirical case study of GPT-4o in a custom Python/Pygame endless runner. The study examines six selected development tasks: three localized refactoring tasks and three tasks involving gameplay feature generation. The resulting implementations were evaluated using software metrics, unit tests, and manual gameplay assessments. In this case study, all three selected refactoring tasks were completed successfully in functional terms, whereas only one of the three selected gameplay feature generation tasks resulted in a correctly integrated feature. The findings suggest that, in this setting, GPT-4o handled localized transformations more reliably than tasks requiring new gameplay interactions across multiple existing systems. Given the exploratory single-case design, these results are best interpreted as indicative observations rather than as generalizable evidence of category-level model performance. Overall, the paper contributes a transparent case-based account of the opportunities and limitations of LLM-assisted refactoring and gameplay feature generation in an existing game software system.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 22 references that are in the map. First posted on arXiv 19 Jun 2026.

Builds on

15 of 22 references.

References · 15

  1. 2024A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applicationscited by 428
  2. 2023The Programmer's Assistant: Conversational Interaction with a Large Language Model for Software Developmentcited by 95
  3. 2024Large Language Models and Games: A Survey and Roadmapcited by 91
  4. 2023Refining ChatGPT-Generated Code: Characterizing and Mitigating Code Quality Issuescited by 78
  5. 2023No Need to Lift a Finger Anymore? Assessing the Quality of Code Generation by ChatGPTcited by 45
  6. 2023On the Effectiveness of Large Language Models in Domain-Specific Code Generationcited by 44
  7. 2023LLMs for Science: Usage for Code Generation and Data Analysiscited by 34
  8. 2024Test-Driven Development for Code Generationcited by 32
  9. 2024An Empirical Study on Usage and Perceptions of LLMs in a Software Engineering Projectcited by 28
  10. 2023Refactoring Programs Using Large Language Models with Few-Shot Examplescited by 27
  11. 2024Large Language Models and Video Games: A Preliminary Scoping Reviewcited by 23
  12. 2024An Empirical Study on the Code Refactoring Capability of Large Language Modelscited by 19
3 more
  1. 2024Can ChatGPT Support Developers? An Empirical Evaluation of Large Language Models for Code Generationcited by 11
  2. 2024GPT for Games: An Updated Scoping Review (2020-2024)cited by 10
  3. 2024Leveraging Large Language Models for Efficient Failure Analysis in Game Developmentcited by 1

Built on by

Not cited yet.