Autoformalization of Game Descriptions using Large Language Models
Not on the map. Why?
Abstract (arXiv)
Game theory is a powerful framework for reasoning about strategic interactions, with applications in domains ranging from day-to-day life to international politics. However, applying formal reasoning tools in such contexts is challenging, as these scenarios are often expressed in natural language. To address this, we introduce a framework for the autoformalization of game-theoretic scenarios, which translates natural language descriptions into formal logic representations suitable for formal solvers. Our approach utilizes one-shot prompting and a solver that provides feedback on syntactic correctness to allow LLMs to refine the code. We evaluate the framework using GPT-4o and a dataset of natural language problem descriptions, achieving 98% syntactic correctness and 88% semantic correctness. These results show the potential of LLMs to bridge the gap between real-life strategic interactions and formal reasoning.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 12 of its 30 references that are in the map. First posted on arXiv 18 Sep 2024.
Builds on
12 of 30 references.
References · 12
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
- 2019Fine-Tuning Language Models from Human Preferencescited by 2,124
- 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,199
- 2020Pre-trained Models for Natural Language Processing: A Surveycited by 504
- 2023Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoningcited by 379
- 2022Draft, Sketch, and Prove: Guiding Formal Theorem Provers with Informal Proofscited by 278
- 2023Solving Math Word Problems by Combining Language Models With Symbolic Solverscited by 124
- 2023Can Large Language Models Serve as Rational Players in Game Theory? A Systematic Analysiscited by 91
- 2021Improving Coherence and Consistency in Neural Sequence Models with Dual-System, Neuro-Symbolic Reasoningcited by 85
- 2023Coupling Large Language Models with Logic Programming for Robust and General Reasoning from Textcited by 59
- 2023Language Models can be Logical Solverscited by 24
- 2024Towards Logically Sound Natural Language Reasoning with Logic-Enhanced Language Model Agentscited by 5
Built on by
Citing papers per year: 2024: 1; 2025: 4.
5 papers.
- 2025Code World Models for General Game Playingcited by 25
- 2025Game Theory Meets Large Language Models: A Systematic Survey with Taxonomy and New Frontierscited by 14
- 2024Generative Agents for Multi-Agent Autoformalization of Interaction Scenarioscited by 5
- 2025The Influence of Human-inspired Agentic Sophistication in LLM-driven Strategic Reasonerscited by 3
- 2025Hypergame Rationalisability: Solving Agent Misalignment In Strategic Playcited by 0
- 2025Hypergame Rationalisability: Solving Agent Misalignment In Strategic Play12 Dec 2025
- 2025Code World Models for General Game Playing6 Oct 2025
- 2025The Influence of Human-inspired Agentic Sophistication in LLM-driven Strategic Reasoners14 May 2025
- 2025Game Theory Meets Large Language Models: A Systematic Survey with Taxonomy and New Frontiers13 Feb 2025
- 2024Generative Agents for Multi-Agent Autoformalization of Interaction Scenarios11 Dec 2024