mlsanityData to 7 Oct 2026

Autoformalization of Game Descriptions using Large Language Models

arXiv 2409.12300 ↗First posted 18 Sep 2024cs.AI cs.GTcited by 5

Not on the map. Why?

Abstract (arXiv)

Game theory is a powerful framework for reasoning about strategic interactions, with applications in domains ranging from day-to-day life to international politics. However, applying formal reasoning tools in such contexts is challenging, as these scenarios are often expressed in natural language. To address this, we introduce a framework for the autoformalization of game-theoretic scenarios, which translates natural language descriptions into formal logic representations suitable for formal solvers. Our approach utilizes one-shot prompting and a solver that provides feedback on syntactic correctness to allow LLMs to refine the code. We evaluate the framework using GPT-4o and a dataset of natural language problem descriptions, achieving 98% syntactic correctness and 88% semantic correctness. These results show the potential of LLMs to bridge the gap between real-life strategic interactions and formal reasoning.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 12 of its 30 references that are in the map. First posted on arXiv 18 Sep 2024.

Builds on

12 of 30 references.

References · 12

  1. 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
  2. 2019Fine-Tuning Language Models from Human Preferencescited by 2,124
  3. 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,199
  4. 2020Pre-trained Models for Natural Language Processing: A Surveycited by 504
  5. 2023Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoningcited by 379
  6. 2022Draft, Sketch, and Prove: Guiding Formal Theorem Provers with Informal Proofscited by 278
  7. 2023Solving Math Word Problems by Combining Language Models With Symbolic Solverscited by 124
  8. 2023Can Large Language Models Serve as Rational Players in Game Theory? A Systematic Analysiscited by 91
  9. 2021Improving Coherence and Consistency in Neural Sequence Models with Dual-System, Neuro-Symbolic Reasoningcited by 85
  10. 2023Coupling Large Language Models with Logic Programming for Robust and General Reasoning from Textcited by 59
  11. 2023Language Models can be Logical Solverscited by 24
  12. 2024Towards Logically Sound Natural Language Reasoning with Logic-Enhanced Language Model Agentscited by 5

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 4.

5 papers.