mlsanityData to 14 Oct 2026

Natural Language to First-Order Logic LLM-based Autoformalization

arXiv 2610.12030 ↗First posted 8 Oct 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) have renewed interest in autoformalization. Yet, when First-Order Logic (FOL) is considered as the target formalism, the field still lacks a unified task formulation and a systematic survey. This paper addresses this gap: we first provide a principled definition for the FOL-autoformalization task by distinguishing Ontology Extraction from Logical Translation, showing how their conflation obscures (cross-study) evaluation; we review existing datasets, evaluation metrics, and LLM-based methods, including fine-tuning, prompting, and verification-based refinement; we identify open challenges in benchmarking, semantic evaluation, ontology-aware methods, and end-to-end applications.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 66 references that are in the map. First posted on arXiv 8 Oct 2026.

Builds on

17 of 66 references.

References · 17

  1. 2024Towards Guaranteed Safe AI: A Framework for Ensuring Robust and Reliable AI Systemscited by 96
  2. 2020LogiQA: A Challenge Dataset for Machine Reading Comprehension with Logical Reasoningcited by 69
  3. 2018A Survey on Semantic Parsingcited by 62
  4. 2021AR-LSAT: Investigating Analytical Reasoning of Textcited by 51
  5. 2022Formal Specifications from Natural Languagecited by 33
  6. 2024Enhancing Reasoning Capabilities of LLMs via Principled Synthetic Logic Corpuscited by 29
  7. 2024Autoformalizing Natural Language to First-Order Logic: A Case Study in Logical Fallacy Detectioncited by 18
  8. 2024From Natural Language to SQL: Review of LLM-based Text-to-SQL Systemscited by 16
  9. 2024LOGIC-LM++: Multi-Step Refinement for Symbolic Formulationscited by 14
  10. 2025VERUS-LM: a Versatile Framework for Combining LLMs with Symbolic Reasoningcited by 12
  11. 2024Strategies for Improving NL-to-FOL Translation with LLMs: Data Generation, Incremental Fine-Tuning, and Verificationcited by 10
  12. 2026Faithful Autoformalization via Roundtrip Verification and Repaircited by 8
5 more
  1. 2024A Short Review for Ontology Learning: Stride to Large Language Models Trendcited by 5
  2. 2025LOGicalThought: Logic-Based Ontological Grounding of LLMs for High-Assurance Reasoningcited by 4
  3. 2024forallutoexistsval: Autonomous Assessment of LLMs in Formal Synthesis and Interpretation Taskscited by 3
  4. 2025LOGICPO: Efficient Translation of NL-based Logical Problems to FOL using LLMs and Preference Optimizationcited by 1
  5. 2026Fixing FOLIO and MALLS: Verified Annotations and an LLM-assisted Framework to Focus Human Relabelingcited by 1

Built on by

Not cited yet.