First Experiments with Neural Translation of Informal to Formal Mathematics
Not on the map. Why?
Abstract (arXiv)
We report on our experiments to train deep neural networks that automatically translate informalized LaTeX-written Mizar texts into the formal Mizar language. To the best of our knowledge, this is the first time when neural networks have been adopted in the formalization of mathematics. Using Luong et al.'s neural machine translation model (NMT), we tested our aligned informal-formal corpora against various hyperparameters and evaluated their results. Our experiments show that our best performing model configurations are able to generate correct Mizar statements on 65.73% of the inference data, with the union of all models covering 79.17%. These results indicate that formalization through artificial neural network is a promising approach for automated formalization of mathematics. We present several case studies to illustrate our results.
Key facts. Cited by 52 papers in the map (data through 7 Oct 2026). First posted on arXiv 10 May 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 3; 2023: 11; 2024: 10; 2025: 19; 2026: 6.
52 papers.
Sort:
By area:
- 2023A Survey of Large Language Modelscited by 2,537
- 2023LeanDojo: Theorem Proving with Retrieval-Augmented Language Modelscited by 414
- 2022Autoformalization with Large Language Modelscited by 252
- 2023ProofNet: Autoformalizing and Formally Proving Undergraduate-Level Mathematicscited by 180
- 2023LINC: A Neurosymbolic Approach for Logical Reasoning by Combining Language Models with First-Order Logic Proverscited by 161
- 2021Proof Artifact Co-training for Theorem Proving with Language Modelscited by 130
- 2023LEGO-Prover: Neural Theorem Proving with Growing Librariescited by 108
- 2024Formal Mathematical Reasoning: A New Frontier in AIcited by 80
- 2024A Survey on Deep Learning for Theorem Provingcited by 55
- 2024Herald: A Natural Language Annotated Lean 4 Datasetcited by 54
- 2024Process-Driven Autoformalization in Lean 4cited by 45
- 2023Multilingual Mathematical Autoformalizationcited by 38
38 more
- 2022Formal Specifications from Natural Languagecited by 33
- 2023Towards Autoformalization of Mathematics and Code Correctness: Experiments with Elementary Proofscited by 27
- 2024Autoformalizing Euclidean Geometrycited by 27
- 2025ATLAS: Autoformalizing Theorems through Lifting, Augmentation, and Synthesis of Datacited by 23
- 2022Towards a Mathematics Formalisation Assistant using Large Language Modelscited by 22
- 2024FormalAlign: Automated Alignment Evaluation for Autoformalizationcited by 19
- 2025Aria: An Agent For Retrieval and Iterative Auto-Formalization via Dependency Graphcited by 18
- 2026130k Lines of Formal Topology in Two Weeks: Simple and Cheap Autoformalization for Everyone?cited by 16
- 2025miniF2F-Lean Revisited: Reviewing Limitations and Charting a Path Forwardcited by 13
- 2023Alien Codingcited by 9
- 2024GFLean: An Autoformalisation Framework for Lean via GFcited by 9
- 2025Grammars of Formal Uncertainty: When to Trust LLMs in Automated Reasoning Taskscited by 9
- 2025Generalized Tree Edit Distance (GTED): A Faithful Evaluation Metric for Statement Autoformalizationcited by 9
- 2025ASSESS: A Semantic and Structural Evaluation Framework for Statement Similaritycited by 8
- 2025A Neurosymbolic Approach to Natural Language Formalization and Verificationcited by 8
- 2023Neural Machine Translation for Mathematical Formulaecited by 7
- 2024Learning Guided Automated Reasoning: A Brief Surveycited by 7
- 2024FLARE: Faithful Logic-Aided Reasoning and Explorationcited by 7
- 2025Towards a Common Framework for Autoformalizationcited by 7
- 2025Lean Finder: Semantic Search for Mathlib That Understands User Intentscited by 7
- 2023MizAR 60 for Mizar 50cited by 6
- 20243D-Prover: Diversity Driven Theorem Proving With Determinantal Point Processescited by 6
- 2025HybridProver: Augmenting Theorem Proving with LLM-Driven Proof Synthesis and Refinementcited by 6
- 2021A Study of Continuous Vector Representationsfor Theorem Provingcited by 4
- 2025Lean-ing on Quality: How High-Quality Data Beats Diverse Multilingual Data in AutoFormalizationcited by 4
- 2025Thinking Machines: Mathematical Reasoning in the Age of LLMscited by 4
- 2025Learning Conjecturing from Scratchcited by 3
- 2025A Llama walks into the 'Bar': Efficient Supervised Fine-Tuning for Legal Reasoning in the Multi-state Bar Examcited by 3
- 2026The Faithfulness Gap: Certifying Semantic Equivalence Between Natural-Language and Formal Mathematical Statementscited by 3
- 2025Improving Autoformalization Using Direct Dependency Retrievalcited by 2
- 2021Disambiguating Symbolic Expressions in Informal Documentscited by 1
- 2025Hierarchical Attention Generates Better Proofscited by 1
- 2025Towards Generating Controllable and Solvable Geometry Problem by Leveraging Symbolic Deduction Enginecited by 1
- 2025KELPS: A Framework for Verified Multi-Language Autoformalization via Semantic-Syntactic Alignmentcited by 1
- 2026Munkres' General Topology Autoformalized in Isabelle/HOLcited by 1
- 2026Decompose, Structure, and Repair: A Neuro-Symbolic Framework for Autoformalization via Operator Treescited by 1
- 2023Translating SUMO-K to Higher-Order Set Theorycited by 0
- 2025TopoAlign: A Framework for Aligning Code to Math via Topological Decompositioncited by 0
50 most cited of 52 All 52 (JSON)
- 2026Sage: Formalization with Semantic Correction16 Sep 2026
- 2026Symbolic Informalization: Fluent, Productive, Multilingual15 Jun 2026
- 2026The Faithfulness Gap: Certifying Semantic Equivalence Between Natural-Language and Formal Mathematical Statements15 Jun 2026
- 2026Decompose, Structure, and Repair: A Neuro-Symbolic Framework for Autoformalization via Operator Trees21 Apr 2026
- 2026Munkres' General Topology Autoformalized in Isabelle/HOL8 Apr 2026
- 2026130k Lines of Formal Topology in Two Weeks: Simple and Cheap Autoformalization for Everyone?6 Jan 2026
- 2025Improving Autoformalization Using Direct Dependency Retrieval15 Nov 2025
- 2025A Neurosymbolic Approach to Natural Language Formalization and Verification12 Nov 2025
- 2025miniF2F-Lean Revisited: Reviewing Limitations and Charting a Path Forward5 Nov 2025
- 2025TopoAlign: A Framework for Aligning Code to Math via Topological Decomposition13 Oct 2025
- 2025Lean Finder: Semantic Search for Mathlib That Understands User Intents8 Oct 2025
- 2025Aria: An Agent For Retrieval and Iterative Auto-Formalization via Dependency Graph6 Oct 2025
38 more
- 2025ASSESS: A Semantic and Structural Evaluation Framework for Statement Similarity26 Sep 2025
- 2025Towards a Common Framework for Autoformalization11 Sep 2025
- 2025Thinking Machines: Mathematical Reasoning in the Age of LLMs1 Aug 2025
- 2025KELPS: A Framework for Verified Multi-Language Autoformalization via Semantic-Syntactic Alignment11 Jul 2025
- 2025Generalized Tree Edit Distance (GTED): A Faithful Evaluation Metric for Statement Autoformalization10 Jul 2025
- 2025Towards Generating Controllable and Solvable Geometry Problem by Leveraging Symbolic Deduction Engine3 Jun 2025
- 2025Grammars of Formal Uncertainty: When to Trust LLMs in Automated Reasoning Tasks26 May 2025
- 2025HybridProver: Augmenting Theorem Proving with LLM-Driven Proof Synthesis and Refinement21 May 2025
- 2025Hierarchical Attention Generates Better Proofs27 Apr 2025
- 2025A Llama walks into the 'Bar': Efficient Supervised Fine-Tuning for Legal Reasoning in the Multi-state Bar Exam7 Apr 2025
- 2025Learning Conjecturing from Scratch3 Mar 2025
- 2025Lean-ing on Quality: How High-Quality Data Beats Diverse Multilingual Data in AutoFormalization18 Feb 2025
- 2025ATLAS: Autoformalizing Theorems through Lifting, Augmentation, and Synthesis of Data8 Feb 2025
- 2024Formal Mathematical Reasoning: A New Frontier in AI20 Dec 2024
- 2024FLARE: Faithful Logic-Aided Reasoning and Exploration14 Oct 2024
- 20243D-Prover: Diversity Driven Theorem Proving With Determinantal Point Processes14 Oct 2024
- 2024FormalAlign: Automated Alignment Evaluation for Autoformalization14 Oct 2024
- 2024Herald: A Natural Language Annotated Lean 4 Dataset9 Oct 2024
- 2024Process-Driven Autoformalization in Lean 44 Jun 2024
- 2024Autoformalizing Euclidean Geometry27 May 2024
- 2024A Survey on Deep Learning for Theorem Proving15 Apr 2024
- 2024GFLean: An Autoformalisation Framework for Lean via GF1 Apr 2024
- 2024Learning Guided Automated Reasoning: A Brief Survey6 Mar 2024
- 2023Multilingual Mathematical Autoformalization7 Nov 2023
- 2023LINC: A Neurosymbolic Approach for Logical Reasoning by Combining Language Models with First-Order Logic Provers23 Oct 2023
- 2023LEGO-Prover: Neural Theorem Proving with Growing Libraries1 Oct 2023
- 2023LeanDojo: Theorem Proving with Retrieval-Augmented Language Models27 Jun 2023
- 2023Neural Machine Translation for Mathematical Formulae25 May 2023
- 2023Translating SUMO-K to Higher-Order Set Theory13 May 2023
- 2023A Survey of Large Language Models31 Mar 2023
- 2023MizAR 60 for Mizar 5012 Mar 2023
- 2023ProofNet: Autoformalizing and Formally Proving Undergraduate-Level Mathematics24 Feb 2023
- 2023Alien Coding27 Jan 2023
- 2023Towards Autoformalization of Mathematics and Code Correctness: Experiments with Elementary Proofs5 Jan 2023
- 2022Towards a Mathematics Formalisation Assistant using Large Language Models14 Nov 2022
- 2022Formal Specifications from Natural Language4 Jun 2022
- 2022Autoformalization with Large Language Models25 May 2022
- 2021Proof Artifact Co-training for Theorem Proving with Language Models11 Feb 2021
50 newest of 52 All 52 (JSON)
- 2023LINC: A Neurosymbolic Approach for Logical Reasoning by Combining Language Models with First-Order Logic Proverscited by 161
- 2024Formal Mathematical Reasoning: A New Frontier in AIcited by 80
- 2024Herald: A Natural Language Annotated Lean 4 Datasetcited by 54
- 2024Process-Driven Autoformalization in Lean 4cited by 45
- 2025Grammars of Formal Uncertainty: When to Trust LLMs in Automated Reasoning Taskscited by 9
- 2024Learning Guided Automated Reasoning: A Brief Surveycited by 7
- 2024FLARE: Faithful Logic-Aided Reasoning and Explorationcited by 7
- 2025Thinking Machines: Mathematical Reasoning in the Age of LLMscited by 4
- 2025A Llama walks into the 'Bar': Efficient Supervised Fine-Tuning for Legal Reasoning in the Multi-state Bar Examcited by 3
- 2025Thinking Machines: Mathematical Reasoning in the Age of LLMs1 Aug 2025
- 2025Grammars of Formal Uncertainty: When to Trust LLMs in Automated Reasoning Tasks26 May 2025
- 2025A Llama walks into the 'Bar': Efficient Supervised Fine-Tuning for Legal Reasoning in the Multi-state Bar Exam7 Apr 2025
- 2024Formal Mathematical Reasoning: A New Frontier in AI20 Dec 2024
- 2024FLARE: Faithful Logic-Aided Reasoning and Exploration14 Oct 2024
- 2024Herald: A Natural Language Annotated Lean 4 Dataset9 Oct 2024
- 2024Process-Driven Autoformalization in Lean 44 Jun 2024
- 2024Learning Guided Automated Reasoning: A Brief Survey6 Mar 2024
- 2023LINC: A Neurosymbolic Approach for Logical Reasoning by Combining Language Models with First-Order Logic Provers23 Oct 2023
- 2023A Survey of Large Language Modelscited by 2,537
- 2022Autoformalization with Large Language Modelscited by 252
- 2023ProofNet: Autoformalizing and Formally Proving Undergraduate-Level Mathematicscited by 180
- 2023LEGO-Prover: Neural Theorem Proving with Growing Librariescited by 108
- 2024A Survey on Deep Learning for Theorem Provingcited by 55
- 2023Multilingual Mathematical Autoformalizationcited by 38
- 2022Formal Specifications from Natural Languagecited by 33
- 2023Towards Autoformalization of Mathematics and Code Correctness: Experiments with Elementary Proofscited by 27
- 2024Autoformalizing Euclidean Geometrycited by 27
- 2025ATLAS: Autoformalizing Theorems through Lifting, Augmentation, and Synthesis of Datacited by 23
- 2022Towards a Mathematics Formalisation Assistant using Large Language Modelscited by 22
- 2024FormalAlign: Automated Alignment Evaluation for Autoformalizationcited by 19
12 most cited of 39 All 39 (JSON)
- 2026Sage: Formalization with Semantic Correction16 Sep 2026
- 2026Symbolic Informalization: Fluent, Productive, Multilingual15 Jun 2026
- 2026The Faithfulness Gap: Certifying Semantic Equivalence Between Natural-Language and Formal Mathematical Statements15 Jun 2026
- 2026Decompose, Structure, and Repair: A Neuro-Symbolic Framework for Autoformalization via Operator Trees21 Apr 2026
- 2026Munkres' General Topology Autoformalized in Isabelle/HOL8 Apr 2026
- 2026130k Lines of Formal Topology in Two Weeks: Simple and Cheap Autoformalization for Everyone?6 Jan 2026
- 2025A Neurosymbolic Approach to Natural Language Formalization and Verification12 Nov 2025
- 2025miniF2F-Lean Revisited: Reviewing Limitations and Charting a Path Forward5 Nov 2025
- 2025TopoAlign: A Framework for Aligning Code to Math via Topological Decomposition13 Oct 2025
- 2025Lean Finder: Semantic Search for Mathlib That Understands User Intents8 Oct 2025
- 2025ASSESS: A Semantic and Structural Evaluation Framework for Statement Similarity26 Sep 2025
- 2025Towards a Common Framework for Autoformalization11 Sep 2025
12 newest of 39 All 39 (JSON)