ProofBridge: Auto-Formalization of Natural Language Proofs in Lean via Joint Embeddings
On the map: Retrieval-augmented generation → Agentic RAG, agents and memory
Abstract (arXiv)
Translating human-written mathematical theorems and proofs from natural language (NL) into formal languages (FLs) like Lean 4 has long been a significant challenge for AI. Most state-of-the-art methods either focus on theorem-only NL-to-FL auto-formalization or on FL proof synthesis from FL theorems. In practice, auto-formalization of both theorem and proof still requires human intervention, as seen in AlphaProof's silver-medal performance at the 2024 IMO, where problem statements were manually translated before automated proof synthesis. We present ProofBridge, a unified framework for automatically translating entire NL theorems and proofs into Lean 4. At its core is a joint embedding model that aligns NL and FL (NL-FL) theorem+proof pairs in a shared semantic space, enabling cross-modal retrieval of semantically relevant FL examples to guide translation. ProofBridge integrates retrieval-augmented fine-tuning with iterative proof repair, leveraging Lean's type checker and semantic equivalence feedback to ensure both syntactic correctness and semantic fidelity. Experiments show substantial improvements in proof auto-formalization over strong baselines (including GPT-5, Gemini-2.5, Kimina-Prover, DeepSeek-Prover), with our retrieval-augmented approach yielding significant gains in semantic correctness (SC, via proving bi-directional equivalence) and type correctness (TC, via type-checking theorem+proof) across pass@k metrics on miniF2F-Test-PF, a dataset we curated. In particular, ProofBridge improves cross-modal retrieval quality by up to 3.28x Recall@1 over all-MiniLM-L6-v2, and achieves +31.14% SC and +1.64% TC (pass@32) compared to the baseline Kimina-Prover-RL-1.7B.
Key facts. Cited by 18 papers in the map (data through 14 Oct 2026). Placed in Agentic RAG, agents and memory, one of 15 directions in Retrieval-augmented generation. Builds on 34 of its 56 references that are in the map. First posted on arXiv 17 Oct 2025.
Builds on
34 of 56 references.
Closest ancestors · 2
Same direction, newest first
- 2025REAL-Prover: Retrieval Augmented Lean Prover for Mathematical Reasoning27 May
- 2023LeanDojo: Theorem Proving with Retrieval-Augmented Language Models27 Jun
Other references · 32
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
- 2021MiniF2F: a cross-system benchmark for formal Olympiad-level mathematicscited by 391
- 2020Generative Language Modeling for Automated Theorem Provingcited by 388
- 2023Improving Text Embeddings with Large Language Modelscited by 303
- 2022Draft, Sketch, and Prove: Guiding Formal Theorem Provers with Informal Proofscited by 291
- 2025DeepSeek-Prover-V2: Advancing Formal Mathematical Reasoning via Reinforcement Learning for Subgoal Decompositioncited by 287
- 2022Autoformalization with Large Language Modelscited by 263
- 2024DeepSeek-Prover: Advancing Theorem Proving in LLMs through Large-Scale Synthetic Datacited by 234
- 2024DeepSeek-Prover-V1.5: Harnessing Proof Assistant Feedback for Reinforcement Learning and Monte-Carlo Tree Searchcited by 197
- 2025Kimina-Prover Preview: Towards Large Formal Reasoning Models with Reinforcement Learningcited by 180
20 more
- 2025Goedel-Prover: A Frontier Model for Open-Source Automated Theorem Provingcited by 133
- 2021Proof Artifact Co-training for Theorem Proving with Language Modelscited by 132
- 2024Lean Workbook: A large-scale Lean problem set formalized from natural language math problemscited by 122
- 2023An In-Context Learning Agent for Formal Theorem-Provingcited by 82
- 2025STP: Self-play LLM Theorem Provers with Iterative Conjecturing and Provingcited by 79
- 2024SynCode: LLM Generation with Grammar Augmentationcited by 69
- 2024TheoremLlama: Transforming General-Purpose LLMs into Lean4 Expertscited by 59
- 2024Herald: A Natural Language Annotated Lean 4 Datasetcited by 59
- 2024Process-Driven Autoformalization in Lean 4cited by 45
- 2024Reliable Evaluation and Benchmarks for Statement Autoformalizationcited by 32
- 2024A Semantic Search Engine for Mathlib4cited by 31
- 2025Leanabell-Prover: Posttraining Scaling in Formal Reasoningcited by 27
- 2023CoTran: An LLM-based Code Translator using Reinforcement Learning with Feedback from Compiler and Symbolic Executioncited by 22
- 2025StepFun-Formalizer: Unlocking the Autoformalization Potential of LLMs through Knowledge-Reasoning Fusioncited by 16
- 2022Peano: Learning Formal Mathematical Reasoningcited by 15
- 2024RLSF: Fine-tuning LLMs via Symbolic Feedbackcited by 14
- 2025Abstractions-of-Thought: Intermediate Representations for LLM Reasoning in Hardware Designcited by 6
- 2025Retrieval-Augmented TLAPS Proof Generation with Large Language Modelscited by 2
- 2024HITgram: A Platform for Experimenting with n-gram Language Modelscited by 1
- 2025Real-Time Agile Software Management for Edge and Fog Computing Based Smart City Infrastructurecited by 1
Built on by
Citing papers per year: 2026: 18.
18 papers.
Sort:
By area:
- 2026AI co-mathematician: Accelerating mathematicians with agentic AIcited by 17
- 2026Faithful Autoformalization via Roundtrip Verification and Repaircited by 8
- 2026TerraFormer: Automated Infrastructure-as-Code with LLMs Fine-Tuned via Policy-Guided Verifier Feedbackcited by 5
- 2026FaithformBench: Benchmarking Faithfulness of Mathematical Chain-of-Thought Autoformalisationcited by 5
- 2026Beyond the Library: An Agentic Framework for Autoformalizing Research Mathematicscited by 4
- 2026FormalRx: Rectify and eXamine Semantic Failures in Autoformalizationcited by 4
- 2026SHADOWBENCH: Toward Reliable Automatic Evaluation of Semantic Alignment in Autoformalizationcited by 4
- 2026COMPOSE: Composing Future Theorems from Citations and Formal Structurecited by 3
- 2026Theory-Level Autoformalization: From Isolated Statements to Unified Formal Knowledge Basescited by 3
- 2026Efficient Test-Time Optimization for Multi-Agent Proof Autoformalizationcited by 2
- 2026TheoremForge: Scaling up Formal Data Synthesis with Low-Budget Agentic Workflowcited by 1
- 2026LLM Framework for Discovering Major Mathematical Conjectures: AI's Quest for the Next Riemann Hypothesiscited by 1
6 more
- 2026FLARE: Verifying MILP Reformulations with LLM-Based Theorem Provingcited by 1
- 2026Natural Synthesis: Outperforming Reactive Synthesis Tools with Large Reasoning Modelscited by 0
- 2026Evaluating the Robustness of Proof Autoformalization in Lean 4cited by 0
- 2026Formalize Once, Edit the Rest: Efficient Lean-Based Answer Selection for Math Reasoningcited by 0
- 2026EULER: Exploring Underused Links with Evidence-Checked Return for Multi-Agent Mathematical Discoverycited by 0
- 2026AIProver: Agentic Auto-Formalization of Mathematical Research via Certificate-Driven Evolving Harnesscited by 0
- 2026AIProver: Agentic Auto-Formalization of Mathematical Research via Certificate-Driven Evolving Harness4 Oct 2026
- 2026SHADOWBENCH: Toward Reliable Automatic Evaluation of Semantic Alignment in Autoformalization29 Aug 2026
- 2026EULER: Exploring Underused Links with Evidence-Checked Return for Multi-Agent Mathematical Discovery28 Aug 2026
- 2026FLARE: Verifying MILP Reformulations with LLM-Based Theorem Proving25 Aug 2026
- 2026FaithformBench: Benchmarking Faithfulness of Mathematical Chain-of-Thought Autoformalisation11 Aug 2026
- 2026Theory-Level Autoformalization: From Isolated Statements to Unified Formal Knowledge Bases14 Jul 2026
- 2026Efficient Test-Time Optimization for Multi-Agent Proof Autoformalization13 Jul 2026
- 2026FormalRx: Rectify and eXamine Semantic Failures in Autoformalization6 Jul 2026
- 2026Beyond the Library: An Agentic Framework for Autoformalizing Research Mathematics30 Jun 2026
- 2026Formalize Once, Edit the Rest: Efficient Lean-Based Answer Selection for Math Reasoning14 Jun 2026
- 2026Evaluating the Robustness of Proof Autoformalization in Lean 412 Jun 2026
- 2026COMPOSE: Composing Future Theorems from Citations and Formal Structure28 May 2026
6 more
- 2026Natural Synthesis: Outperforming Reactive Synthesis Tools with Large Reasoning Models14 May 2026
- 2026AI co-mathematician: Accelerating mathematicians with agentic AI7 May 2026
- 2026Faithful Autoformalization via Roundtrip Verification and Repair27 Apr 2026
- 2026LLM Framework for Discovering Major Mathematical Conjectures: AI's Quest for the Next Riemann Hypothesis19 Apr 2026
- 2026TheoremForge: Scaling up Formal Data Synthesis with Low-Budget Agentic Workflow24 Jan 2026
- 2026TerraFormer: Automated Infrastructure-as-Code with LLMs Fine-Tuned via Policy-Guided Verifier Feedback13 Jan 2026
- 2026FaithformBench: Benchmarking Faithfulness of Mathematical Chain-of-Thought Autoformalisationcited by 5
- 2026Beyond the Library: An Agentic Framework for Autoformalizing Research Mathematicscited by 4
- 2026FormalRx: Rectify and eXamine Semantic Failures in Autoformalizationcited by 4
- 2026Efficient Test-Time Optimization for Multi-Agent Proof Autoformalizationcited by 2
- 2026Natural Synthesis: Outperforming Reactive Synthesis Tools with Large Reasoning Modelscited by 0
- 2026Formalize Once, Edit the Rest: Efficient Lean-Based Answer Selection for Math Reasoningcited by 0
- 2026FaithformBench: Benchmarking Faithfulness of Mathematical Chain-of-Thought Autoformalisation11 Aug 2026
- 2026Efficient Test-Time Optimization for Multi-Agent Proof Autoformalization13 Jul 2026
- 2026FormalRx: Rectify and eXamine Semantic Failures in Autoformalization6 Jul 2026
- 2026Beyond the Library: An Agentic Framework for Autoformalizing Research Mathematics30 Jun 2026
- 2026Formalize Once, Edit the Rest: Efficient Lean-Based Answer Selection for Math Reasoning14 Jun 2026
- 2026Natural Synthesis: Outperforming Reactive Synthesis Tools with Large Reasoning Models14 May 2026
- 2026Faithful Autoformalization via Roundtrip Verification and Repaircited by 8
- 2026TerraFormer: Automated Infrastructure-as-Code with LLMs Fine-Tuned via Policy-Guided Verifier Feedbackcited by 5
- 2026SHADOWBENCH: Toward Reliable Automatic Evaluation of Semantic Alignment in Autoformalizationcited by 4
- 2026COMPOSE: Composing Future Theorems from Citations and Formal Structurecited by 3
- 2026Theory-Level Autoformalization: From Isolated Statements to Unified Formal Knowledge Basescited by 3
- 2026LLM Framework for Discovering Major Mathematical Conjectures: AI's Quest for the Next Riemann Hypothesiscited by 1
- 2026FLARE: Verifying MILP Reformulations with LLM-Based Theorem Provingcited by 1
- 2026Evaluating the Robustness of Proof Autoformalization in Lean 4cited by 0
- 2026EULER: Exploring Underused Links with Evidence-Checked Return for Multi-Agent Mathematical Discoverycited by 0
- 2026SHADOWBENCH: Toward Reliable Automatic Evaluation of Semantic Alignment in Autoformalization29 Aug 2026
- 2026EULER: Exploring Underused Links with Evidence-Checked Return for Multi-Agent Mathematical Discovery28 Aug 2026
- 2026FLARE: Verifying MILP Reformulations with LLM-Based Theorem Proving25 Aug 2026
- 2026Theory-Level Autoformalization: From Isolated Statements to Unified Formal Knowledge Bases14 Jul 2026
- 2026Evaluating the Robustness of Proof Autoformalization in Lean 412 Jun 2026
- 2026COMPOSE: Composing Future Theorems from Citations and Formal Structure28 May 2026
- 2026Faithful Autoformalization via Roundtrip Verification and Repair27 Apr 2026
- 2026LLM Framework for Discovering Major Mathematical Conjectures: AI's Quest for the Next Riemann Hypothesis19 Apr 2026
- 2026TerraFormer: Automated Infrastructure-as-Code with LLMs Fine-Tuned via Policy-Guided Verifier Feedback13 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2025DRIFT: Decompose, Retrieve, Illustrate, then Formalize Theorems
- 2025Translating Informal Proofs into Formal Proofs Using a Chain of States
- 2025IndiMathBench: Autoformalizing Mathematical Reasoning Problems with a Human Touch
- 2025FMC: Formalization of Natural Language Mathematical Competition Problems
- 2025LeanProgress: Guiding Search for Neural Theorem Proving via Proof Progress Prediction
- 2024ImProver: Agent-Based Automated Proof Optimization
- 2026PROMISE: Proof Automation as Structural Imitation of Human Reasoning
- 2025FormalMATH: Benchmarking Formal Mathematical Reasoning of Large Language Models