DRIFT: Decompose, Retrieve, Illustrate, then Formalize Theorems
Not on the map. Why?
Abstract (arXiv)
Automating the formalization of mathematical statements for theorem proving remains a major challenge for Large Language Models (LLMs). LLMs struggle to identify and utilize the prerequisite mathematical knowledge and its corresponding formal representation in languages like Lean. Current retrieval-augmented autoformalization methods query external libraries using the informal statement directly, but overlook a fundamental limitation: informal statements lack direct mappings to mathematical theorems and lemmata, nor do those theorems translate trivially into the formal primitives of languages like Lean. To address this, we introduce DRIFT, a novel framework that enables LLMs to decompose informal mathematical statements into smaller, more tractable "sub-components". This facilitates targeted retrieval of premises from mathematical libraries such as Mathlib. Additionally, DRIFT retrieves illustrative theorems to help models use premises more effectively in formalization tasks. We evaluate DRIFT across diverse benchmarks (ProofNet, ConNF, and MiniF2F-test) and find that it consistently improves premise retrieval, nearly doubling the F1 score compared to the DPR baseline on ProofNet. Notably, DRIFT demonstrates strong performance on the out-of-distribution ConNF benchmark, with BEq+@10 improvements of 42.25% and 37.14% using GPT-4.1 and DeepSeek-V3.1, respectively. Our analysis shows that retrieval effectiveness in mathematical autoformalization depends heavily on model-specific knowledge boundaries, highlighting the need for adaptive retrieval strategies aligned with each model's capabilities.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 33 of its 60 references that are in the map. First posted on arXiv 12 Oct 2025.
Builds on
33 of 60 references.
References · 33
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
- 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,073
- 2022Precise Zero-Shot Dense Retrieval without Relevance Labelscited by 517
- 2023LeanDojo: Theorem Proving with Retrieval-Augmented Language Modelscited by 427
- 2021MiniF2F: a cross-system benchmark for formal Olympiad-level mathematicscited by 391
- 2022Draft, Sketch, and Prove: Guiding Formal Theorem Provers with Informal Proofscited by 291
- 2024Large Language Models for Mathematical Reasoning: Progresses and Challengescited by 284
- 2024DeepSeek-Prover-V1.5: Harnessing Proof Assistant Feedback for Reinforcement Learning and Monte-Carlo Tree Searchcited by 197
- 2024PutnamBench: Evaluating Neural Theorem-Provers on the Putnam Mathematical Competitioncited by 165
- 2025Goedel-Prover-V2: Scaling Formal Theorem Proving with Scaffolded Data Synthesis and Self-Correctioncited by 154
- 2023Query2doc: Query Expansion with Large Language Modelscited by 149
21 more
- 2024RQ-RAG: Learning to Refine Queries for Retrieval Augmented Generationcited by 147
- 2019The Lean mathematical librarycited by 134
- 2025Goedel-Prover: A Frontier Model for Open-Source Automated Theorem Provingcited by 133
- 2024Lean Workbook: A large-scale Lean problem set formalized from natural language math problemscited by 122
- 2025Seed-Prover: Deep and Broad Reasoning for Automated Theorem Provingcited by 101
- 2024RL on Incorrect Synthetic Data Scales the Efficiency of LLM Math Reasoning by Eight-Foldcited by 99
- 2023An In-Context Learning Agent for Formal Theorem-Provingcited by 82
- 2024Lean-STaR: Learning to Interleave Thinking and Provingcited by 68
- 2024TheoremLlama: Transforming General-Purpose LLMs into Lean4 Expertscited by 59
- 2023Multilingual Mathematical Autoformalizationcited by 39
- 2023Decomposing the Enigma: Subgoal-based Demonstration Learning for Formal Theorem Provingcited by 37
- 2024A Semantic Search Engine for Mathlib4cited by 31
- 2024Rango: Adaptive Retrieval-Augmented Proving for Automated Software Verificationcited by 27
- 2024Consistent Autoformalization for Constructing Mathematical Librariescited by 21
- 2025LeanExplore: A search engine for Lean 4 declarationscited by 18
- 2024RichRAG: Crafting Rich Responses for Multi-faceted Queries in Retrieval-Augmented Generationcited by 16
- 2025StepFun-Formalizer: Unlocking the Autoformalization Potential of LLMs through Knowledge-Reasoning Fusioncited by 16
- 2025Theorem Prover as a Judge for Synthetic Data Generationcited by 14
- 2025Question Decomposition for Retrieval-Augmented Generationcited by 11
- 2025Automated Formalization via Conceptual Retrieval-Augmented LLMscited by 5
- 2025Growing Mathlib: maintenance of a large scale mathematical librarycited by 5
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026FormalScience: Scalable Human-in-the-Loop Autoformalisation of Science with Agentic Code Generation in Leancited by 4
- 2026Theory-Scale Auto-Formalization of Logics for Computer Sciencecited by 4
- 2026Theory-Level Autoformalization: From Isolated Statements to Unified Formal Knowledge Basescited by 3
- 2026Monotonic Reference-Free Refinement for Autoformalizationcited by 1
- 2026Decompose, Structure, and Repair: A Neuro-Symbolic Framework for Autoformalization via Operator Treescited by 1
- 2026What are the Right Symmetries for Formal Theorem Proving?cited by 1
- 2026MathForm: Scaling Mathematical Autoformalization with Knowledge Retrieval and Verification-Guided Refinementcited by 0
- 2026When Does Structured Knowledge Help Neural Theorem Proving?cited by 0
- 2026When Does Structured Knowledge Help Neural Theorem Proving?28 Sep 2026
- 2026MathForm: Scaling Mathematical Autoformalization with Knowledge Retrieval and Verification-Guided Refinement14 Aug 2026
- 2026Theory-Level Autoformalization: From Isolated Statements to Unified Formal Knowledge Bases14 Jul 2026
- 2026Theory-Scale Auto-Formalization of Logics for Computer Science25 Jun 2026
- 2026What are the Right Symmetries for Formal Theorem Proving?21 May 2026
- 2026FormalScience: Scalable Human-in-the-Loop Autoformalisation of Science with Agentic Code Generation in Lean24 Apr 2026
- 2026Decompose, Structure, and Repair: A Neuro-Symbolic Framework for Autoformalization via Operator Trees21 Apr 2026
- 2026Monotonic Reference-Free Refinement for Autoformalization30 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2025ProofBridge: Auto-Formalization of Natural Language Proofs in Lean via Joint Embeddings
- 2026Re2Math: Benchmarking Theorem Retrieval in Research-Level Mathematics
- 2025LeanProgress: Guiding Search for Neural Theorem Proving via Proof Progress Prediction
- 2026LEAP: Supercharging LLMs for Formal Mathematics with Agentic Frameworks
- 2025Safe: Enhancing Mathematical Reasoning in Large Language Models via Retrospective Step-aware Formal Verification
- 2025Steering LLMs for Formal Theorem Proving
- 2025Translating Informal Proofs into Formal Proofs Using a Chain of States
- 2026TheoremGraph: Bridging Formal and Informal Mathematics