mlsanityData to 14 Oct 2026

DRIFT: Decompose, Retrieve, Illustrate, then Formalize Theorems

arXiv 2510.10815 ↗First posted 12 Oct 2025cs.AI cs.CL cs.IRcited by 8

Not on the map. Why?

Abstract (arXiv)

Automating the formalization of mathematical statements for theorem proving remains a major challenge for Large Language Models (LLMs). LLMs struggle to identify and utilize the prerequisite mathematical knowledge and its corresponding formal representation in languages like Lean. Current retrieval-augmented autoformalization methods query external libraries using the informal statement directly, but overlook a fundamental limitation: informal statements lack direct mappings to mathematical theorems and lemmata, nor do those theorems translate trivially into the formal primitives of languages like Lean. To address this, we introduce DRIFT, a novel framework that enables LLMs to decompose informal mathematical statements into smaller, more tractable "sub-components". This facilitates targeted retrieval of premises from mathematical libraries such as Mathlib. Additionally, DRIFT retrieves illustrative theorems to help models use premises more effectively in formalization tasks. We evaluate DRIFT across diverse benchmarks (ProofNet, ConNF, and MiniF2F-test) and find that it consistently improves premise retrieval, nearly doubling the F1 score compared to the DPR baseline on ProofNet. Notably, DRIFT demonstrates strong performance on the out-of-distribution ConNF benchmark, with BEq+@10 improvements of 42.25% and 37.14% using GPT-4.1 and DeepSeek-V3.1, respectively. Our analysis shows that retrieval effectiveness in mathematical autoformalization depends heavily on model-specific knowledge boundaries, highlighting the need for adaptive retrieval strategies aligned with each model's capabilities.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 33 of its 60 references that are in the map. First posted on arXiv 12 Oct 2025.

Builds on

33 of 60 references.

References · 33

  1. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
  2. 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
  3. 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,073
  4. 2022Precise Zero-Shot Dense Retrieval without Relevance Labelscited by 517
  5. 2023LeanDojo: Theorem Proving with Retrieval-Augmented Language Modelscited by 427
  6. 2021MiniF2F: a cross-system benchmark for formal Olympiad-level mathematicscited by 391
  7. 2022Draft, Sketch, and Prove: Guiding Formal Theorem Provers with Informal Proofscited by 291
  8. 2024Large Language Models for Mathematical Reasoning: Progresses and Challengescited by 284
  9. 2024DeepSeek-Prover-V1.5: Harnessing Proof Assistant Feedback for Reinforcement Learning and Monte-Carlo Tree Searchcited by 197
  10. 2024PutnamBench: Evaluating Neural Theorem-Provers on the Putnam Mathematical Competitioncited by 165
  11. 2025Goedel-Prover-V2: Scaling Formal Theorem Proving with Scaffolded Data Synthesis and Self-Correctioncited by 154
  12. 2023Query2doc: Query Expansion with Large Language Modelscited by 149
21 more
  1. 2024RQ-RAG: Learning to Refine Queries for Retrieval Augmented Generationcited by 147
  2. 2019The Lean mathematical librarycited by 134
  3. 2025Goedel-Prover: A Frontier Model for Open-Source Automated Theorem Provingcited by 133
  4. 2024Lean Workbook: A large-scale Lean problem set formalized from natural language math problemscited by 122
  5. 2025Seed-Prover: Deep and Broad Reasoning for Automated Theorem Provingcited by 101
  6. 2024RL on Incorrect Synthetic Data Scales the Efficiency of LLM Math Reasoning by Eight-Foldcited by 99
  7. 2023An In-Context Learning Agent for Formal Theorem-Provingcited by 82
  8. 2024Lean-STaR: Learning to Interleave Thinking and Provingcited by 68
  9. 2024TheoremLlama: Transforming General-Purpose LLMs into Lean4 Expertscited by 59
  10. 2023Multilingual Mathematical Autoformalizationcited by 39
  11. 2023Decomposing the Enigma: Subgoal-based Demonstration Learning for Formal Theorem Provingcited by 37
  12. 2024A Semantic Search Engine for Mathlib4cited by 31
  13. 2024Rango: Adaptive Retrieval-Augmented Proving for Automated Software Verificationcited by 27
  14. 2024Consistent Autoformalization for Constructing Mathematical Librariescited by 21
  15. 2025LeanExplore: A search engine for Lean 4 declarationscited by 18
  16. 2024RichRAG: Crafting Rich Responses for Multi-faceted Queries in Retrieval-Augmented Generationcited by 16
  17. 2025StepFun-Formalizer: Unlocking the Autoformalization Potential of LLMs through Knowledge-Reasoning Fusioncited by 16
  18. 2025Theorem Prover as a Judge for Synthetic Data Generationcited by 14
  19. 2025Question Decomposition for Retrieval-Augmented Generationcited by 11
  20. 2025Automated Formalization via Conceptual Retrieval-Augmented LLMscited by 5
  21. 2025Growing Mathlib: maintenance of a large scale mathematical librarycited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 8.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025ProofBridge: Auto-Formalization of Natural Language Proofs in Lean via Joint Embeddings
  2. 2026Re2Math: Benchmarking Theorem Retrieval in Research-Level Mathematics
  3. 2025LeanProgress: Guiding Search for Neural Theorem Proving via Proof Progress Prediction
  4. 2026LEAP: Supercharging LLMs for Formal Mathematics with Agentic Frameworks
  5. 2025Safe: Enhancing Mathematical Reasoning in Large Language Models via Retrospective Step-aware Formal Verification
  6. 2025Steering LLMs for Formal Theorem Proving
  7. 2025Translating Informal Proofs into Formal Proofs Using a Chain of States
  8. 2026TheoremGraph: Bridging Formal and Informal Mathematics