Learning to Repair Lean Proofs from Compiler Feedback
On the map: LLM agents and tool use → Educational agents and math problem solving
Abstract (arXiv)
As neural theorem provers become increasingly agentic, the ability to interpret and act on compiler feedback is critical. However, existing Lean datasets consist almost exclusively of correct proofs, offering little supervision for understanding and repairing failures. We study Lean proof repair as a supervised learning problem: given an erroneous proof and compiler feedback, predict both a corrected proof and a natural-language diagnosis grounded in the same feedback. We introduce APRIL (Automated Proof Repair in Lean), a dataset of 260,000 supervised tuples pairing systematically generated proof failures with compiler diagnostics and aligned repair and explanation targets. Training language models on APRIL substantially improves repair accuracy and feedback-conditioned reasoning; in our single-shot repair evaluation setting, a finetuned 4B-parameter model outperforms the strongest open-source baseline. We view diagnostic-conditioned supervision as a complementary training signal for feedback-using provers. Our dataset is available at https://huggingface.co/datasets/uw-math-ai/APRIL.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Educational agents and math problem solving, one of 16 directions in LLM agents and tool use. Builds on 22 of its 33 references that are in the map. First posted on arXiv 3 Feb 2026.
Builds on
22 of 33 references.
References · 22
- 2025Qwen3 Technical Reportcited by 8,195
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
- 2023LeanDojo: Theorem Proving with Retrieval-Augmented Language Modelscited by 414
- 2023Llemma: An Open Language Model For Mathematicscited by 385
- 2021MiniF2F: a cross-system benchmark for formal Olympiad-level mathematicscited by 380
- 2025DeepSeek-Prover-V2: Advancing Formal Mathematical Reasoning via Reinforcement Learning for Subgoal Decompositioncited by 270
- 2022Autoformalization with Large Language Modelscited by 252
- 2024DeepSeek-Prover: Advancing Theorem Proving in LLMs through Large-Scale Synthetic Datacited by 225
- 2022HyperTree Proof Search for Neural Theorem Provingcited by 192
- 2024DeepSeek-Prover-V1.5: Harnessing Proof Assistant Feedback for Reinforcement Learning and Monte-Carlo Tree Searchcited by 189
- 2025Kimina-Prover Preview: Towards Large Formal Reasoning Models with Reinforcement Learningcited by 173
- 2025Goedel-Prover: A Frontier Model for Open-Source Automated Theorem Provingcited by 126
10 more
- 2024Lean Workbook: A large-scale Lean problem set formalized from natural language math problemscited by 115
- 2025Seed-Prover: Deep and Broad Reasoning for Automated Theorem Provingcited by 96
- 2020Graph-based, Self-Supervised Program Repair from Diagnostic Feedbackcited by 93
- 2021Break-It-Fix-It: Unsupervised Learning for Program Repaircited by 71
- 2024TheoremLlama: Transforming General-Purpose LLMs into Lean4 Expertscited by 58
- 2024Herald: A Natural Language Annotated Lean 4 Datasetcited by 54
- 2025Aristotle: IMO-level Automated Theorem Provingcited by 47
- 2025Toward Training Superintelligent Software Agents through Self-Play SWE-RLcited by 37
- 2025Solving Formal Math Problems by Decomposition and Iterative Reflectioncited by 35
- 2025LeanExplore: A search engine for Lean 4 declarationscited by 13
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Beyond the Library: An Agentic Framework for Autoformalizing Research Mathematicscited by 4
- 2026BlueprintRepair: Typed Local Edits for Failed Lean Proof Blueprintscited by 2
- 2026Sorries Are Not the Hard Part: An Expert-Review Case Study of a Semi-Autonomous Formalizationcited by 1
- 2026CAPRI: Contract-Aware Proof Repair for Isabellecited by 0
- 2026Compiler-Guided Adaptive Proof Search with Cross-Model Synergy on Context-Dependent Theorem Provingcited by 0
- 2026LeanPolish: Verified Supervision for Lean Proof Compressioncited by 0
- 2026LeanPolish: Verified Supervision for Lean Proof Compression29 Sep 2026
- 2026CAPRI: Contract-Aware Proof Repair for Isabelle13 Aug 2026
- 2026BlueprintRepair: Typed Local Edits for Failed Lean Proof Blueprints30 Jul 2026
- 2026Beyond the Library: An Agentic Framework for Autoformalizing Research Mathematics30 Jun 2026
- 2026Sorries Are Not the Hard Part: An Expert-Review Case Study of a Semi-Autonomous Formalization11 Jun 2026
- 2026Compiler-Guided Adaptive Proof Search with Cross-Model Synergy on Context-Dependent Theorem Proving4 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2025LeanProgress: Guiding Search for Neural Theorem Proving via Proof Progress Prediction
- 2024Lean-STaR: Learning to Interleave Thinking and Proving
- 2025ProofOptimizer: Training Language Models to Simplify Proofs without Human Demonstrations
- 2026Pythagoras-Prover: Advancing Efficient Formal Proving via Augmented Lean Formalisation
- 2026From Errors to Proofs: Minimal-Core-Guided Repair for Neuro-Symbolic Constraint Solving
- 2021Proof Artifact Co-training for Theorem Proving with Language Models
- 2025Premise Selection for a Lean Hammer
- 2026OProver: A Unified Framework for Agentic Formal Theorem Proving