Formally Solving Answer-Construction Problems in Lean
On the map: LLM reasoning → Mathematical reasoning
Abstract (arXiv)
Large language models (LLMs) have achieved remarkable progress in formal mathematical reasoning. Mathematical competition problems fall into two broad types: theorem-proving problems ask for a proof of a fully specified statement, whereas answer-construction problems ask the solver to construct an answer object and prove that it satisfies the stated specification. Existing mathematical reasoning engines mainly target theorem-proving problems, yet answer-construction problems remain less studied. This setting is challenging because model capabilities are misaligned, with general LLMs better suited to answer construction and prover LLMs better suited to proof generation, and because Lean proof checking alone does not rule out inadmissible circular witnesses. To close this gap, we introduce Enumerate-Conjecture-Prove (ECP), a neuro-symbolic framework for solving answer-construction problems in Lean. ECP uses general LLMs to perform bounded enumeration and construct candidate answers, and invokes prover LLMs to produce machine-checked proofs. ECP introduces admissibility checking to ensure that each answer is canonical and does not involve a circular argument. On answer-construction problems from PutnamBench and autoformalized MathArena, ECP formally solves 17/346 PutnamBench instances and 18/75 MathArena instances with admissible answers and proofs, outperforming LLM baselines at aligned inference budgets.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 28 of its 62 references that are in the map. First posted on arXiv 24 May 2025.
Builds on
28 of 62 references.
Closest ancestors · 6
Same direction, newest first
- 2025DeepSeek-Prover-V2: Advancing Formal Mathematical Reasoning via Reinforcement Learning for Subgoal Decomposition30 Apr
- 2025Kimina-Prover Preview: Towards Large Formal Reasoning Models with Reinforcement Learning15 Apr
- 2025Proof or Bluff? Evaluating LLMs on 2025 USA Math Olympiad27 Mar
- 2024Formal Mathematical Reasoning: A New Frontier in AI20 Dec
- 2024Herald: A Natural Language Annotated Lean 4 Dataset9 Oct
- 2024InternLM-Math: Open Math Large Language Models Toward Verifiable Reasoning9 Feb
Other references · 22
- 2025Qwen3 Technical Reportcited by 8,820
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2022Training Compute-Optimal Large Language Modelscited by 3,019
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
- 2023LeanDojo: Theorem Proving with Retrieval-Augmented Language Modelscited by 427
- 2021MiniF2F: a cross-system benchmark for formal Olympiad-level mathematicscited by 391
- 2022Draft, Sketch, and Prove: Guiding Formal Theorem Provers with Informal Proofscited by 291
- 2024DeepSeek-Prover: Advancing Theorem Proving in LLMs through Large-Scale Synthetic Datacited by 234
- 2024DeepSeek-Prover-V1.5: Harnessing Proof Assistant Feedback for Reinforcement Learning and Monte-Carlo Tree Searchcited by 197
- 2023ProofNet: Autoformalizing and Formally Proving Undergraduate-Level Mathematicscited by 192
- 2024PutnamBench: Evaluating Neural Theorem-Provers on the Putnam Mathematical Competitioncited by 165
10 more
- 2019The Lean mathematical librarycited by 134
- 2024Lean Workbook: A large-scale Lean problem set formalized from natural language math problemscited by 122
- 2025Gold-medalist Performance in Solving Olympiad Geometry with AlphaGeometry2cited by 97
- 2023FIMO: A Challenge Formal Dataset for Automated Theorem Provingcited by 55
- 2024Proving Olympiad Algebraic Inequalities without Human Demonstrationscited by 20
- 2020Manthan: A Data Driven Approach for Boolean Function Synthesiscited by 11
- 2025Lean-auto: An Interface between Lean 4 and Automated Theorem Proverscited by 6
- 2018Functional Synthesis via Input-Output Separationcited by 3
- 2025Beyond Theorem Proving: Formulation, Framework and Benchmark for Formal Problem-Solvingcited by 2
- 2022HOLL: Program Synthesis for Higher OrderLogic Lockingcited by 1
Built on by
Citing papers per year: 2025: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Magenta: Closing the Loop Between Mathematical Reasoning and Lean Verification
- 2026Formalize Once, Edit the Rest: Efficient Lean-Based Answer Selection for Math Reasoning
- 2025LeanProgress: Guiding Search for Neural Theorem Proving via Proof Progress Prediction
- 2026Advancing Mathematics Research with AI-Driven Formal Proof Search
- 2026LEAP: Supercharging LLMs for Formal Mathematics with Agentic Frameworks
- 2025REAL-Prover: Retrieval Augmented Lean Prover for Mathematical Reasoning
- 2025Hilbert: Recursively Building Formal Proofs with Informal Reasoning
- 2026Risk-Controlled Lean-as-Judge for Natural-Language Mathematical Reasoning