Construction-Verification: A Benchmark for Applied Mathematics in Lean 4
Not on the map. Why?
Abstract (arXiv)
Recent advances in large language models have demonstrated impressive capabilities in mathematical formalization. However, existing benchmarks focus on logical verification of declarative propositions, often neglecting the task of explicitly synthesizing solutions. This limitation is particularly acute in applied mathematics domains, where the goal is frequently to derive concrete values or executable algorithms rather than solely proving theorems. To address this, we introduce a Lean 4 framework that enforces a construction-verification workflow, compelling the agent to define explicit solutions before proving their correctness. We curate a comprehensive benchmark AMBER (Applied Mathematics BEnchmark for Reasoning) spanning core domains of applied mathematics, including convex analysis, optimization, numerical algebra, and high-dimensional probability. Aside from theorem proving, our benchmark features complex tasks such as evaluation, algorithm design, and representation transformation. Experiments reveal that current models face significant difficulties with these constructive tasks. Notably, we observe that general-purpose reasoning models consistently outperform specialized theorem provers. We attribute this to a degradation of instruction following capabilities in specialized models. Fine-tuning on proof corpora appears to induce ``tactical overfitting", compromising the ability to adhere to complex constructive requirements, whereas general models retain the versatility needed for multi-task formal reasoning.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). First posted on arXiv 1 Feb 2026.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026CAM-Bench: A Benchmark for Computational and Applied Mathematics in Lean
- 2026LEAP: Supercharging LLMs for Formal Mathematics with Agentic Frameworks
- 2025Solving Formal Math Problems by Decomposition and Iterative Reflection
- 2026FormalProofBench: Can Models Write Graduate Level Math Proofs That Are Formally Verified?
- 2026TheoremBench: Evaluating LLMs on Theorem Proving in Formal Mathematics
- 2025REAL-Prover: Retrieval Augmented Lean Prover for Mathematical Reasoning
- 2026AXLE: A Cloud Infrastructure for Lean 4 Theorem Proving Utilities
- 2026AdvancedMathBench: A Benchmark Suite for Advanced Mathematical Proof Generation and Verification