CAM-Bench: A Benchmark for Computational and Applied Mathematics in Lean
On the map: LLM reasoning → Mathematical reasoning
Abstract (arXiv)
Formal theorem-proving benchmarks enable mechanically verifiable evaluation of mathematical reasoning in large language models. However, existing benchmarks mainly focus on Olympiad-style problems and algebraic domains, leaving computational and applied mathematics underrepresented. We introduce CAM-Bench, a Lean 4 theorem-proving benchmark of 1,000 Lean proof targets in computational and applied mathematics, with coverage spanning optimization, numerical linear algebra, and numerical analysis. These problems are adapted from textbook exercises and often depend on locally introduced definitions, notation, algorithms, and elementary results. To construct CAM-Bench, we develop a dependency-recovery pipeline that reconstructs the local textbook context needed to state each problem faithfully. It then normalizes each problem into a standalone informal theorem and translates it into a Lean target. We validate the resulting formal problems through Lean compilation and semantic review, checking both formal correctness and semantic alignment with the original exercises. For each problem, we release the raw exercise, recovered context, normalized informal theorem, and final Lean target. CAM-Bench complements existing formal mathematics benchmarks by targeting applied mathematics problems that rely on textbook concepts and elementary theorems, many of which are not directly available as standard Mathlib4 lemmas. We evaluate widely used large language models and formalization agents on CAM-Bench, and analyze common failure modes in tracking local assumptions, applying elementary results, decomposing proofs, and maintaining long-horizon control in Lean.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 27 of its 85 references that are in the map. First posted on arXiv 17 May 2026.
Builds on
27 of 85 references.
Closest ancestors · 9
Same direction, newest first
- 2025Seed-Prover: Deep and Broad Reasoning for Automated Theorem Proving31 Jul
- 2025Solving Formal Math Problems by Decomposition and Iterative Reflection21 Jul
- 2025CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics6 May
- 2025FormalMATH: Benchmarking Formal Mathematical Reasoning of Large Language Models5 May
- 2025DeepSeek-Prover-V2: Advancing Formal Mathematical Reasoning via Reinforcement Learning for Subgoal Decomposition30 Apr
- 2025Kimina-Prover Preview: Towards Large Formal Reasoning Models with Reinforcement Learning15 Apr
- 2024Lean-STaR: Learning to Interleave Thinking and Proving14 Jul
- 2024Process-Driven Autoformalization in Lean 44 Jun
- 2020Generative Language Modeling for Automated Theorem Proving7 Sep
Other references · 18
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2024OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problemscited by 1,099
- 2023LeanDojo: Theorem Proving with Retrieval-Augmented Language Modelscited by 414
- 2021MiniF2F: a cross-system benchmark for formal Olympiad-level mathematicscited by 380
- 2022Autoformalization with Large Language Modelscited by 252
- 2022HyperTree Proof Search for Neural Theorem Provingcited by 192
- 2024DeepSeek-Prover-V1.5: Harnessing Proof Assistant Feedback for Reinforcement Learning and Monte-Carlo Tree Searchcited by 189
- 2023ProofNet: Autoformalizing and Formally Proving Undergraduate-Level Mathematicscited by 180
- 2024PutnamBench: Evaluating Neural Theorem-Provers on the Putnam Mathematical Competitioncited by 153
- 2025Goedel-Prover-V2: Scaling Formal Theorem Proving with Scaffolded Data Synthesis and Self-Correctioncited by 140
- 2025BFS-Prover: Scalable Best-First Tree Search for LLM-based Automatic Theorem Provingcited by 82
6 more
- 2023FIMO: A Challenge Formal Dataset for Automated Theorem Provingcited by 54
- 2024InternLM2.5-StepProver: Advancing Automated Theorem Proving via Critic-Guided Searchcited by 34
- 2025FATE: A Formal Benchmark Series for Frontier Algebra of Multiple Difficulty Levelscited by 23
- 2025RLMEval: Evaluating Research-Level Neural Theorem Provingcited by 6
- 2025Evaluating Autoformalization Robustness via Semantically Similar Paraphrasingcited by 6
- 2026FormalProofBench: Can Models Write Graduate Level Math Proofs That Are Formally Verified?cited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Construction-Verification: A Benchmark for Applied Mathematics in Lean 4
- 2026TheoremBench: Evaluating LLMs on Theorem Proving in Formal Mathematics
- 2026SorryDB: Can AI Provers Complete Real-World Lean Theorems?
- 2025A Combinatorial Identities Benchmark for Theorem Proving via Automated Theorem Generation
- 2026LEAP: Supercharging LLMs for Formal Mathematics with Agentic Frameworks
- 2025Lean Meets Theoretical Computer Science: Scalable Synthesis of Theorem Proving Challenges in Formal-Informal Pairs
- 2026MA-ProofBench: A Two-Tiered Evaluation of LLMs for Theorem Proving in Mathematical Analysis
- 2025REAL-Prover: Retrieval Augmented Lean Prover for Mathematical Reasoning