LeanFlow: A Case Study in Workflow-Driven Lean Autoformalization
On the map: LLM agents and tool use → Educational agents and math problem solving
Abstract (arXiv)
We present and evaluate LeanFlow, an LLM agent system specialized for translating mathematical papers into buildable Lean projects. Recent verifier-in-the-loop systems show that large formal artifacts can be produced, but it remains unclear which runtime mechanisms affect completion, auditability, or efficiency in document-to-project formalization. We study this question through case studies on two previously unformalized mathematical papers in number theory and measure theory, using model, proof-workflow, and toolset ablations with Kimi2.6 and GPT5.5; we report task outcome, API calls, input tokens, and output tokens. With Kimi2.6, the full workflow completes both document-level projects within the 2000-call budget, while no-queue variants reach the budget limit; with GPT5.5, all document-level variants complete, and the full workflow has the lowest or tied-lowest input-token cost on both sources. As complementary calibration, LeanFlow reaches 75.7% BEq+ on the PFR slice of RLM25 and solves all five ICML 2026 AI for Math TCS challenge projects in our GPT5.5 runs.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Educational agents and math problem solving, one of 16 directions in LLM agents and tool use. Builds on 7 of its 23 references that are in the map. First posted on arXiv 26 Jun 2026.
Builds on
7 of 23 references.
References · 7
- 2023LeanDojo: Theorem Proving with Retrieval-Augmented Language Modelscited by 427
- 2021MiniF2F: a cross-system benchmark for formal Olympiad-level mathematicscited by 391
- 2022Autoformalization with Large Language Modelscited by 263
- 2025FormalMATH: Benchmarking Formal Mathematical Reasoning of Large Language Modelscited by 48
- 2024Reliable Evaluation and Benchmarks for Statement Autoformalizationcited by 32
- 2026M2F: Automated Formalization of Mathematical Literature at Scalecited by 15
- 2025RLMEval: Evaluating Research-Level Neural Theorem Provingcited by 8
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Understanding Tool-Augmented Agents for Lean Formalization: A Factorial Analysis
- 2026From Static Templates to Dynamic Runtime Graphs: A Survey of Workflow Optimization for LLM Agents
- 2026FlowScout: From Execution Feedback to Reliable Tool-Using Agent Workflows
- 2026Lean4Agent: Formal Modeling and Verification for Agent Workflow and Trajectory
- 2026Beyond the Library: An Agentic Framework for Autoformalizing Research Mathematics
- 2026(Auto)formalization is supposed to be easy: Trellis process semantics for spelling out rigorous proofs
- 2026Complete Cyclic Subtask Graphs for Tool-Using LLM Agents: Flexibility, Cost, and Bottlenecks in Long-Horizon Workflows
- 2026WorkflowPerturb: Calibrated Stress Tests for Evaluating Multi-Agent Workflow Metrics