ProofFlow: A Dependency Graph Approach to Faithful Proof Autoformalization
Not on the map. Why?
Abstract (arXiv)
Proof autoformalization, the task of translating natural language theorems and proofs into machine-verifiable code, is a critical step for integrating large language models into rigorous mathematical workflows. Current approaches focus on producing executable code, but they frequently fail to preserve the semantic meaning and logical structure of the original human-written argument. To address this, we introduce ProofFlow, a novel pipeline that treats structural fidelity as a primary objective. ProofFlow first constructs a directed acyclic graph (DAG) to map the logical dependencies between proof steps. Then, it employs a novel lemma-based approach to systematically formalize each step as an intermediate lemma, preserving the logical structure of the original argument. To facilitate evaluation, we present a new benchmark of 184 undergraduate-level problems, manually annotated with step-by-step solutions and logical dependency graphs, and introduce ProofScore, a new composite metric to evaluate syntactic correctness, semantic faithfulness, and structural fidelity. Experimental results show our pipeline sets a new state-of-the-art for autoformalization, achieving a ProofScore of 0.545, substantially exceeding baselines like full-proof formalization (0.123), which processes the entire proof at once, and step-proof formalization (0.072), which handles each step independently. Our pipeline, benchmark, and score metric are open-sourced to encourage further progress at https://github.com/Huawei-AI4Math/ProofFlow.
Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). Builds on 27 of its 37 references that are in the map. First posted on arXiv 13 Oct 2025.
Builds on
27 of 37 references.
References · 27
- 2022Draft, Sketch, and Prove: Guiding Formal Theorem Provers with Informal Proofscited by 291
- 2025DeepSeek-Prover-V2: Advancing Formal Mathematical Reasoning via Reinforcement Learning for Subgoal Decompositioncited by 287
- 2022Autoformalization with Large Language Modelscited by 263
- 2025Kimina-Prover Preview: Towards Large Formal Reasoning Models with Reinforcement Learningcited by 180
- 2025Goedel-Prover-V2: Scaling Formal Theorem Proving with Scaffolded Data Synthesis and Self-Correctioncited by 154
- 2025Seed-Prover: Deep and Broad Reasoning for Automated Theorem Provingcited by 101
- 2021NaturalProofs: Mathematical Theorem Proving in Natural Languagecited by 81
- 2024Herald: A Natural Language Annotated Lean 4 Datasetcited by 59
- 2024Don't Trust: Verify -- Grounding LLM Quantitative Reasoning with Autoformalizationcited by 55
- 2025FormalMATH: Benchmarking Formal Mathematical Reasoning of Large Language Modelscited by 48
- 2024Process-Driven Autoformalization in Lean 4cited by 45
- 2015A formal proof of the Kepler conjecturecited by 42
15 more
- 2025Solving Formal Math Problems by Decomposition and Iterative Reflectioncited by 35
- 2024Reliable Evaluation and Benchmarks for Statement Autoformalizationcited by 32
- 2025Prover Agent: An Agent-Based Framework for Formal Mathematical Proofscited by 31
- 2023Towards Autoformalization of Mathematics and Code Correctness: Experiments with Elementary Proofscited by 27
- 2025ATLAS: Autoformalizing Theorems through Lifting, Augmentation, and Synthesis of Datacited by 23
- 2025Solving Inequality Proofs with Large Language Modelscited by 21
- 2025Mathesis: Towards Formal Theorem Proving from Natural Languagescited by 18
- 2025Reviving DSP for Advanced Theorem Proving in the Era of Reasoning Modelscited by 17
- 2025StepFun-Formalizer: Unlocking the Autoformalization Potential of LLMs through Knowledge-Reasoning Fusioncited by 16
- 2025StepFun-Prover Preview: Let's Think and Verify Step by Stepcited by 13
- 2023A New Approach Towards Autoformalizationcited by 10
- 2024GFLean: An Autoformalisation Framework for Lean via GFcited by 9
- 2025FormaRL: Enhancing Autoformalization with no Labeled Datacited by 9
- 2025Towards Solving More Challenging IMO Problems via Decoupled Reasoning and Provingcited by 7
- 2025StepProof: Step-by-step verification of natural language mathematical proofscited by 6
Built on by
Citing papers per year: 2026: 21.
21 papers.
Sort:
By area:
- 2026M2F: Automated Formalization of Mathematical Literature at Scalecited by 15
- 2026Faults in Our Formal Benchmarking: Dataset Defects and Evaluation Failures in Lean Theorem Provingcited by 9
- 2026MathAtlas: A Benchmark for Autoformalization in the Wildcited by 4
- 2026On Time, Within Budget: Constraint-Driven Online Resource Allocation for Agentic Workflowscited by 3
- 2026COMPOSE: Composing Future Theorems from Citations and Formal Structurecited by 3
- 2026Theory-Level Autoformalization: From Isolated Statements to Unified Formal Knowledge Basescited by 3
- 2026Efficient Test-Time Optimization for Multi-Agent Proof Autoformalizationcited by 2
- 2026VALG: An Agentic System for ML Theory Researchcited by 2
- 2026Does the Proof Prove It That Way? Faithful Formalization of Elements Proofscited by 2
- 2026Decompose, Structure, and Repair: A Neuro-Symbolic Framework for Autoformalization via Operator Treescited by 1
- 2026Benchmarking Testing in Automated Theorem Provingcited by 1
- 2026What are the Right Symmetries for Formal Theorem Proving?cited by 1
9 more
- 2026CausalSmith: A Formally Grounded, Self-Improving Agentic Framework for Automated Research in Causal Inferencecited by 1
- 2026Rethinking Supervision Granularity: Segment-Level Learning for LLM-Based Theorem Provingcited by 0
- 2026Evaluating the Robustness of Proof Autoformalization in Lean 4cited by 0
- 2026Formalize Once, Edit the Rest: Efficient Lean-Based Answer Selection for Math Reasoningcited by 0
- 2026ProofLoom: Proof-Obligation-Driven Theory Construction for Autoformalizing Research-Level Stochastic Optimizationcited by 0
- 2026Fyan: A Human--AI Harness with Semantic Auditing for Document-Level Formalizationcited by 0
- 2026AIProver: Agentic Auto-Formalization of Mathematical Research via Certificate-Driven Evolving Harnesscited by 0
- 2026claimcheck: Measuring and Improving Specification Faithfulnesscited by 0
- 2026Beyond LLM Judge: Mechanical Verification for Agentic Autoformalizationcited by 0
- 2026Beyond LLM Judge: Mechanical Verification for Agentic Autoformalization14 Oct 2026
- 2026claimcheck: Measuring and Improving Specification Faithfulness12 Oct 2026
- 2026AIProver: Agentic Auto-Formalization of Mathematical Research via Certificate-Driven Evolving Harness4 Oct 2026
- 2026Fyan: A Human--AI Harness with Semantic Auditing for Document-Level Formalization30 Sep 2026
- 2026ProofLoom: Proof-Obligation-Driven Theory Construction for Autoformalizing Research-Level Stochastic Optimization28 Sep 2026
- 2026Does the Proof Prove It That Way? Faithful Formalization of Elements Proofs15 Aug 2026
- 2026VALG: An Agentic System for ML Theory Research13 Aug 2026
- 2026CausalSmith: A Formally Grounded, Self-Improving Agentic Framework for Automated Research in Causal Inference24 Jul 2026
- 2026Theory-Level Autoformalization: From Isolated Statements to Unified Formal Knowledge Bases14 Jul 2026
- 2026Efficient Test-Time Optimization for Multi-Agent Proof Autoformalization13 Jul 2026
- 2026Faults in Our Formal Benchmarking: Dataset Defects and Evaluation Failures in Lean Theorem Proving28 Jun 2026
- 2026Formalize Once, Edit the Rest: Efficient Lean-Based Answer Selection for Math Reasoning14 Jun 2026
9 more
- 2026Evaluating the Robustness of Proof Autoformalization in Lean 412 Jun 2026
- 2026COMPOSE: Composing Future Theorems from Citations and Formal Structure28 May 2026
- 2026What are the Right Symmetries for Formal Theorem Proving?21 May 2026
- 2026MathAtlas: A Benchmark for Autoformalization in the Wild13 May 2026
- 2026Rethinking Supervision Granularity: Segment-Level Learning for LLM-Based Theorem Proving12 May 2026
- 2026On Time, Within Budget: Constraint-Driven Online Resource Allocation for Agentic Workflows7 May 2026
- 2026Benchmarking Testing in Automated Theorem Proving26 Apr 2026
- 2026Decompose, Structure, and Repair: A Neuro-Symbolic Framework for Autoformalization via Operator Trees21 Apr 2026
- 2026M2F: Automated Formalization of Mathematical Literature at Scale19 Feb 2026
- 2026On Time, Within Budget: Constraint-Driven Online Resource Allocation for Agentic Workflowscited by 3
- 2026VALG: An Agentic System for ML Theory Researchcited by 2
- 2026CausalSmith: A Formally Grounded, Self-Improving Agentic Framework for Automated Research in Causal Inferencecited by 1
- 2026AIProver: Agentic Auto-Formalization of Mathematical Research via Certificate-Driven Evolving Harnesscited by 0
- 2026Beyond LLM Judge: Mechanical Verification for Agentic Autoformalizationcited by 0
- 2026Beyond LLM Judge: Mechanical Verification for Agentic Autoformalization14 Oct 2026
- 2026AIProver: Agentic Auto-Formalization of Mathematical Research via Certificate-Driven Evolving Harness4 Oct 2026
- 2026VALG: An Agentic System for ML Theory Research13 Aug 2026
- 2026CausalSmith: A Formally Grounded, Self-Improving Agentic Framework for Automated Research in Causal Inference24 Jul 2026
- 2026On Time, Within Budget: Constraint-Driven Online Resource Allocation for Agentic Workflows7 May 2026
- 2026M2F: Automated Formalization of Mathematical Literature at Scalecited by 15
- 2026Faults in Our Formal Benchmarking: Dataset Defects and Evaluation Failures in Lean Theorem Provingcited by 9
- 2026MathAtlas: A Benchmark for Autoformalization in the Wildcited by 4
- 2026COMPOSE: Composing Future Theorems from Citations and Formal Structurecited by 3
- 2026Theory-Level Autoformalization: From Isolated Statements to Unified Formal Knowledge Basescited by 3
- 2026Does the Proof Prove It That Way? Faithful Formalization of Elements Proofscited by 2
- 2026Decompose, Structure, and Repair: A Neuro-Symbolic Framework for Autoformalization via Operator Treescited by 1
- 2026Benchmarking Testing in Automated Theorem Provingcited by 1
- 2026What are the Right Symmetries for Formal Theorem Proving?cited by 1
- 2026Evaluating the Robustness of Proof Autoformalization in Lean 4cited by 0
- 2026ProofLoom: Proof-Obligation-Driven Theory Construction for Autoformalizing Research-Level Stochastic Optimizationcited by 0
- 2026Fyan: A Human--AI Harness with Semantic Auditing for Document-Level Formalizationcited by 0
12 most cited of 13 All 13 (JSON)
- 2026claimcheck: Measuring and Improving Specification Faithfulness12 Oct 2026
- 2026Fyan: A Human--AI Harness with Semantic Auditing for Document-Level Formalization30 Sep 2026
- 2026ProofLoom: Proof-Obligation-Driven Theory Construction for Autoformalizing Research-Level Stochastic Optimization28 Sep 2026
- 2026Does the Proof Prove It That Way? Faithful Formalization of Elements Proofs15 Aug 2026
- 2026Theory-Level Autoformalization: From Isolated Statements to Unified Formal Knowledge Bases14 Jul 2026
- 2026Faults in Our Formal Benchmarking: Dataset Defects and Evaluation Failures in Lean Theorem Proving28 Jun 2026
- 2026Evaluating the Robustness of Proof Autoformalization in Lean 412 Jun 2026
- 2026COMPOSE: Composing Future Theorems from Citations and Formal Structure28 May 2026
- 2026What are the Right Symmetries for Formal Theorem Proving?21 May 2026
- 2026MathAtlas: A Benchmark for Autoformalization in the Wild13 May 2026
- 2026Benchmarking Testing in Automated Theorem Proving26 Apr 2026
- 2026Decompose, Structure, and Repair: A Neuro-Symbolic Framework for Autoformalization via Operator Trees21 Apr 2026
12 newest of 13 All 13 (JSON)