mlsanityData to 14 Oct 2026

TheoremForge: Scaling up Formal Data Synthesis with Low-Budget Agentic Workflow

arXiv 2601.17332 ↗First posted 24 Jan 2026cs.AIcited by 1

On the map: LLM agents and tool use → Educational agents and math problem solving

also in 1 more
Abstract (arXiv)

The high cost of agentic workflows in formal mathematics hinders large-scale data synthesis, exacerbating the scarcity of open-source corpora. To address this, we introduce TheoremForge, a cost-effective formal data synthesis pipeline that decomposes the formalization process into five sub-tasks, which are textitstatement formalization, textitproof generation, textitpremise selection, textitproof correction and textitproof sketching. By implementing a textitDecoupled Extraction Strategy, the workflow recovers valid training signals from globally failed trajectories, effectively utilizing wasted computation. Experiments on a 2,000-problem benchmark demonstrate that TheoremForge achieves a Verified Rate of 12.6%, surpassing the 8.6% baseline, at an average cost of only 0.481 per successful trajectory using Gemini-3-Flash. Crucially, our strategy increases data yield by 1.6× for proof generation compared to standard filtering. These results establish TheoremForge as a scalable framework for constructing a data flywheel to train future expert models. Our code is available hrefhttps://github.com/timechess/TheoremForgehere.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Educational agents and math problem solving, one of 16 directions in LLM agents and tool use. Builds on 29 of its 39 references that are in the map. First posted on arXiv 24 Jan 2026.

Builds on

29 of 39 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025Aria: An Agent For Retrieval and Iterative Auto-Formalization via Dependency Graph6 Oct
  2. 2025Prover Agent: An Agent-Based Framework for Formal Mathematical Proofs24 Jun
  3. 2025RocqStar: Leveraging Similarity-driven Retrieval and Agentic Systems for Rocq generation28 May

Other references · 26

  1. 2024AFlow: Automating Agentic Workflow Generationcited by 432
  2. 2023LeanDojo: Theorem Proving with Retrieval-Augmented Language Modelscited by 427
  3. 2022Draft, Sketch, and Prove: Guiding Formal Theorem Provers with Informal Proofscited by 291
  4. 2025DeepMath-103K: A Large-Scale, Challenging, Decontaminated, and Verifiable Mathematical Dataset for Advancing Reasoningcited by 280
  5. 2024DeepSeek-Prover-V1.5: Harnessing Proof Assistant Feedback for Reinforcement Learning and Monte-Carlo Tree Searchcited by 197
  6. 2025Kimina-Prover Preview: Towards Large Formal Reasoning Models with Reinforcement Learningcited by 180
  7. 2025Multi-agent Architecture Search via Agentic Supernetcited by 179
  8. 2025Goedel-Prover-V2: Scaling Formal Theorem Proving with Scaffolded Data Synthesis and Self-Correctioncited by 154
  9. 2025Agentic Reasoning and Tool Integration for LLMs via Reinforcement Learningcited by 110
  10. 2024TheoremLlama: Transforming General-Purpose LLMs into Lean4 Expertscited by 59
  11. 2024Herald: A Natural Language Annotated Lean 4 Datasetcited by 59
  12. 2025EvoAgentX: An Automated Framework for Evolving Agentic Workflowscited by 44
14 more
  1. 2025APOLLO: Automated LLM and Lean Collaboration for Advanced Formal Reasoningcited by 35
  2. 2024A Semantic Search Engine for Mathlib4cited by 31
  3. 2025Scaling up Multi-Turn Off-Policy RL and Multi-Agent Tree Search for LLM Step-Proverscited by 28
  4. 2025FATE: A Formal Benchmark Series for Frontier Algebra of Multiple Difficulty Levelscited by 27
  5. 2025DyFlow: Dynamic Workflow Framework for Agentic Reasoningcited by 23
  6. 2025QualityFlow: An Agentic Workflow for Program Synthesis Controlled by LLM Quality Checkscited by 22
  7. 2025ReForm: Reflective Autoformalization with Prospective Bounded Sequence Optimizationcited by 20
  8. 2025ProofBridge: Auto-Formalization of Natural Language Proofs in Lean via Joint Embeddingscited by 18
  9. 2025Adaptive Self-improvement LLM Agentic System for ML Library Developmentcited by 16
  10. 2024Aristotle: Mastering Logical Reasoning with A Logic-Complete Decompose-Search-Resolve Frameworkcited by 15
  11. 2024Tree-of-Code: A Tree-Structured Exploring Framework for End-to-End Code Generation and Execution in Complex Task Handlingcited by 11
  12. 2025HybridProver: Augmenting Theorem Proving with LLM-Driven Proof Synthesis and Refinementcited by 6
  13. 2024Collaborative Mean Estimation Among Heterogeneous Strategic Agents: Individual Rationality, Fairness, and Truthful Contributioncited by 4
  14. 2025SymCode: A Neurosymbolic Approach to Mathematical Reasoning via Verifiable Code Generationcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Optimizing the Cost-Quality Tradeoff of Agentic Theorem Provers in Lean
  2. 2025LLM-based Automated Theorem Proving Hinges on Scalable Synthetic Data Generation
  3. 2026Compile to Compress: Boosting Formal Theorem Provers by Compiler Outputs
  4. 2026AoA: Theorem Proving Agent over Abstract Syntax Tree of Redesigned Language
  5. 2026M2F: Automated Formalization of Mathematical Literature at Scale
  6. 2026LEAP: Supercharging LLMs for Formal Mathematics with Agentic Frameworks
  7. 2025EvolProver: Advancing Automated Theorem Proving by Evolving Formalized Problems via Symmetry and Difficulty
  8. 2026MechMath: Sorrifier-Driven Formal Decomposition Workflow for Automated Theorem Proving