mlsanityData to 7 Oct 2026

Sage: Formalization with Semantic Correction

arXiv 2609.35790 ↗First posted 16 Sep 2026cs.LG cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

While neural theorem provers have achieved impressive milestones in formal mathematics, they largely operate on the assumption that faithful Lean 4 formal statements are already provided. Translating informal natural language into a formal language is a critical data bottleneck plagued by an "illusion of rigor": standard type-checkers accept statements that compile but drop hypotheses, introduce vacuous truths, or subtly alter mathematical bounds. To resolve this, we introduce Sage (Semantic Agent-Guided Formalization Engine), an agentic framework that replaces monolithic translation with a four-stage decomposed generation pipeline coupled with a dual-signal semantic correction loop. By pairing Lean 4 compiler diagnostics with multi-dimensional semantic feedback, our correction loop enforces mathematical fidelity alongside syntactic validity. By explicitly accounting for the gap between open-ended queries and declarative formal targets, our pipeline prevents models from achieving high formalization rates by guessing unverified answers (exhibiting a 70.9% answer leakage rate in monolithic baselines). Consequently, Sage suppresses leakage to 2.7% while achieving 73.3% pass@4 joint compilation and semantic fidelity on the Omni-MATH without proofs (compared to 42.0% for a fine-tuned Goedel-Formalizer-V2 baseline). Finally, on IMO-Unformalized, a novel frontier of 175 unformalized International Mathematical Olympiad problems, Sage demonstrates effective zero-shot generalization with 87.4% pass@4 verified fidelity compared to just 19.4% for the baseline, winning over 79% of blind pairwise evaluations.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 29 of its 40 references that are in the map. First posted on arXiv 16 Sep 2026.

Builds on

29 of 40 references.

References · 29

  1. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  2. 2023Let's Verify Step by Stepcited by 3,598
  3. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  4. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
  5. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
  6. 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 751
  7. 2023LeanDojo: Theorem Proving with Retrieval-Augmented Language Modelscited by 414
  8. 2023Llemma: An Open Language Model For Mathematicscited by 385
  9. 2025DeepSeek-Prover-V2: Advancing Formal Mathematical Reasoning via Reinforcement Learning for Subgoal Decompositioncited by 270
  10. 2022Autoformalization with Large Language Modelscited by 252
  11. 2022HyperTree Proof Search for Neural Theorem Provingcited by 192
  12. 2023ProofNet: Autoformalizing and Formally Proving Undergraduate-Level Mathematicscited by 180
17 more
  1. 2019The Lean mathematical librarycited by 127
  2. 2024Code Generation with AlphaCodium: From Prompt Engineering to Flow Engineeringcited by 100
  3. 2025Seed-Prover: Deep and Broad Reasoning for Automated Theorem Provingcited by 96
  4. 2023FIMO: A Challenge Formal Dataset for Automated Theorem Provingcited by 54
  5. 2024Don't Trust: Verify -- Grounding LLM Quantitative Reasoning with Autoformalizationcited by 53
  6. 2018First Experiments with Neural Translation of Informal to Formal Mathematicscited by 52
  7. 2024Process-Driven Autoformalization in Lean 4cited by 45
  8. 2024Autoformalize Mathematical Statements by Symbolic Equivalence and Semantic Consistencycited by 39
  9. 2025Solving Formal Math Problems by Decomposition and Iterative Reflectioncited by 35
  10. 2024Reliable Evaluation and Benchmarks for Statement Autoformalizationcited by 25
  11. 2024FormalAlign: Automated Alignment Evaluation for Autoformalizationcited by 19
  12. 2025Aria: An Agent For Retrieval and Iterative Auto-Formalization via Dependency Graphcited by 18
  13. 2025ReForm: Reflective Autoformalization with Prospective Bounded Sequence Optimizationcited by 18
  14. 2025miniF2F-Lean Revisited: Reviewing Limitations and Charting a Path Forwardcited by 13
  15. 2026Faults in Our Formal Benchmarking: Dataset Defects and Evaluation Failures in Lean Theorem Provingcited by 7
  16. 2026Beyond Compilation: Evaluating Faithful Natural-Language-to-Lean Statement Formalizationcited by 4
  17. 2026SHADOWBENCH: Toward Reliable Automatic Evaluation of Semantic Alignment in Autoformalizationcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Hilbert: Recursively Building Formal Proofs with Informal Reasoning
  2. 2025FormalMATH: Benchmarking Formal Mathematical Reasoning of Large Language Models
  3. 2026Beyond the Library: An Agentic Framework for Autoformalizing Research Mathematics
  4. 2026TheoremForge: Scaling up Formal Data Synthesis with Low-Budget Agentic Workflow
  5. 2026Neuro-Formal Verification: Agentic Language-Agnostic Formal Program Reasoning
  6. 2025HERMES: Towards Efficient and Verifiable Mathematical Reasoning in LLMs
  7. 2026LAMP: Lean-based Agentic framework with MCP and Proof Repair
  8. 2025Prover Agent: An Agent-Based Framework for Formal Mathematical Proofs