mlsanityData to 7 Oct 2026

Magenta: Closing the Loop Between Mathematical Reasoning and Lean Verification

arXiv 2609.11319 ↗First posted 10 Sep 2026cs.AIcited by 0

On the map: LLM reasoning → Mathematical reasoning

Abstract (arXiv)

Most of mathematical knowledge has been communicated through so-called informal use of mathematics and natural language. With large language models (LLMs) being highly adept in using natural language, they achieve strong performance, yet not perfect, in informal mathematical reasoning. Restraining LLMs to informal reasoning misses out on the opportunity to use the discrete verification abilities that machines offer through machine-checkable proofs. In this paper, we bridge the gap between informal and formal reasoning by integrating Lean signals into the informal reasoning process. We introduce Magenta, a training-free agentic pipeline that, given only a natural-language problem, produces an answer, expresses it as a Lean 4 statement, and constructs a machine-checked proof. A statement judge verifies whether the formalisation preserves the original problem, while an error-attribution judge routes failed attempts either to mathematical re-derivation or local Lean repair. Magenta achieves 100% accuracy across all evaluated olympiad benchmarks, including AIME 2025, AIME 2026, and HMMT February 2026. When paired with the open-weight K2-Horizon-7B reasoner, it solves all six IMO 2026 problems. Our analysis shows that statement adjudication is essential for preventing false certificates and that feedback-guided correction outperforms independent resampling on difficult problems.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 21 of its 52 references that are in the map. First posted on arXiv 10 Sep 2026.

Builds on

21 of 52 references.

Closest ancestors · 7

Same direction, newest first

  1. 2026FaithformBench: Benchmarking Faithfulness of Mathematical Chain-of-Thought Autoformalisation11 Aug
  2. 2026Pythagoras-Prover: Advancing Efficient Formal Proving via Augmented Lean Formalisation10 Jun
  3. 2026Risk-Controlled Lean-as-Judge for Natural-Language Mathematical Reasoning27 May
  4. 2026Advancing Mathematics Research with AI-Driven Formal Proof Search21 May
  5. 2026Rethinking Math Reasoning Evaluation: A Robust LLM-as-a-Judge Framework Beyond Symbolic Rigidity24 Apr
  6. 2026Pipeline for Verifying LLM-Generated Mathematical Solutions24 Feb
  7. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models5 Feb

Other references · 14

  1. 2025OpenAI GPT-5 System Cardcited by 910
  2. 2024Skywork-Reward: Bag of Tricks for Reward Modeling in LLMscited by 322
  3. 2024DeepSeek-Prover: Advancing Theorem Proving in LLMs through Large-Scale Synthetic Datacited by 225
  4. 2025A Survey on Test-Time Scaling in Large Language Models: What, How, Where, and How Well?cited by 215
  5. 2025Big-Math: A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Modelscited by 104
  6. 2026Kimi K3: Open Frontier Intelligencecited by 99
  7. 2025Winning Gold at IMO 2025 with a Model-Agnostic Verification-and-Refinement Pipelinecited by 79
  8. 2025Seed-Prover 1.5: Mastering Undergraduate-Level Theorem Proving via Learning from Experiencecited by 36
  9. 2026LongCat-Flash-Prover: Advancing Native Formal Reasoning via Agentic Tool-Integrated Reinforcement Learningcited by 6
  10. 2026OProver: A Unified Framework for Agentic Formal Theorem Provingcited by 6
  11. 2026Moonshine: An Autonomous Mathematical Research Agent Centered on Conjecture Generationcited by 4
  12. 2026Evaluation of LLMs for Mathematical Formalization in Leancited by 2
2 more
  1. 2026From Solvers to Research: Large Language Model-Driven Formal Mathematics at the Research Frontiercited by 1
  2. 2026AoA: Theorem Proving Agent over Abstract Syntax Tree of Redesigned Languagecited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026LEAP: Supercharging LLMs for Formal Mathematics with Agentic Frameworks
  2. 2025Hilbert: Recursively Building Formal Proofs with Informal Reasoning
  3. 2024LeanAgent: Lifelong Learning for Formal Theorem Proving
  4. 2025HERMES: Towards Efficient and Verifiable Mathematical Reasoning in LLMs
  5. 2025FormalMATH: Benchmarking Formal Mathematical Reasoning of Large Language Models
  6. 2026Numina-Lean-Agent: An Open and General Agentic Reasoning System for Formal Mathematics
  7. 2025Formally Solving Answer-Construction Problems in Lean
  8. 2025APOLLO: Automated LLM and Lean Collaboration for Advanced Formal Reasoning