mlsanityData to 7 Oct 2026

LongCat-Flash-Prover: Advancing Native Formal Reasoning via Agentic Tool-Integrated Reinforcement Learning

arXiv 2603.21065 ↗First posted 22 Mar 2026cs.AI cs.CLcited by 6

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

also in 1 more
Abstract (arXiv)

We introduce LongCat-Flash-Prover, a flagship 560-billion-parameter open-source Mixture-of- Experts (MoE) model that advances Native Formal Reasoning in Lean4 through agentic tool-integrated reasoning (TIR). We decompose the native formal reasoning task into three independent formal capabilities, i.e., auto-formalization, sketching, and proving. To facilitate these capabilities, we propose a Hybrid-Experts Iteration Framework to expand high-quality task trajectories, including generating a formal statement based on a given informal problem, producing a whole-proof directly from the statement, or a lemma-style sketch. During agentic RL, we present a Hierarchical Importance Sampling Policy Optimization (HisPO) algorithm, which aims to stabilize the MoE model training on such long-horizon tasks. It employs a gradient masking strategy that accounts for the policy staleness and the inherent train-inference engine discrepancies at both sequence and token levels. Additionally, we also incorporate theorem consistency and legality detection mechanisms to eliminate reward hacking issues. Extensive evaluations show that our LongCat-Flash-Prover sets a new state-of-the-art for open-weights models in both auto-formalization and theorem proving. Demonstrating remarkable sample efficiency, it achieves a 97.1% pass rate on MiniF2F-Test using only 72 inference budget per problem. On more challenging benchmarks, it solves 70.8% of ProverBench and 41.5% of PutnamBench with no more than 220 attempts per problem, significantly outperforming existing open-weights baselines.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 46 of its 60 references that are in the map. First posted on arXiv 22 Mar 2026.

Builds on

46 of 60 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Introducing LongCat-Flash-Thinking: A Technical Report23 Sep

Other references · 45

  1. 2017Proximal Policy Optimization Algorithmscited by 14,441
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  4. 2025Qwen3 Technical Reportcited by 8,195
  5. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  6. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  7. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  8. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  9. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
  10. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
  11. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
  12. 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,829
33 more
  1. 2025Understanding R1-Zero-Like Training: A Critical Perspectivecited by 1,276
  2. 2025Group Sequence Policy Optimizationcited by 788
  3. 2021MiniF2F: a cross-system benchmark for formal Olympiad-level mathematicscited by 380
  4. 2022Draft, Sketch, and Prove: Guiding Formal Theorem Provers with Informal Proofscited by 278
  5. 2025DeepSeek-Prover-V2: Advancing Formal Mathematical Reasoning via Reinforcement Learning for Subgoal Decompositioncited by 270
  6. 2022HyperTree Proof Search for Neural Theorem Provingcited by 192
  7. 2025Kimina-Prover Preview: Towards Large Formal Reasoning Models with Reinforcement Learningcited by 173
  8. 2024PutnamBench: Evaluating Neural Theorem-Provers on the Putnam Mathematical Competitioncited by 153
  9. 2019Mastering Complex Control in MOBA Games with Deep Reinforcement Learningcited by 150
  10. 2025Goedel-Prover-V2: Scaling Formal Theorem Proving with Scaffolded Data Synthesis and Self-Correctioncited by 140
  11. 2021Proof Artifact Co-training for Theorem Proving with Language Modelscited by 130
  12. 2025Reinforcement Learning with Verifiable Rewards: GRPO's Effective Loss, Dynamics, and Success Amplificationcited by 108
  13. 2025Self-Evolving Curriculum for LLM Reasoningcited by 107
  14. 2025STP: Self-play LLM Theorem Provers with Iterative Conjecturing and Provingcited by 77
  15. 2025Towards Robust Mathematical Reasoningcited by 67
  16. 2024TheoremLlama: Transforming General-Purpose LLMs into Lean4 Expertscited by 58
  17. 2025Scaling Laws for Native Multimodal Modelscited by 47
  18. 2025FormalMATH: Benchmarking Formal Mathematical Reasoning of Large Language Modelscited by 45
  19. 2025AMO-Bench: Large Language Models Still Struggle in High School Math Competitionscited by 36
  20. 2025Solving Formal Math Problems by Decomposition and Iterative Reflectioncited by 35
  21. 2024HunyuanProver: A Scalable Data Synthesis Framework and Guided Tree Search for Automated Theorem Provingcited by 32
  22. 2025CombiBench: Benchmarking LLM Capability for Combinatorial Mathematicscited by 28
  23. 2025Leanabell-Prover-V2: Verifier-integrated Reasoning for Formal Theorem Proving via Reinforcement Learningcited by 26
  24. 2025Scaling up Multi-Turn Off-Policy RL and Multi-Agent Tree Search for LLM Step-Proverscited by 26
  25. 2025OJBench: A Competition Level Code Benchmark For Large Language Modelscited by 22
  26. 2025StepFun-Formalizer: Unlocking the Autoformalization Potential of LLMs through Knowledge-Reasoning Fusioncited by 15
  27. 2025StepFun-Prover Preview: Let's Think and Verify Step by Stepcited by 12
  28. 2026ARLArena: A Unified Framework for Stable Agentic Reinforcement Learningcited by 11
  29. 2025Autoformalizer with Tool Feedbackcited by 7
  30. 2025R-Horizon: How Far Can Your Large Reasoning Model Really Go in Breadth and Depth?cited by 7
  31. 2024Self-Evolutionary Large Language Models through Uncertainty-Enhanced Preference Optimizationcited by 6
  32. 20243D-Prover: Diversity Driven Theorem Proving With Determinantal Point Processescited by 6
  33. 2025Do Large Language Models Excel in Complex Logical Reasoning with Formal Language?cited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026LongCat-Flash-Thinking-2601 Technical Report
  2. 2026Scaling the Scaling Logic: Agentic Meta-Synthesis of Logic Reasoning
  3. 2025AlphaApollo: A System for Deep Agentic Reasoning
  4. 2025AutoTool: Dynamic Tool Selection and Integration for Agentic Reasoning
  5. 2025Local Look-Ahead Guidance via Verifier-in-the-Loop for Automated Theorem Proving
  6. 2025Agentic Reasoning and Tool Integration for LLMs via Reinforcement Learning
  7. 2026ASTER: Agentic Scaling with Tool-integrated Extended Reasoning
  8. 2026ToolVerse: Unlocking Massive Environments and Long-Horizon Tasks for Agentic Reinforcement Learning