mlsanityData to 7 Oct 2026

Goedel-Code-Prover: Hierarchical Proof Search for Open State-of-the-Art Code Verification

arXiv 2603.19329 ↗First posted 18 Mar 2026cs.SE cs.AIcited by 10

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) can generate plausible code but offer limited guarantees of correctness. Formally verifying that implementations satisfy specifications requires constructing machine-checkable proofs, a task that remains beyond current automation. We propose a hierarchical proof search framework for automated code verification in Lean~4 that decomposes complex verification goals into structurally simpler subgoals before attempting tactic-level proving. Central to our approach is a principled decomposition score that combines constructive justification with structural effectiveness. The same score serves as both the training reward and the inference-time ranking criterion, aligning optimization and deployment. We train Goedel Code Prover, a single unified policy for both decomposition and completion, through supervised initialization followed by hybrid reinforcement learning, where a continuous decomposition reward supports planning exploration while supervised replay stabilizes proof generation. On three Lean-based code verification benchmarks comprising 427 tasks, our 8B-parameter model achieves a 62.0% prove success rate, a 2.6 improvement over the strongest baseline under the reported inference settings. We further observe consistent inference-time scaling: success rates improve monotonically with search iterations and sampling budget, while whole-proof baselines plateau within the evaluated budgets.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 40 of its 57 references that are in the map. First posted on arXiv 18 Mar 2026.

Builds on

40 of 57 references.

References · 40

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  2. 2025Qwen3 Technical Reportcited by 8,195
  3. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  4. 2023Let's Verify Step by Stepcited by 3,598
  5. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
  6. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
  7. 2022Competition-Level Code Generation with AlphaCodecited by 1,427
  8. 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,332
  9. 2021Deduplicating Training Data Makes Language Models Bettercited by 705
  10. 2017Ray: A Distributed Framework for Emerging AI Applicationscited by 516
  11. 2023LeanDojo: Theorem Proving with Retrieval-Augmented Language Modelscited by 414
  12. 2020Generative Language Modeling for Automated Theorem Provingcited by 379
28 more
  1. 2022Draft, Sketch, and Prove: Guiding Formal Theorem Provers with Informal Proofscited by 278
  2. 2025DeepSeek-Prover-V2: Advancing Formal Mathematical Reasoning via Reinforcement Learning for Subgoal Decompositioncited by 270
  3. 2024DeepSeek-Prover: Advancing Theorem Proving in LLMs through Large-Scale Synthetic Datacited by 225
  4. 2022HyperTree Proof Search for Neural Theorem Provingcited by 192
  5. 2025Kimina-Prover Preview: Towards Large Formal Reasoning Models with Reinforcement Learningcited by 173
  6. 2020DreamCoder: Growing generalizable, interpretable knowledge with wake-sleep Bayesian program learningcited by 159
  7. 2025Goedel-Prover-V2: Scaling Formal Theorem Proving with Scaffolded Data Synthesis and Self-Correctioncited by 140
  8. 2019The Lean mathematical librarycited by 127
  9. 2023Baldur: Whole-Proof Generation and Repair with Large Language Modelscited by 118
  10. 2025BFS-Prover: Scalable Best-First Tree Search for LLM-based Automatic Theorem Provingcited by 82
  11. 2024Formal Mathematical Reasoning: A New Frontier in AIcited by 80
  12. 2025LeetCodeDataset: A Temporal Dataset for Robust Evaluation and Efficient Training of Code LLMscited by 67
  13. 2025OpenCodeInstruct: A Large-scale Instruction Tuning Dataset for Code LLMscited by 57
  14. 2024A Survey on Deep Learning for Theorem Provingcited by 55
  15. 2023Verus: Verifying Rust Programs using Linear Ghost Types (extended version)cited by 50
  16. 2025Aristotle: IMO-level Automated Theorem Provingcited by 47
  17. 2023Large Language Models and Simple, Stupid Bugscited by 45
  18. 2025Seed-Prover 1.5: Mastering Undergraduate-Level Theorem Proving via Learning from Experiencecited by 36
  19. 2023Finding Inductive Loop Invariants using Large Language Modelscited by 35
  20. 2025VERINA: Benchmarking Verifiable Code Generationcited by 30
  21. 2025CLEVER: A Curated Benchmark for Formally Verified Code Generationcited by 27
  22. 2025Scaling up Multi-Turn Off-Policy RL and Multi-Agent Tree Search for LLM Step-Proverscited by 26
  23. 2024Rango: Adaptive Retrieval-Augmented Proving for Automated Software Verificationcited by 25
  24. 2024Formal Theorem Proving by Rewarding LLMs to Decompose Proofs Hierarchicallycited by 22
  25. 2026AlgoVeri: An Aligned Benchmark for Verified Code Generation on Classical Algorithmscited by 11
  26. 2026Advances and Frontiers of LLM-based Issue Resolution in Software Engineering: A Comprehensive Surveycited by 8
  27. 2026CSLib: The Lean Computer Science Librarycited by 4
  28. 2026Model See, Model Do? Exposure-Aware Evaluation of Bug-vs-Fix Preference in Code LLMscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 10.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Automating Formal Verification with Reinforcement Learning and Recursive Inference
  2. 2026WybeCoder: Verified Imperative Code Generation
  3. 2026Compile to Compress: Boosting Formal Theorem Provers by Compiler Outputs
  4. 2026PROMISE: Proof Automation as Structural Imitation of Human Reasoning
  5. 2026Harnessing Code Agents for Automatic Software Verification
  6. 2026Automating Formal Verification with Agent-Guided Tree Search
  7. 2026SWE-Proof: Can Language Models Resolve Real-World Issues with Machine-Checked Proofs?
  8. 2026Adaptive Generate-Rank-Verify: Inference-Time Search with Costly Verification