mlsanityData to 14 Oct 2026

Self-Supervised Theorem Discovery in a Formal Axiomatic System

arXiv 2606.28747 ↗First posted 27 Jun 2026cs.AI cs.LGcited by 0

On the map: LLM reasoning → Mathematical reasoning

Abstract (arXiv)

Recent artificial intelligence (AI) systems have shown remarkable progress in mathematical reasoning. Many existing approaches, including large language models (LLMs), draw on human prior knowledge in the form of mathematical text, code, or theorem libraries. Although these approaches are highly effective in practice, it remains an open question whether an agent can autonomously discover useful theorems without such human priors. We study this question in a formal axiomatic system by developing an agent that starts from axioms and inference rules alone and gradually grows a library of useful theorems. Concretely, we propose a self-supervised theorem-discovery algorithm that alternates between proof search and useful-theorem extraction, building a theorem library whose entries are reused as lemmas for subsequent proof search. Experiments show that the agent discovers tens of thousands of theorems and finds proofs for human-written benchmark problems, suggesting that its discoveries include theorems meaningful from a human mathematical perspective. Furthermore, the discovered theorems improve LLM proof performance when provided as prompt lemmas, indicating that they can serve as external knowledge for LLM reasoning. Our results provide evidence that useful theorems can emerge from proof search without relying on human-provided theorem libraries. More broadly, they suggest a path toward self-evolving AI systems for mathematics whose discoveries remain formally verifiable.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 17 of its 39 references that are in the map. First posted on arXiv 27 Jun 2026.

Builds on

17 of 39 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025STP: Self-play LLM Theorem Provers with Iterative Conjecturing and Proving31 Jan
  2. 2023Llemma: An Open Language Model For Mathematics16 Oct

Other references · 15

  1. 2017Hindsight Experience Replaycited by 1,136
  2. 2023LeanDojo: Theorem Proving with Retrieval-Augmented Language Modelscited by 427
  3. 2025Absolute Zero: Reinforced Self-play Reasoning with Zero Datacited by 344
  4. 2022Draft, Sketch, and Prove: Guiding Formal Theorem Provers with Informal Proofscited by 291
  5. 2022Autoformalization with Large Language Modelscited by 263
  6. 2024DeepSeek-Prover: Advancing Theorem Proving in LLMs through Large-Scale Synthetic Datacited by 234
  7. 2025Why Language Models Hallucinatecited by 220
  8. 2022HyperTree Proof Search for Neural Theorem Provingcited by 197
  9. 2022Formal Mathematics Statement Curriculum Learningcited by 142
  10. 2021Proof Artifact Co-training for Theorem Proving with Language Modelscited by 132
  11. 2023LEGO-Prover: Neural Theorem Proving with Growing Librariescited by 109
  12. 2018Reinforcement Learning of Theorem Provingcited by 69
3 more
  1. 2024Learning Formal Mathematics From Intrinsic Motivationcited by 45
  2. 2025Bourbaki: Self-Generated and Goal-Conditioned MDPs for Theorem Provingcited by 12
  3. 2022Learning to Find Proofs and Theorems by Learning to Refine Search Strategies: The Case of Loop Invariant Synthesiscited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Artificial Intelligence for Mathematical Reasoning: An Integrated Survey of Language Models, Neuro-symbolic Systems, and Verified Discovery
  2. 2026On Reasoning-Centric LLM-based Automated Theorem Proving
  3. 2025DeepTheorem: Advancing LLM Reasoning for Theorem Proving Through Natural Language and Reinforcement Learning
  4. 2024Formal Theorem Proving by Rewarding LLMs to Decompose Proofs Hierarchically
  5. 2025Prover Agent: An Agent-Based Framework for Formal Mathematical Proofs
  6. 2026MechMath: Sorrifier-Driven Formal Decomposition Workflow for Automated Theorem Proving
  7. 2023math-PVS: A Large Language Model Framework to Map Scientific Publications to PVS Theories
  8. 2026A Minimal Agent for Automated Theorem Proving