Beyond Correctness: Toward Automated Novelty Verification with Lean 4
Not on the map. Why?
Abstract (arXiv)
Artificial intelligence systems applied to mathematics verify correctness but not novelty: an automatically generated theorem can compile in Lean without errors and yet be an already known result. This article presents AViD Journal, a pipeline that receives a LaTeX article, formalizes its statements in Lean 4, and issues a novelty verdict through a decision tree over three dimensions: prior existence in a formal corpus (Mathlib) and an informal one (TheoremSearch and Matlas, with temporal filter and LLM judge), non-triviality via automatic tactics, and structural distance between proofs measured as Jaccard distance over premise sets. Evaluation on papers withdrawn from arXiv due to declared duplication produced a result more informative than any performance measure: the identification of three obstacles that limit the approach regardless of this implementation. First, successful compilation of a Lean file does not guarantee semantic fidelity. Second, the recall ceiling is imposed by the coverage of theorem indices, not by the similarity metric. Third, arXiv removes the source code of articles upon withdrawal, compromising the reproducibility of any benchmark built upon them.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 25 references that are in the map. First posted on arXiv 2 Aug 2026.
Builds on
15 of 25 references.
References · 15
- 2023Magnushammer: A Transformer-Based Approach to Premise Selectioncited by 50
- 2026Numina-Lean-Agent: An Open and General Agentic Reasoning System for Formal Mathematicscited by 50
- 2026First Proofcited by 32
- 2023Machine-Learned Premise Selection for Leancited by 10
- 2025Lean Finder: Semantic Search for Mathlib That Understands User Intentscited by 8
- 2026Semantic Search over 9 Million Mathematical Theoremscited by 8
- 2026First Proof Second Batchcited by 6
- 2026TheoremGraph: Bridging Formal and Informal Mathematicscited by 5
- 2024Mining Math Conjectures from LLMs: A Pruning Approachcited by 4
- 2026The Network Structure of Mathlibcited by 4
- 2026Matlas: A Semantic Search Engine for Mathematicscited by 3
- 2026COMPOSE: Composing Future Theorems from Citations and Formal Structurecited by 3
Built on by
Not cited yet.