PriorProof: A Point-in-Time Measure of Technique Novelty for Formal Proofs
Not on the map. Why?
Abstract (arXiv)
Mathematicians distinguish proofs that explain, simplify, or introduce a nonstandard route, but these judgments are difficult to operationalize. We study a deliberately narrower construct: time-relative proof-route nonstandardness in formal mathematics. For a Lean theorem, PriorProof extracts the dependency footprint of its elaborated proof term and scores the weighted surprisal of that footprint under a retrieval-conditioned, hierarchically smoothed prior built only from an earlier quarterly snapshot of Mathlib. The method requires no hand-built technique ontology and no human labels: statement retrieval is learned from proof-derived contrastive pairs, while the scored object is read mechanically from proof terms. In a blinded topology study, 100 presentations collapse to 76 distinct underlying pairs: 12 canonical contrasts shown three times for consistency screening and 64 distinct stratified pairs. Against the majority of three retained domain raters, PriorProof agrees on 53/76 pairs (69.7%, Wilson 95% CI 58.7-78.9%), including 11/12 canonical pairs (91.7%, 64.6-98.5%) and 42/64 stratified pairs (65.6%, 53.4-76.1%). Score-gap quartiles are nonmonotone after repeat collapse; the endpoints are 12/19 (63.2%, 41.0-80.9%) in the smallest-gap bin and 16/19 (84.2%, 62.4-94.5%) in the largest, supporting an endpoint-calibration tendency rather than a resolved staircase. The best language-model condition agrees on 60/76 pairs (78.9%, 68.5-86.6%); on paired outcomes, PriorProof alone is correct on 8 pairs and the model alone on 15 (exact two-sided McNemar p = 0.210), so the difference is not established at this sample size. We therefore present PriorProof not as a replacement for expert or model judgment, but as a decomposable, time-anchored signal whose score gap provides an interpretable reliability indicator.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 29 references that are in the map. First posted on arXiv 18 Jul 2026.
Builds on
12 of 29 references.
References · 12
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,414
- 2020A Unifying Review of Deep and Shallow Anomaly Detectioncited by 423
- 2023LeanDojo: Theorem Proving with Retrieval-Augmented Language Modelscited by 414
- 2024DeepSeek-Prover: Advancing Theorem Proving in LLMs through Large-Scale Synthetic Datacited by 225
- 2022HyperTree Proof Search for Neural Theorem Provingcited by 192
- 2016DeepMath - Deep Sequence Models for Premise Selectioncited by 80
- 2024miniCTX: Neural Theorem Proving with (Long-)Contextscited by 35
- 20243D-Prover: Diversity Driven Theorem Proving With Determinantal Point Processescited by 6
- 2026The Network Structure of Mathlibcited by 4
- 2026TheoremGraph: Bridging Formal and Informal Mathematicscited by 4
- 2023Investigations into Proof Structurescited by 2
Built on by
Not cited yet.