mlsanityData to 14 Oct 2026

Flood and Harvest: The Provable Necessity of Trivia for Generating Valuable Mathematics via the Lens of Language Generation in the Limit

arXiv 2606.14688 ↗First posted 12 Jun 2026cs.LG cs.AI cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

AI systems coupled to proof assistants now generate formal mathematics at scale, and the gap between what a checker can verify and what a mathematician would value has become the binding constraint. We model the generation of valuable mathematics as nested language generation in the limit: a verifiable formal language F, accessed through a membership oracle (the proof checker), contains an unknown valuable language H ∈ H revealed only through an adversarial enumeration of a core C subseteq H of exact density α (the literature). Every output is valuable (∈ H), trivial (∈ F setminus H), or a hallucination (notin F). We settle four questions. First, the verifier is not taste: the collections admitting generation with breadth are exactly those of the oracle-free model, characterized fiber-wise by Angluin's condition. Second, the verifier does buy sound coverage, covering all unseen valuable statements while asserting only valid ones: possible with it, impossible without it; it relocates unavoidable errors from false to trivial. Third, and centrally, a sharp dichotomy on the tight family: generators emitting finitely many trivia achieve optimal coverage α/2, while any infinite trivia allowance, even at vanishing rate, jumps the optimum to 1-α/2 (both tight, for cores presented as the candidate intersection), and one generator attains both ends. The transition is in trivia count, not rate; the gap 1-α is the unrecorded mass. Fourth, both regimes instantiate in a compression model of mathematics. A perfect verifier cannot substitute for taste: the unbounded stream of correct-but-worthless statements is not an engineering accident but a provable necessity, since covering unrecorded valuable mathematics requires an infinite, but asymptotically negligible, stream of certified trivia.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 34 of its 91 references that are in the map. First posted on arXiv 12 Jun 2026.

Builds on

34 of 91 references.

References · 34

  1. 2023LeanDojo: Theorem Proving with Retrieval-Augmented Language Modelscited by 427
  2. 2021MiniF2F: a cross-system benchmark for formal Olympiad-level mathematicscited by 391
  3. 2020Generative Language Modeling for Automated Theorem Provingcited by 388
  4. 2022Draft, Sketch, and Prove: Guiding Formal Theorem Provers with Informal Proofscited by 291
  5. 2022Autoformalization with Large Language Modelscited by 263
  6. 2024DeepSeek-Prover: Advancing Theorem Proving in LLMs through Large-Scale Synthetic Datacited by 234
  7. 2022HyperTree Proof Search for Neural Theorem Provingcited by 197
  8. 2019The Lean mathematical librarycited by 134
  9. 2025Goedel-Prover: A Frontier Model for Open-Source Automated Theorem Provingcited by 133
  10. 2016DeepMath - Deep Sequence Models for Premise Selectioncited by 81
  11. 2025Mathematical exploration and discovery at scalecited by 77
  12. 2024A Survey on Deep Learning for Theorem Provingcited by 57
22 more
  1. 2024Language Generation in the Limitcited by 40
  2. 2024Generation through the lens of learning theorycited by 31
  3. 2024Exploring Facets of Language Generation in the Limitcited by 28
  4. 2025Density Measures for Language Generationcited by 21
  5. 2025Generation from Noisy Examplescited by 20
  6. 2025Representative Language Generationcited by 19
  7. 2025Language Generation in the Limit: Noise, Loss, and Feedbackcited by 16
  8. 2025(Im)possibility of Automated Hallucination Detection in Large Language Modelscited by 15
  9. 2025On the Query Complexity of Verifier-Assisted Language Generationcited by 12
  10. 2026Safe Language Generation in the Limitcited by 9
  11. 2026Compression is all you need: Modeling Mathematicscited by 5
  12. 2026Mistake-Bounded Language Generationcited by 5
  13. 2026Agnostic Language Identification and Generationcited by 4
  14. 2026On Generation in Metric Spacescited by 4
  15. 2026Artificial Intelligence and the Structure of Mathematicscited by 4
  16. 2026Contrastive Identification and Generation in the Limitcited by 4
  17. 2026On the Price of Privacy for Language Identification and Generationcited by 3
  18. 2026A Theory of Time-Sensitive Language Generation: Sparse Hallucination Beats Mode Collapsecited by 3
  19. 2026Interestingness as an Inductive Heuristic for Future Compression Progresscited by 3
  20. 2026On Language Generation in the Limit with Bounded Memorycited by 3
  21. 2024On the Limits of Language Generation: Trade-Offs Between Hallucination and Mode Collapsecited by 2
  22. 2025Mathematical Knowledge Bases as Grammar-Compressed Proof Terms: Exploring Metamath Proof Structurescited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.