LANTERN: Illuminating Hidden Mathematical Knowledge in Language Models
Not on the map. Why?
Abstract (arXiv)
Language models can now prove theorems, but people still decide which problems to pursue. We ask whether a model's internal representations can help identify promising mathematical connections. We develop LANTERN, a fast, cost-efficient pipeline that uses a classifier over pretrained-model activations to rank candidate relations, followed by staged filtering, hypothesis generation, executable verification, and analytical checking. Applied to the On-Line Encyclopedia of Integer Sequences (OEIS), LANTERN ranked 50 million pairs among 10,000 frequently referenced sequences and produced 62 verified relations between pairs without an existing OEIS cross-reference. A content screen retained 13 relations worth presenting; nine of these are informative or insightful, including four which are entirely novel to the best of our knowledge: none appears in the OEIS or in our targeted literature search. The entire end-to-end process including classifier training, candidate ranking, filtering and verification took under 8 hours.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 95 references that are in the map. First posted on arXiv 26 Sep 2026.
Builds on
16 of 95 references.
References · 16
- 2022Discovering Latent Knowledge in Language Models Without Supervisioncited by 767
- 2025STP: Self-play LLM Theorem Provers with Iterative Conjecturing and Provingcited by 79
- 2025Mathematical exploration and discovery at scalecited by 77
- 2022Deep Symbolic Regression for Recurrent Sequencescited by 54
- 2024Learning Formal Mathematics From Intrinsic Motivationcited by 45
- 2022Predicting the Future of AI with AI: High-quality link prediction in an exponentially growing knowledge networkcited by 36
- 2025Predicting New Research Directions in Materials Science using Large Language Models and Concept Graphscited by 9
- 2025LeanConjecturer: Automatic Generation of Mathematical Conjectures for Theorem Provingcited by 8
- 2022FACT: Learning Governing Abstractions Behind Integer Sequencescited by 6
- 2024Discovering emergent connections in quantum physics research via dynamic word embeddingscited by 3
- 2026Probing Materials Knowledge in LLMs: From Latent Embeddings to Reliable Predictionscited by 2
- 2026OEIS Open: How many conjectures can language models turn into theorems?cited by 2
4 more
- 2026The Problem Is the Problem: Towards Scalable Mathematical Discoverycited by 2
- 2022On the Cryptomorphism between Davis' Subset Lattices, Atomic Lattices, and Closure Systems under T1 Separation Axiomcited by 1
- 2026MECA: A Mechanism-Centered Agent for Constructing Well-Specified and Valuable Mathematical Conjecturescited by 1
- 2026LLM Framework for Discovering Major Mathematical Conjectures: AI's Quest for the Next Riemann Hypothesiscited by 1
Built on by
Not cited yet.