G"odel Test: Can Large Language Models Solve Easy Conjectures?
Not on the map. Why?
Abstract (arXiv)
Recent announcements from frontier AI model labs have highlighted strong results on high-school and undergraduate math competitions. Yet it remains unclear whether large language models can solve new, simple conjectures in more advanced areas of mathematics. We propose the G"odel Test: evaluating whether a model can produce correct proofs for very simple, previously unsolved conjectures. To this end, we study the performance of GPT-5 on five conjectures in combinatorial optimization. For each problem, we provided one or two source papers from which the conjecture arose, withheld our own conjecture, and then assessed the model's reasoning in detail. On the three easier problems, GPT-5 produced nearly correct solutions; for Problem 2 it even derived a different approximation guarantee that, upon checking, refuted our conjecture while providing a valid solution. The model failed on Problem 4, which required combining results from two papers. On Problem 5, a harder case without a validated conjecture, GPT-5 proposed the same algorithm we had in mind but failed in the analysis, suggesting the proof is more challenging than expected. Although our sample is small, the results point to meaningful progress on routine reasoning, occasional flashes of originality, and clear limitations when cross-paper synthesis is required. GPT-5 may represent an early step toward frontier models eventually passing the G"odel Test.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 7 of its 11 references that are in the map. First posted on arXiv 22 Sep 2025.
Builds on
7 of 11 references.
References · 7
- 2016Guaranteed Non-convex Optimization: Submodular Maximization over Continuous Domainscited by 31
- 2023Constrained Submodular Maximization via New Bounds for DR-Submodular Functionscited by 15
- 2017Weakly Submodular Maximization Beyond Cardinality Constraints: Does Randomization Help Greedy?cited by 13
- 2021Submodular + Concavecited by 13
- 2022Using Partial Monotonicity in Submodular Maximizationcited by 9
- 2020Weakly Submodular Function Maximization Using Local Submodularity Ratiocited by 7
- 2025Bicriteria Submodular Maximizationcited by 1
Built on by
Citing papers per year: 2025: 1; 2026: 4.
5 papers.
- 2026Towards Autonomous Mathematics Researchcited by 40
- 2025Solving a Research Problem in Mathematical Statistics with AI Assistancecited by 6
- 2026MathNet: a Global Multimodal Benchmark for Mathematical Reasoning and Retrievalcited by 6
- 2026Automated alignment is harder than you thinkcited by 2
- 2026The Benjamini--Hochberg Procedure Can Fail to Control the FDR for Correlated Two-Sided Gaussian Testscited by 0
- 2026The Benjamini--Hochberg Procedure Can Fail to Control the FDR for Correlated Two-Sided Gaussian Tests13 Jul 2026
- 2026Automated alignment is harder than you think7 May 2026
- 2026MathNet: a Global Multimodal Benchmark for Mathematical Reasoning and Retrieval20 Apr 2026
- 2026Towards Autonomous Mathematics Research10 Feb 2026
- 2025Solving a Research Problem in Mathematical Statistics with AI Assistance24 Nov 2025