First Proof
Not on the map. Why?
Abstract (arXiv)
To assess the ability of current AI systems to correctly answer research-level mathematics questions, we share a set of ten math questions which have arisen naturally in the research process of the authors. The questions had not been shared publicly until now; the answers are known to the authors of the questions but will remain encrypted for a short time.
Key facts. Cited by 26 papers in the map (data through 7 Oct 2026). Builds on 2 of its 4 references that are in the map. First posted on arXiv 5 Feb 2026.
Builds on
2 of 4 references.
References · 2
Built on by
Citing papers per year: 2026: 26.
26 papers.
Sort:
By area:
- 2026Automated Conjecture Resolution with Formal Verificationcited by 21
- 2026LemmaBench: A Live, Research-Level Benchmark to Evaluate LLM Capabilities in Mathematicscited by 7
- 2026Measuring Progress in Reasoning Toward Mathematical Discovery with Automatic Verificationcited by 7
- 2026RMA: an Agentic System for Research-Level Mathematical Problemscited by 6
- 2026ProofCouncil: An LLM Agent for Solving Open Mathematical Problemscited by 6
- 2026The Agentic Researcher: A Practical Guide to AI-Assisted Research in Mathematics and Machine Learningcited by 4
- 2026Soohak: A Mathematician-Curated Benchmark for Evaluating Research-level Math Capabilities of LLMscited by 4
- 2026LiveMathematicianBench: A Live Benchmark for Research-Level Mathematical Reasoning with Proof Sketchescited by 2
- 2026Artificial Intelligence and the Structure of Mathematicscited by 2
- 2026pAI/MSc: ML Theory Research with Humans on the Loopcited by 2
- 2026ResearchMath-14K: Scaling Research-Level Mathematics via Agentscited by 2
- 2026An Enigma of Artificial Reason: Investigating the Production-Evaluation Gap in Large Reasoning Modelscited by 1
14 more
- 2026Evaluating Research-Level Math Proofs via Strict Step-Level Verificationcited by 1
- 2026AI-Assisted Discovery of Convex Relaxations via Dual Agentscited by 1
- 2026From Solvers to Research: Large Language Model-Driven Formal Mathematics at the Research Frontiercited by 1
- 2026ReasFlow: Assisting Reasoning-Centric Scientific Discovery in Applied Mathematics via a Knowledge-Based Multi-Agent Systemcited by 1
- 2026Efficient Reasoning on the Edgecited by 0
- 2026Can LLM generate interesting mathematical research problems?cited by 0
- 2026k-server-bench: Automating Potential Discovery for the k-Server Conjecturecited by 0
- 2026Forage V2: Knowledge Evolution and Transfer in Autonomous Agent Organizationscited by 0
- 2026Failure Modes of Large Language Models on Research-Level Mathematics: A Taxonomy and an Empirical Characterisationcited by 0
- 2026How AI settled the complexity of the oldest SGD algorithmcited by 0
- 2026The Ramanujan Challenge For AIcited by 0
- 2026Beyond Correctness: Toward Automated Novelty Verification with Lean 4cited by 0
- 2026Explanations, Prompts, and Formalizations: Arguments for New Norms in LLM-Enabled Mathematical Researchcited by 0
- 2026TCSAlgBench: Benchmarking Automated Proving for Research-Level Theoretical Computer Sciencecited by 0
- 2026TCSAlgBench: Benchmarking Automated Proving for Research-Level Theoretical Computer Science28 Sep 2026
- 2026Explanations, Prompts, and Formalizations: Arguments for New Norms in LLM-Enabled Mathematical Research29 Aug 2026
- 2026Beyond Correctness: Toward Automated Novelty Verification with Lean 42 Aug 2026
- 2026ReasFlow: Assisting Reasoning-Centric Scientific Discovery in Applied Mathematics via a Knowledge-Based Multi-Agent System15 Jul 2026
- 2026ProofCouncil: An LLM Agent for Solving Open Mathematical Problems10 Jul 2026
- 2026From Solvers to Research: Large Language Model-Driven Formal Mathematics at the Research Frontier8 Jul 2026
- 2026AI-Assisted Discovery of Convex Relaxations via Dual Agents30 Jun 2026
- 2026How AI settled the complexity of the oldest SGD algorithm28 Jun 2026
- 2026The Ramanujan Challenge For AI27 Jun 2026
- 2026Failure Modes of Large Language Models on Research-Level Mathematics: A Taxonomy and an Empirical Characterisation12 Jun 2026
- 2026Evaluating Research-Level Math Proofs via Strict Step-Level Verification9 Jun 2026
- 2026An Enigma of Artificial Reason: Investigating the Production-Evaluation Gap in Large Reasoning Models31 May 2026
14 more
- 2026ResearchMath-14K: Scaling Research-Level Mathematics via Agents27 May 2026
- 2026RMA: an Agentic System for Research-Level Mathematical Problems20 May 2026
- 2026Soohak: A Mathematician-Curated Benchmark for Evaluating Research-level Math Capabilities of LLMs9 May 2026
- 2026pAI/MSc: ML Theory Research with Humans on the Loop22 Apr 2026
- 2026Forage V2: Knowledge Evolution and Transfer in Autonomous Agent Organizations21 Apr 2026
- 2026k-server-bench: Automating Potential Discovery for the k-Server Conjecture8 Apr 2026
- 2026Artificial Intelligence and the Structure of Mathematics7 Apr 2026
- 2026Automated Conjecture Resolution with Formal Verification4 Apr 2026
- 2026LiveMathematicianBench: A Live Benchmark for Research-Level Mathematical Reasoning with Proof Sketches2 Apr 2026
- 2026Can LLM generate interesting mathematical research problems?19 Mar 2026
- 2026Efficient Reasoning on the Edge17 Mar 2026
- 2026The Agentic Researcher: A Practical Guide to AI-Assisted Research in Mathematics and Machine Learning16 Mar 2026
- 2026Measuring Progress in Reasoning Toward Mathematical Discovery with Automatic Verification16 Mar 2026
- 2026LemmaBench: A Live, Research-Level Benchmark to Evaluate LLM Capabilities in Mathematics27 Feb 2026
- 2026Automated Conjecture Resolution with Formal Verificationcited by 21
- 2026Measuring Progress in Reasoning Toward Mathematical Discovery with Automatic Verificationcited by 7
- 2026Soohak: A Mathematician-Curated Benchmark for Evaluating Research-level Math Capabilities of LLMscited by 4
- 2026LiveMathematicianBench: A Live Benchmark for Research-Level Mathematical Reasoning with Proof Sketchescited by 2
- 2026An Enigma of Artificial Reason: Investigating the Production-Evaluation Gap in Large Reasoning Modelscited by 1
- 2026ReasFlow: Assisting Reasoning-Centric Scientific Discovery in Applied Mathematics via a Knowledge-Based Multi-Agent Systemcited by 1
- 2026Efficient Reasoning on the Edgecited by 0
- 2026ReasFlow: Assisting Reasoning-Centric Scientific Discovery in Applied Mathematics via a Knowledge-Based Multi-Agent System15 Jul 2026
- 2026An Enigma of Artificial Reason: Investigating the Production-Evaluation Gap in Large Reasoning Models31 May 2026
- 2026Soohak: A Mathematician-Curated Benchmark for Evaluating Research-level Math Capabilities of LLMs9 May 2026
- 2026Automated Conjecture Resolution with Formal Verification4 Apr 2026
- 2026LiveMathematicianBench: A Live Benchmark for Research-Level Mathematical Reasoning with Proof Sketches2 Apr 2026
- 2026Efficient Reasoning on the Edge17 Mar 2026
- 2026Measuring Progress in Reasoning Toward Mathematical Discovery with Automatic Verification16 Mar 2026
- 2026RMA: an Agentic System for Research-Level Mathematical Problemscited by 6
- 2026ProofCouncil: An LLM Agent for Solving Open Mathematical Problemscited by 6
- 2026The Agentic Researcher: A Practical Guide to AI-Assisted Research in Mathematics and Machine Learningcited by 4
- 2026ResearchMath-14K: Scaling Research-Level Mathematics via Agentscited by 2
- 2026AI-Assisted Discovery of Convex Relaxations via Dual Agentscited by 1
- 2026ProofCouncil: An LLM Agent for Solving Open Mathematical Problems10 Jul 2026
- 2026AI-Assisted Discovery of Convex Relaxations via Dual Agents30 Jun 2026
- 2026ResearchMath-14K: Scaling Research-Level Mathematics via Agents27 May 2026
- 2026RMA: an Agentic System for Research-Level Mathematical Problems20 May 2026
- 2026The Agentic Researcher: A Practical Guide to AI-Assisted Research in Mathematics and Machine Learning16 Mar 2026
- 2026LemmaBench: A Live, Research-Level Benchmark to Evaluate LLM Capabilities in Mathematicscited by 7
- 2026Artificial Intelligence and the Structure of Mathematicscited by 2
- 2026pAI/MSc: ML Theory Research with Humans on the Loopcited by 2
- 2026Evaluating Research-Level Math Proofs via Strict Step-Level Verificationcited by 1
- 2026From Solvers to Research: Large Language Model-Driven Formal Mathematics at the Research Frontiercited by 1
- 2026Can LLM generate interesting mathematical research problems?cited by 0
- 2026k-server-bench: Automating Potential Discovery for the k-Server Conjecturecited by 0
- 2026Forage V2: Knowledge Evolution and Transfer in Autonomous Agent Organizationscited by 0
- 2026Failure Modes of Large Language Models on Research-Level Mathematics: A Taxonomy and an Empirical Characterisationcited by 0
- 2026How AI settled the complexity of the oldest SGD algorithmcited by 0
- 2026The Ramanujan Challenge For AIcited by 0
- 2026Beyond Correctness: Toward Automated Novelty Verification with Lean 4cited by 0
12 most cited of 14 All 14 (JSON)
- 2026TCSAlgBench: Benchmarking Automated Proving for Research-Level Theoretical Computer Science28 Sep 2026
- 2026Explanations, Prompts, and Formalizations: Arguments for New Norms in LLM-Enabled Mathematical Research29 Aug 2026
- 2026Beyond Correctness: Toward Automated Novelty Verification with Lean 42 Aug 2026
- 2026From Solvers to Research: Large Language Model-Driven Formal Mathematics at the Research Frontier8 Jul 2026
- 2026How AI settled the complexity of the oldest SGD algorithm28 Jun 2026
- 2026The Ramanujan Challenge For AI27 Jun 2026
- 2026Failure Modes of Large Language Models on Research-Level Mathematics: A Taxonomy and an Empirical Characterisation12 Jun 2026
- 2026Evaluating Research-Level Math Proofs via Strict Step-Level Verification9 Jun 2026
- 2026pAI/MSc: ML Theory Research with Humans on the Loop22 Apr 2026
- 2026Forage V2: Knowledge Evolution and Transfer in Autonomous Agent Organizations21 Apr 2026
- 2026k-server-bench: Automating Potential Discovery for the k-Server Conjecture8 Apr 2026
- 2026Artificial Intelligence and the Structure of Mathematics7 Apr 2026
12 newest of 14 All 14 (JSON)