Proving Olympiad Inequalities by Synergizing LLMs and Symbolic Reasoning
On the map: LLM reasoning → Mathematical reasoning
Abstract (arXiv)
Large language models (LLMs) can prove mathematical theorems formally by generating proof steps (textita.k.a. tactics) within a proof system. However, the space of possible tactics is vast and complex, while the available training data for formal proofs is limited, posing a significant challenge to LLM-based tactic generation. To address this, we introduce a neuro-symbolic tactic generator that synergizes the mathematical intuition learned by LLMs with domain-specific insights encoded by symbolic methods. The key aspect of this integration is identifying which parts of mathematical reasoning are best suited to LLMs and which to symbolic methods. While the high-level idea of neuro-symbolic integration is broadly applicable to various mathematical problems, in this paper, we focus specifically on Olympiad inequalities (Figure~1). We analyze how humans solve these problems and distill the techniques into two types of tactics: (1) scaling, handled by symbolic methods, and (2) rewriting, handled by LLMs. In addition, we combine symbolic tools with LLMs to prune and rank the proof goals for efficient proof search. We evaluate our framework on 161 challenging inequalities from multiple mathematics competitions, achieving state-of-the-art performance and significantly outperforming existing LLM and symbolic approaches without requiring additional training data.
Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 35 of its 87 references that are in the map. First posted on arXiv 19 Feb 2025.
Builds on
35 of 87 references.
Closest ancestors · 4
Same direction, newest first
- 2024Formal Mathematical Reasoning: A New Frontier in AI20 Dec
- 2024Neuro-Symbolic Data Generation for Math Reasoning6 Dec
- 2024LEAN-GitHub: Compiling GitHub LEAN repositories for a versatile LEAN prover24 Jul
- 2020Generative Language Modeling for Automated Theorem Proving7 Sep
Other references · 31
- 2017Attention Is All You Needcited by 60,361
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2023Mistral 7Bcited by 3,164
- 2024DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Modelcited by 1,135
- 2023LeanDojo: Theorem Proving with Retrieval-Augmented Language Modelscited by 427
- 2022Draft, Sketch, and Prove: Guiding Formal Theorem Provers with Informal Proofscited by 291
- 2024DeepSeek-Prover: Advancing Theorem Proving in LLMs through Large-Scale Synthetic Datacited by 234
- 2022HyperTree Proof Search for Neural Theorem Provingcited by 197
- 2023Navigate through Enigmatic Labyrinth A Survey of Chain of Thought Reasoning: Advances, Frontiers and Futurecited by 184
- 2021The Principles of Deep Learning Theorycited by 173
- 2022Formal Mathematics Statement Curriculum Learningcited by 142
19 more
- 2025Goedel-Prover: A Frontier Model for Open-Source Automated Theorem Provingcited by 133
- 2021Proof Artifact Co-training for Theorem Proving with Language Modelscited by 132
- 2024Lean Workbook: A large-scale Lean problem set formalized from natural language math problemscited by 122
- 2023Baldur: Whole-Proof Generation and Repair with Large Language Modelscited by 119
- 2023LEGO-Prover: Neural Theorem Proving with Growing Librariescited by 109
- 2023An In-Context Learning Agent for Formal Theorem-Provingcited by 82
- 2018Sampling Can Be Faster Than Optimizationcited by 68
- 2024Lean Copilot: Large Language Models as Copilots for Theorem Proving in Leancited by 58
- 2024A Survey on Deep Learning for Theorem Provingcited by 57
- 2020INT: An Inequality Benchmark for Evaluating Generalization in Theorem Provingcited by 44
- 2015A formal proof of the Kepler conjecturecited by 42
- 2023Lyra: Orchestrating Dual Correction in Automated Theorem Provingcited by 25
- 2016Solving and Verifying the boolean Pythagorean Triples problem via Cube-and-Conquercited by 23
- 2024Proving Olympiad Algebraic Inequalities without Human Demonstrationscited by 20
- 2024Graph2Tac: Online Representation Learning of Formal Math Conceptscited by 15
- 2018Learning to Reason with HOL4 tacticscited by 14
- 2023Machine-Learned Premise Selection for Leancited by 10
- 2021Online Machine Learning Techniques for Coq: A Comparisoncited by 7
- 2023SMT-Solving Induction Proofs of Inequalitiescited by 1
Built on by
Citing papers per year: 2025: 9; 2026: 8.
17 papers.
Sort:
By area:
- 2025RL Grokking Recipe: How Does RL Unlock and Transfer New Algorithms in LLMs?cited by 23
- 2025Solving Inequality Proofs with Large Language Modelscited by 21
- 2025Reviving DSP for Advanced Theorem Proving in the Era of Reasoning Modelscited by 17
- 2026AI co-mathematician: Accelerating mathematicians with agentic AIcited by 17
- 2025AutoGPS: Automated Geometry Problem Solving via Multimodal Formalization and Deductive Reasoningcited by 14
- 2025SciML Agents: Write the Solver, Not the Solutioncited by 6
- 2025Foundation Models for Scientific Discovery: From Paradigm Enhancement to Paradigm Transitioncited by 6
- 2026DreamProver: Evolving Transferable Lemma Libraries via a Wake-Sleep Theorem-Proving Agentcited by 5
- 2025Pre-trained Language Models Learn Remarkably Accurate Representations of Numberscited by 4
- 2025A Case Study on the Effectiveness of LLMs in Verification with Proof Assistantscited by 3
- 2026TCS-BENCH: Benchmarking State-of-the-Art Generative AI Theoretical Computer Science Research Abilitycited by 3
- 2025Language Models Learn Universal Representations of Numbers and Here's Why You Should Carecited by 2
5 more
- 2026Neuro-Symbolic Proof Generation for Scaling Systems Software Verificationcited by 1
- 2026From LLM-Generated Conjectures to Lean Formalizations: Automated Polynomial Inequality Proving via Sum-of-Squares Certificatescited by 1
- 2026From Solvers to Research: Large Language Model-Driven Formal Mathematics at the Research Frontiercited by 1
- 2026REASON: Accelerating Probabilistic Logical Reasoning for Scalable Neuro-Symbolic Intelligencecited by 0
- 2026Learning to Coordinate Symbolic Tools: LLM Agents for Verified Sum-of-Squares Certificatescited by 0
- 2026TCS-BENCH: Benchmarking State-of-the-Art Generative AI Theoretical Computer Science Research Ability10 Aug 2026
- 2026Learning to Coordinate Symbolic Tools: LLM Agents for Verified Sum-of-Squares Certificates31 Jul 2026
- 2026From Solvers to Research: Large Language Model-Driven Formal Mathematics at the Research Frontier8 Jul 2026
- 2026From LLM-Generated Conjectures to Lean Formalizations: Automated Polynomial Inequality Proving via Sum-of-Squares Certificates14 May 2026
- 2026AI co-mathematician: Accelerating mathematicians with agentic AI7 May 2026
- 2026DreamProver: Evolving Transferable Lemma Libraries via a Wake-Sleep Theorem-Proving Agent29 Apr 2026
- 2026Neuro-Symbolic Proof Generation for Scaling Systems Software Verification20 Mar 2026
- 2026REASON: Accelerating Probabilistic Logical Reasoning for Scalable Neuro-Symbolic Intelligence28 Jan 2026
- 2025Language Models Learn Universal Representations of Numbers and Here's Why You Should Care30 Oct 2025
- 2025Foundation Models for Scientific Discovery: From Paradigm Enhancement to Paradigm Transition17 Oct 2025
- 2025RL Grokking Recipe: How Does RL Unlock and Transfer New Algorithms in LLMs?25 Sep 2025
- 2025SciML Agents: Write the Solver, Not the Solution12 Sep 2025
5 more
- 2025A Case Study on the Effectiveness of LLMs in Verification with Proof Assistants26 Aug 2025
- 2025Reviving DSP for Advanced Theorem Proving in the Era of Reasoning Models13 Jun 2025
- 2025Pre-trained Language Models Learn Remarkably Accurate Representations of Numbers10 Jun 2025
- 2025Solving Inequality Proofs with Large Language Models9 Jun 2025
- 2025AutoGPS: Automated Geometry Problem Solving via Multimodal Formalization and Deductive Reasoning29 May 2025
- 2025Solving Inequality Proofs with Large Language Modelscited by 21
- 2025Reviving DSP for Advanced Theorem Proving in the Era of Reasoning Modelscited by 17
- 2025AutoGPS: Automated Geometry Problem Solving via Multimodal Formalization and Deductive Reasoningcited by 14
- 2026From LLM-Generated Conjectures to Lean Formalizations: Automated Polynomial Inequality Proving via Sum-of-Squares Certificatescited by 1
- 2026REASON: Accelerating Probabilistic Logical Reasoning for Scalable Neuro-Symbolic Intelligencecited by 0
- 2026From LLM-Generated Conjectures to Lean Formalizations: Automated Polynomial Inequality Proving via Sum-of-Squares Certificates14 May 2026
- 2026REASON: Accelerating Probabilistic Logical Reasoning for Scalable Neuro-Symbolic Intelligence28 Jan 2026
- 2025Reviving DSP for Advanced Theorem Proving in the Era of Reasoning Models13 Jun 2025
- 2025Solving Inequality Proofs with Large Language Models9 Jun 2025
- 2025AutoGPS: Automated Geometry Problem Solving via Multimodal Formalization and Deductive Reasoning29 May 2025
- 2026AI co-mathematician: Accelerating mathematicians with agentic AIcited by 17
- 2025SciML Agents: Write the Solver, Not the Solutioncited by 6
- 2026DreamProver: Evolving Transferable Lemma Libraries via a Wake-Sleep Theorem-Proving Agentcited by 5
- 2026Learning to Coordinate Symbolic Tools: LLM Agents for Verified Sum-of-Squares Certificatescited by 0
- 2026Learning to Coordinate Symbolic Tools: LLM Agents for Verified Sum-of-Squares Certificates31 Jul 2026
- 2026AI co-mathematician: Accelerating mathematicians with agentic AI7 May 2026
- 2026DreamProver: Evolving Transferable Lemma Libraries via a Wake-Sleep Theorem-Proving Agent29 Apr 2026
- 2025SciML Agents: Write the Solver, Not the Solution12 Sep 2025
- 2025RL Grokking Recipe: How Does RL Unlock and Transfer New Algorithms in LLMs?cited by 23
- 2025Foundation Models for Scientific Discovery: From Paradigm Enhancement to Paradigm Transitioncited by 6
- 2025Pre-trained Language Models Learn Remarkably Accurate Representations of Numberscited by 4
- 2025A Case Study on the Effectiveness of LLMs in Verification with Proof Assistantscited by 3
- 2026TCS-BENCH: Benchmarking State-of-the-Art Generative AI Theoretical Computer Science Research Abilitycited by 3
- 2025Language Models Learn Universal Representations of Numbers and Here's Why You Should Carecited by 2
- 2026Neuro-Symbolic Proof Generation for Scaling Systems Software Verificationcited by 1
- 2026From Solvers to Research: Large Language Model-Driven Formal Mathematics at the Research Frontiercited by 1
- 2026TCS-BENCH: Benchmarking State-of-the-Art Generative AI Theoretical Computer Science Research Ability10 Aug 2026
- 2026From Solvers to Research: Large Language Model-Driven Formal Mathematics at the Research Frontier8 Jul 2026
- 2026Neuro-Symbolic Proof Generation for Scaling Systems Software Verification20 Mar 2026
- 2025Language Models Learn Universal Representations of Numbers and Here's Why You Should Care30 Oct 2025
- 2025Foundation Models for Scientific Discovery: From Paradigm Enhancement to Paradigm Transition17 Oct 2025
- 2025RL Grokking Recipe: How Does RL Unlock and Transfer New Algorithms in LLMs?25 Sep 2025
- 2025A Case Study on the Effectiveness of LLMs in Verification with Proof Assistants26 Aug 2025
- 2025Pre-trained Language Models Learn Remarkably Accurate Representations of Numbers10 Jun 2025
Similar, not cited
Close in wording, no citation either way
- 2025Brains vs. Bytes: Evaluating LLM Proficiency in Olympiad Mathematics
- 2025Thinking Machines: Mathematical Reasoning in the Age of LLMs
- 2025Proof or Bluff? Evaluating LLMs on 2025 USA Math Olympiad
- 2025A Survey on Mathematical Reasoning and Optimization with Large Language Models
- 2025One Example Shown, Many Concepts Known! Counterexample-Driven Conceptual Reasoning in Mathematical LLMs
- 2023math-PVS: A Large Language Model Framework to Map Scientific Publications to PVS Theories
- 2026Rethinking Math Reasoning Evaluation: A Robust LLM-as-a-Judge Framework Beyond Symbolic Rigidity
- 2025DeepTheorem: Advancing LLM Reasoning for Theorem Proving Through Natural Language and Reinforcement Learning