mlsanityData to 14 Oct 2026

Artificial Intelligence for Mathematical Reasoning: An Integrated Survey of Language Models, Neuro-symbolic Systems, and Verified Discovery

arXiv 2606.08728 ↗First posted 7 Jun 2026cs.AI cs.CL cs.CVcited by 1

On the map: LLM reasoning → Mathematical reasoning

Abstract (arXiv)

Mathematical reasoning has long served as a stringent test of machine intelligence; over the past decade, it has moved from a niche problem within NLP to one of the most consequential AI frontiers. This survey provides a unified account of the field's evolution, from early rule-based math word problem (MWP) solvers and template-driven geometry systems, through neural expression generation and LLM prompting, to contemporary reasoning models, multi-agent systems, neuro-symbolic theorem provers, and verified discovery workflows. We organize the landscape along four axes: (i) informal reasoning over text and diagrams, spanning MWP solving, multimodal geometry, and VLMs; (ii) formal reasoning in proof assistants, including autoformalization, tactic prediction, compiler-guided repair, and proof search; (iii) mathematical discovery, where systems propose constructions, improve bounds, or assist attacks on open problems; and (iv) the inference and training-time techniques, including CoT prompting, tool use, process reward models, and RLVR, that increasingly connect generation with verification. We catalog major benchmarks across grade-school arithmetic, competition mathematics, geometry, formal proving, multimodal and multilingual reasoning, and expert evaluation, and we examine benchmark saturation, contamination, reporting mismatches, and the distinction between pass@1, majority voting, and verifier-assisted pass@k. We critically assess failure modes: brittleness under perturbation, reward hacking, multimodal grounding failures, fragile formalization, and the energy cost of reasoning-scale inference. Drawing on recent perspectives from working mathematicians, we identify future directions centered on verified-discovery workflows, reasoning efficiency, and infrastructure to make AI-assisted formalization broadly usable. Companion materials: https://github.com/Starscream-11813/awesome-AI4Math.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 94 of its 268 references that are in the map. First posted on arXiv 7 Jun 2026.

Builds on

94 of 268 references.

Closest ancestors · 22

Same direction, newest first

  1. 2026Achieving Gold-Medal-Level Olympiad Reasoning via Simple and Unified Scaling13 May
  2. 2026MathlibLemma: Folklore Lemma Generation and Benchmark for Formal Mathematics30 Jan
  3. 2025Towards Robust Mathematical Reasoning3 Nov
  4. 2025DeepTheorem: Advancing LLM Reasoning for Theorem Proving Through Natural Language and Reinforcement Learning29 May
  5. 2025DeepSeek-Prover-V2: Advancing Formal Mathematical Reasoning via Reinforcement Learning for Subgoal Decomposition30 Apr
  6. 2025Kimina-Prover Preview: Towards Large Formal Reasoning Models with Reinforcement Learning15 Apr
  7. 2025LIMO: Less is More for Reasoning5 Feb
  8. 2025Understand, Solve and Translate: Bridging the Multilingual Mathematical Reasoning Gap5 Jan
  9. 2024Formal Mathematical Reasoning: A New Frontier in AI20 Dec
  10. 2024FrontierMath: A Benchmark for Evaluating Advanced Mathematical Reasoning in AI7 Nov
  11. 2024Omni-MATH: A Universal Olympiad Level Mathematic Benchmark For Large Language Models10 Oct
  12. 2024GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language Models7 Oct
10 more
  1. 2024Step-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMs26 Jun
  2. 2024Process-Driven Autoformalization in Lean 44 Jun
  3. 2024Achieving >97% on GSM8K: Deeply Understanding the Problems Makes LLMs Better Solvers for Math Word Problems23 Apr
  4. 2024Functional Benchmarks for Robust Evaluation of Reasoning Performance, and the Reasoning Gap29 Feb
  5. 2024InternLM-Math: Open Math Large Language Models Toward Verifiable Reasoning9 Feb
  6. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models5 Feb
  7. 2023Breaking Language Barriers in Multilingual Mathematical Reasoning: Insights and Observations31 Oct
  8. 2023WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-Instruct18 Aug
  9. 2022Language Models are Multilingual Chain-of-Thought Reasoners6 Oct
  10. 2020Generative Language Modeling for Automated Theorem Proving7 Sep

Other references · 72

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2017Proximal Policy Optimization Algorithmscited by 15,215
  3. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  4. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  5. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  6. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  7. 2025Qwen2.5-VL Technical Reportcited by 5,587
  8. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  9. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
  10. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,790
  11. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,367
  12. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
38 more
  1. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
  2. 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,475
  3. 2025s1: Simple test-time scalingcited by 1,341
  4. 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
  5. 2024Qwen2.5-Math Technical Report: Toward Mathematical Expert Model via Self-Improvementcited by 1,090
  6. 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 991
  7. 2022Solving math word problems with process- and outcome-based feedbackcited by 901
  8. 2021Are NLP Models really able to Solve Simple Math Word Problems?cited by 878
  9. 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 867
  10. 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 769
  11. 2023AGIEval: A Human-Centric Benchmark for Evaluating Foundation Modelscited by 716
  12. 2019MathQA: Towards Interpretable Math Word Problem Solving with Operation-Based Formalismscited by 662
  13. 2017Program Induction by Rationale Generation : Learning to Solve and Explain Algebraic Word Problemscited by 650
  14. 2024Improve Mathematical Reasoning in Language Models by Automated Process Supervisioncited by 441
  15. 2024Mixture-of-Agents Enhances Large Language Model Capabilitiescited by 438
  16. 2024Training Language Models to Self-Correct via Reinforcement Learningcited by 426
  17. 2021MiniF2F: a cross-system benchmark for formal Olympiad-level mathematicscited by 391
  18. 2021Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoningcited by 383
  19. 2016Solving General Arithmetic Word Problemscited by 360
  20. 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learningcited by 303
  21. 2024Quiet-STaR: Language Models Can Teach Themselves to Think Before Speakingcited by 301
  22. 2025REINFORCE++: Stabilizing Critic-Free Policy Optimization with Global Advantage Normalizationcited by 241
  23. 2024DeepSeek-Prover: Advancing Theorem Proving in LLMs through Large-Scale Synthetic Datacited by 234
  24. 2021GeoQA: A Geometric Question Answering Benchmark Towards Multimodal Numerical Reasoningcited by 228
  25. 2023G-LLaVA: Solving Geometric Problem with Multi-Modal Large Language Modelcited by 210
  26. 2023ProofNet: Autoformalizing and Formally Proving Undergraduate-Level Mathematicscited by 192
  27. 2025Goedel-Prover-V2: Scaling Formal Theorem Proving with Scaffolded Data Synthesis and Self-Correctioncited by 154
  28. 2025Goedel-Prover: A Frontier Model for Open-Source Automated Theorem Provingcited by 133
  29. 2024MAVIS: Mathematical Visual Instruction Tuning with an Automatic Data Enginecited by 113
  30. 2023CMATH: Can Your Language Model Pass Chinese Elementary School Math Test?cited by 90
  31. 2021Generate & Rank: A Multi-task Framework for Math Word Problemscited by 82
  32. 2025SuperGPQA: Scaling LLM Evaluation across 285 Graduate Disciplinescited by 79
  33. 2025Mathematical exploration and discovery at scalecited by 77
  34. 2020Ape210K: A Large-Scale and Template-Rich Dataset of Math Word Problemscited by 60
  35. 2024Lean Copilot: Large Language Models as Copilots for Theorem Proving in Leancited by 58
  36. 2025Aristotle: IMO-level Automated Theorem Provingcited by 58
  37. 2018Translating a Math Word Problem to an Expression Treecited by 57
  38. 2018Semantically-Aligned Equation Generation for Solving and Reasoning Math Word Problemscited by 49

50 most cited of 72 All 72 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Thinking Machines: Mathematical Reasoning in the Age of LLMs
  2. 2025SymCode: A Neurosymbolic Approach to Mathematical Reasoning via Verifiable Code Generation
  3. 2026Moxia: A Trust-First Neuro-Symbolic Execution Architecture for Self-Explaining Mathematical Reasoning
  4. 2026Measuring Progress in Reasoning Toward Mathematical Discovery with Automatic Verification
  5. 2025A Survey on Mathematical Reasoning and Optimization with Large Language Models
  6. 2026Mathematical Reasoning in Large Language Models: Benchmarks, Architectures, Evaluation, and Open Challenges
  7. 2026LiveMathematicianBench: A Live Benchmark for Research-Level Mathematical Reasoning with Proof Sketches
  8. 2024Mathematics and Machine Creativity: A Survey on Bridging Mathematics with AI