Foundation of Intelligence: Review of Math Word Problems from Human Cognition Perspective
Not on the map. Why?
Abstract (arXiv)
Math word problem (MWP) serves as a fundamental research topic in artificial intelligence (AI) dating back to 1960s. This research aims to advance the reasoning abilities of AI by mirroring the human-like cognitive intelligence. The mainstream technological paradigm has evolved from the early rule-based methods, to deep learning models, and is rapidly advancing towards large language models. However, the field still lacks a systematic taxonomy for the MWP survey along with a discussion of current development trends. Therefore, in this paper, we aim to comprehensively review related research in MWP solving through the lens of human cognition, to demonstrate how recent AI models are advancing in simulating human cognitive abilities. Specifically, we summarize 5 crucial cognitive abilities for MWP solving, including Problem Understanding, Logical Organization, Associative Memory, Critical Thinking, and Knowledge Learning. Focused on these abilities, we review two mainstream MWP models in recent 10 years: neural network solvers, and LLM based solvers, and discuss the core human-like abilities they demonstrated in their intricate problem-solving process. Moreover, we rerun all the representative MWP solvers and supplement their performance on 5 mainstream benchmarks for a unified comparison. To the best of our knowledge, this survey first comprehensively analyzes the influential MWP research of the past decade from the perspective of human reasoning cognition and provides an integrative overall comparison across existing approaches. We hope it can inspire further research in AI reasoning. Our repository is released on https://github.com/Ljyustc/FoI-MWP.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 124 of its 221 references that are in the map. First posted on arXiv 24 Oct 2025.
Builds on
124 of 221 references.
References · 124
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2017Graph Attention Networkscited by 8,923
- 2017Mask R-CNNcited by 7,277
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
38 more
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2013Auto-Encoding Variational Bayescited by 4,053
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
- 2023A Survey of Large Language Modelscited by 2,576
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
- 2019Language Models as Knowledge Bases?cited by 1,936
- 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,407
- 2021What Makes Good In-Context Examples for GPT-3?cited by 1,195
- 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,076
- 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,073
- 2020Meta-Learning in Neural Networks: A Surveycited by 950
- 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 886
- 2021Are NLP Models really able to Solve Simple Math Word Problems?cited by 878
- 2023Vision-Language Models for Vision Tasks: A Surveycited by 839
- 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 783
- 2023Large Language Modelscited by 780
- 2023MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Modelscited by 735
- 2019MathQA: Towards Interpretable Math Word Problem Solving with Operation-Based Formalismscited by 662
- 2022PAL: Program-aided Language Modelscited by 652
- 2017Program Induction by Rationale Generation : Learning to Solve and Explain Algebraic Word Problemscited by 650
- 2023WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-Instructcited by 625
- 2023MAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuningcited by 487
- 2017Scene Graph Generation by Iterative Message Passingcited by 462
- 2024A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Modelscited by 452
- 2020Generative Language Modeling for Automated Theorem Provingcited by 388
- 2022Complexity-Based Prompting for Multi-Step Reasoningcited by 388
- 2023Llemma: An Open Language Model For Mathematicscited by 388
- 2021Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoningcited by 383
- 2023RepoCoder: Repository-Level Code Completion Through Iterative Retrieval and Generationcited by 367
- 2016Solving General Arithmetic Word Problemscited by 360
- 2022Large Language Models are Better Reasoners with Self-Verificationcited by 307
- 2023ToRA: A Tool-Integrated Reasoning Agent for Mathematical Problem Solvingcited by 282
- 2023Mathematical Capabilities of ChatGPTcited by 268
- 2022Emergent Analogical Reasoning in Large Language Modelscited by 240
- 2021GeoQA: A Geometric Question Answering Benchmark Towards Multimodal Numerical Reasoningcited by 228
50 most cited of 124 All 124 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024Large Language Models for Mathematical Reasoning: Progresses and Challenges
- 2022Why are NLP Models Fumbling at Elementary Math? A Survey of Deep Learning based Word Problem Solvers
- 2024Can Language Models Rival Mathematics Students? Evaluating Mathematical Reasoning through Textual Manipulation and Human Experiments
- 2024Do Large Language Models Truly Grasp Mathematics? An Empirical Exploration From Cognitive Psychology
- 2025CogMath: Assessing LLMs' Authentic Mathematical Ability from a Human Cognitive Perspective
- 2024Physics of Language Models: Part 2.1, Grade-School Math and the Hidden Reasoning Process
- 2023Mathematics, word problems, common sense, and artificial intelligence
- 2023Math Word Problem Solving by Generating Linguistic Variants of Problem Statements