mlsanityData to 14 Oct 2026

MathQA: Towards Interpretable Math Word Problem Solving with Operation-Based Formalisms

arXiv 1905.13319 ↗First posted 30 May 2019cs.CLcited by 662

Not on the map. Why?

Cited by 171 in LLM reasoning, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

We introduce a large-scale dataset of math word problems and an interpretable neural math problem solver that learns to map problems to operation programs. Due to annotation challenges, current datasets in this domain have been either relatively small in scale or did not offer precise operational annotations over diverse problem types. We introduce a new representation language to model precise operation programs corresponding to each math problem that aim to improve both the performance and the interpretability of the learned models. Using this representation language, our new dataset, MathQA, significantly enhances the AQuA dataset with fully-specified operational programs. We additionally introduce a neural sequence-to-program model enhanced with automatic problem categorization. Our experiments show improvements over competitive baselines in our MathQA as well as the AQuA dataset. The results are still significantly lower than human performance indicating that the dataset poses new challenges for future research. Our dataset is available at: https://math-qa.github.io/math-QA/

Key facts. Cited by 662 papers in the map (data through 14 Oct 2026). First posted on arXiv 30 May 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 30; 2022: 56; 2023: 74; 2024: 176; 2025: 217; 2026: 109.

662 papers.

Sort:

By area:

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  3. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  4. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  5. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
  6. 2021Program Synthesis with Large Language Modelscited by 3,637
  7. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  8. 2023A Survey of Large Language Modelscited by 2,576
  9. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,614
  10. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
  11. 2024OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problemscited by 1,136
  12. 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,076
38 more
  1. 2022Solving math word problems with process- and outcome-based feedbackcited by 901
  2. 2021Are NLP Models really able to Solve Simple Math Word Problems?cited by 878
  3. 2023H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Modelscited by 832
  4. 2023The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Onlycited by 763
  5. 2024A Survey on Large Language Models for Code Generationcited by 658
  6. 2022PAL: Program-aided Language Modelscited by 652
  7. 2023An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuningcited by 639
  8. 2022Towards Reasoning in Large Language Models: A Surveycited by 596
  9. 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 586
  10. 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 572
  11. 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 562
  12. 2023MAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuningcited by 487
  13. 2022Knowledge Unlearning for Mitigating Privacy Risks in Language Modelscited by 437
  14. 2025Scaling up Test-Time Compute with Latent Reasoning: A Recurrent Depth Approachcited by 415
  15. 2022Complexity-Based Prompting for Multi-Step Reasoningcited by 388
  16. 2021Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoningcited by 383
  17. 2022Dynamic Prompt Learning via Policy Gradient for Semi-structured Mathematical Reasoningcited by 350
  18. 2023CodeT5+: Open Code Large Language Models for Code Understanding and Generationcited by 333
  19. 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 331
  20. 2024InternLM-XComposer2: Mastering Free-form Text-Image Composition and Comprehension in Vision-Language Large Modelcited by 326
  21. 2021A Diverse Corpus for Evaluating and Developing English Math Word Problem Solverscited by 318
  22. 2022Large Language Models are Better Reasoners with Self-Verificationcited by 307
  23. 2023Large Language Models as Tool Makerscited by 303
  24. 2023Tool Learning with Foundation Modelscited by 302
  25. 2024We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?cited by 286
  26. 2024Large Language Models for Mathematical Reasoning: Progresses and Challengescited by 284
  27. 2023Mathematical Capabilities of ChatGPTcited by 268
  28. 2022Reasoning with Language Model Prompting: A Surveycited by 252
  29. 2024SVD-LLM: Truncation-aware Singular Value Decomposition for Large Language Model Compressioncited by 243
  30. 2024ReFT: Reasoning with Reinforced Fine-Tuningcited by 239
  31. 2022FOLIO: Natural Language Reasoning with First-Order Logiccited by 235
  32. 2021GeoQA: A Geometric Question Answering Benchmark Towards Multimodal Numerical Reasoningcited by 228
  33. 2023REFINER: Reasoning Feedback on Intermediate Representationscited by 205
  34. 2022TALM: Tool Augmented Language Modelscited by 197
  35. 2022ConvFinQA: Exploring the Chain of Numerical Reasoning in Conversational Finance Question Answeringcited by 196
  36. 2023RA-DIT: Retrieval-Augmented Dual Instruction Tuningcited by 195
  37. 2024Are We Done with MMLU?cited by 194
  38. 2021Muppet: Massive Multi-task Representations with Pre-Finetuningcited by 192

50 most cited of 662 All 662 (JSON)