MWPToolkit: An Open-Source Framework for Deep Learning-Based Math Word Problem Solvers
Not on the map. Why?
Abstract (arXiv)
Developing automatic Math Word Problem (MWP) solvers has been an interest of NLP researchers since the 1960s. Over the last few years, there are a growing number of datasets and deep learning-based methods proposed for effectively solving MWPs. However, most existing methods are benchmarked soly on one or two datasets, varying in different configurations, which leads to a lack of unified, standardized, fair, and comprehensive comparison between methods. This paper presents MWPToolkit, the first open-source framework for solving MWPs. In MWPToolkit, we decompose the procedure of existing MWP solvers into multiple core components and decouple their models into highly reusable modules. We also provide a hyper-parameter search function to boost the performance. In total, we implement and compare 17 MWP solvers on 4 widely-used single equation generation benchmarks and 2 multiple equations generation benchmarks. These features enable our MWPToolkit to be suitable for researchers to reproduce advanced baseline models and develop new MWP solvers quickly. Code and documents are available at https://github.com/LYH-YF/MWPToolkit.
Key facts. Cited by 39 papers in the map (data through 7 Oct 2026). Builds on 26 of its 49 references that are in the map. First posted on arXiv 2 Sep 2021.
Builds on
26 of 49 references.
References · 26
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,471
- 2021Are NLP Models really able to Solve Simple Math Word Problems?cited by 861
- 2019DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generationcited by 842
- 2021Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoningcited by 376
- 2021A Diverse Corpus for Evaluating and Developing English Math Word Problem Solverscited by 314
- 2017OpenNMT: Open-source Toolkit for Neural Machine Translationcited by 251
- 2021GeoQA: A Geometric Question Answering Benchmark Towards Multimodal Numerical Reasoningcited by 224
- 2020RecBole: Towards a Unified, Comprehensive and Efficient Framework for Recommendation Algorithmscited by 137
14 more
- 2018Translating a Math Word Problem to an Expression Treecited by 57
- 2021ExplainaBoard: An Explainable Leaderboard for NLPcited by 50
- 2018Semantically-Aligned Equation Generation for Solving and Reasoning Math Word Problemscited by 49
- 2021Neural-Symbolic Solver for Math Word Problems with Auxiliary Taskscited by 38
- 2016Variational Neural Machine Translationcited by 35
- 2020Semantically-Aligned Universal Tree-Structured Solver for Math Word Problemscited by 35
- 2021CRSLab: An Open-Source Toolkit for Building Conversational Recommender Systemcited by 34
- 2018The Gap of Semantic Parsing: A Survey on Automatic Math Word Problem Solverscited by 31
- 2020Graph-to-Tree Neural Networks for Learning Structured Input-Output Translation with Applications to Semantic Parsing and Math Word Problemcited by 31
- 2016Annotating Derivations: A New Evaluation Strategy and Dataset for Algebra Word Problemscited by 28
- 2020Photon: A Robust Cross-Domain Text-to-SQL Systemcited by 26
- 2020Learning by Fixing: Solving Math Word Problems with Weak Supervisioncited by 25
- 2021Investigating Math Word Problems using Pretrained Multilingual Language Modelscited by 21
- 2021TextBox: A Unified, Modularized, and Extensible Framework for Text Generationcited by 15
Built on by
Citing papers per year: 2021: 1; 2022: 14; 2023: 16; 2024: 6; 2025: 1; 2026: 1.
39 papers.
Sort:
By area:
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
- 2023WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-Instructcited by 618
- 2023Scaling Relationship on Learning Mathematical Reasoning with Large Language Modelscited by 417
- 2023Active Prompting with Chain-of-Thought for Large Language Modelscited by 154
- 2022A Survey of Deep Learning for Mathematical Reasoningcited by 124
- 2023Automatic Prompt Augmentation and Selection with Chain-of-Thought from Labeled Datacited by 119
- 2024A Review of Large Language Models and Autonomous Agents in Chemistrycited by 96
- 2022Solving Math Word Problems via Cooperative Reasoning induced Language Modelscited by 76
- 2022Learning to Reason Deductively: Math Word Problem Solving as Complex Relation Extractioncited by 44
- 2023An Independent Evaluation of ChatGPT on Mathematical Word Problems (MWP)cited by 31
27 more
- 2023Let GPT be a Math Tutor: Teaching Math Word Problem Solvers with Customized Exercise Generationcited by 27
- 2023Enhancing Chain-of-Thoughts Prompting with Iterative Bootstrapping in Large Language Modelscited by 16
- 2022JiuZhang: A Chinese Pre-trained Language Model for Mathematical Problem Understandingcited by 15
- 2021Solving Linear Algebra by Program Synthesiscited by 14
- 2022Chaining Simultaneous Thoughts for Numerical Reasoningcited by 14
- 2022Multi-View Reasoning: Consistent Contrastive Learning for Math Word Problemcited by 13
- 2023Learning Multi-Step Reasoning by Solving Arithmetic Taskscited by 12
- 2022Why are NLP Models Fumbling at Elementary Math? A Survey of Deep Learning based Word Problem Solverscited by 9
- 2022Generalizing Math Word Problem Solvers via Solution Diversificationcited by 7
- 2023Math Word Problem Solving by Generating Linguistic Variants of Problem Statementscited by 7
- 2022Towards Robust Numerical Question Answering: Diagnosing Numerical Capabilities of NLP Systemscited by 6
- 2023Learning by Applying: A General Framework for Mathematical Reasoning via Enhancing Explicit Knowledge Learningcited by 5
- 2024Chain-of-Translation Prompting (CoTR): A Novel Prompting Technique for Low Resource Languagescited by 5
- 2023An Expression Tree Decoding Strategy for Mathematical Equation Generationcited by 4
- 2024Shears: Unstructured Sparsity with Neural Low-rank Adapter Searchcited by 4
- 2023Chatbots put to the test in math and logic problems: A preliminary comparison and assessment of ChatGPT-3.5, ChatGPT-4, and Google Bardcited by 3
- 2024Survey of Natural Language Processing for Education: Taxonomy, Systematic Review, and Future Trendscited by 3
- 2025Learnware of Language Models: Specialized Small Language Models Can Do Bigcited by 3
- 2023JiuZhang 2.0: A Unified Chinese Pre-trained Language Model for Multi-task Mathematical Problem Solvingcited by 2
- 2024BAIT: Benchmarking (Embedding) Architectures for Interactive Theorem-Provingcited by 2
- 2022ComSearch: Equation Searching with Combinatorial Strategy for Solving Math Word Problems with Weak Supervisioncited by 1
- 2023MWPRanker: An Expression Similarity Based Math Word Problem Retrievercited by 1
- 2023SEGO: Sequential Subgoal Optimization for Mathematical Problem-Solvingcited by 1
- 2022Tackling Math Word Problems with Fine-to-Coarse Abstracting and Reasoningcited by 0
- 2023Techniques to Improve Neural Math Word Problem Solverscited by 0
- 2024Data Augmentation with In-Context Learning and Comparative Evaluation in Math Word Problem Solvingcited by 0
- 2026GradingAttack: Exposing Security Vulnerabilities in LLM Based Educational Grading Agentscited by 0
- 2026GradingAttack: Exposing Security Vulnerabilities in LLM Based Educational Grading Agents1 Feb 2026
- 2025Learnware of Language Models: Specialized Small Language Models Can Do Big19 May 2025
- 2024Chain-of-Translation Prompting (CoTR): A Novel Prompting Technique for Low Resource Languages6 Sep 2024
- 2024A Review of Large Language Models and Autonomous Agents in Chemistry26 Jun 2024
- 2024Shears: Unstructured Sparsity with Neural Low-rank Adapter Search16 Apr 2024
- 2024Data Augmentation with In-Context Learning and Comparative Evaluation in Math Word Problem Solving5 Apr 2024
- 2024BAIT: Benchmarking (Embedding) Architectures for Interactive Theorem-Proving6 Mar 2024
- 2024Survey of Natural Language Processing for Education: Taxonomy, Systematic Review, and Future Trends15 Jan 2024
- 2023SEGO: Sequential Subgoal Optimization for Mathematical Problem-Solving19 Oct 2023
- 2023An Expression Tree Decoding Strategy for Mathematical Equation Generation14 Oct 2023
- 2023WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-Instruct18 Aug 2023
- 2023Scaling Relationship on Learning Mathematical Reasoning with Large Language Models3 Aug 2023
27 more
- 2023MWPRanker: An Expression Similarity Based Math Word Problem Retriever3 Jul 2023
- 2023Math Word Problem Solving by Generating Linguistic Variants of Problem Statements24 Jun 2023
- 2023JiuZhang 2.0: A Unified Chinese Pre-trained Language Model for Multi-task Mathematical Problem Solving19 Jun 2023
- 2023Learning Multi-Step Reasoning by Solving Arithmetic Tasks2 Jun 2023
- 2023Chatbots put to the test in math and logic problems: A preliminary comparison and assessment of ChatGPT-3.5, ChatGPT-4, and Google Bard30 May 2023
- 2023Let GPT be a Math Tutor: Teaching Math Word Problem Solvers with Customized Exercise Generation22 May 2023
- 2023Enhancing Chain-of-Thoughts Prompting with Iterative Bootstrapping in Large Language Models23 Apr 2023
- 2023Automatic Prompt Augmentation and Selection with Chain-of-Thought from Labeled Data24 Feb 2023
- 2023An Independent Evaluation of ChatGPT on Mathematical Word Problems (MWP)23 Feb 2023
- 2023Active Prompting with Chain-of-Thought for Large Language Models23 Feb 2023
- 2023Learning by Applying: A General Framework for Mathematical Reasoning via Enhancing Explicit Knowledge Learning11 Feb 2023
- 2023Techniques to Improve Neural Math Word Problem Solvers6 Feb 2023
- 2022A Survey of Deep Learning for Mathematical Reasoning20 Dec 2022
- 2022Generalizing Math Word Problem Solvers via Solution Diversification1 Dec 2022
- 2022Chaining Simultaneous Thoughts for Numerical Reasoning29 Nov 2022
- 2022Towards Robust Numerical Question Answering: Diagnosing Numerical Capabilities of NLP Systems14 Nov 2022
- 2022Solving Math Word Problems via Cooperative Reasoning induced Language Models28 Oct 2022
- 2022Multi-View Reasoning: Consistent Contrastive Learning for Math Word Problem21 Oct 2022
- 2022ComSearch: Equation Searching with Combinatorial Strategy for Solving Math Word Problems with Weak Supervision13 Oct 2022
- 2022JiuZhang: A Chinese Pre-trained Language Model for Mathematical Problem Understanding13 Jun 2022
- 2022Why are NLP Models Fumbling at Elementary Math? A Survey of Deep Learning based Word Problem Solvers31 May 2022
- 2022Tackling Math Word Problems with Fine-to-Coarse Abstracting and Reasoning17 May 2022
- 2022PaLM: Scaling Language Modeling with Pathways5 Apr 2022
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Models21 Mar 2022
- 2022Learning to Reason Deductively: Math Word Problem Solving as Complex Relation Extraction19 Mar 2022
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Models28 Jan 2022
- 2021Solving Linear Algebra by Program Synthesis16 Nov 2021
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2023WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-Instructcited by 618
- 2023Scaling Relationship on Learning Mathematical Reasoning with Large Language Modelscited by 417
- 2023Active Prompting with Chain-of-Thought for Large Language Modelscited by 154
- 2022A Survey of Deep Learning for Mathematical Reasoningcited by 124
- 2023Automatic Prompt Augmentation and Selection with Chain-of-Thought from Labeled Datacited by 119
- 2022Solving Math Word Problems via Cooperative Reasoning induced Language Modelscited by 76
- 2022Learning to Reason Deductively: Math Word Problem Solving as Complex Relation Extractioncited by 44
- 2023Enhancing Chain-of-Thoughts Prompting with Iterative Bootstrapping in Large Language Modelscited by 16
- 2023Learning Multi-Step Reasoning by Solving Arithmetic Taskscited by 12
- 2023Math Word Problem Solving by Generating Linguistic Variants of Problem Statementscited by 7
12 most cited of 15 All 15 (JSON)
- 2023WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-Instruct18 Aug 2023
- 2023Scaling Relationship on Learning Mathematical Reasoning with Large Language Models3 Aug 2023
- 2023Math Word Problem Solving by Generating Linguistic Variants of Problem Statements24 Jun 2023
- 2023JiuZhang 2.0: A Unified Chinese Pre-trained Language Model for Multi-task Mathematical Problem Solving19 Jun 2023
- 2023Learning Multi-Step Reasoning by Solving Arithmetic Tasks2 Jun 2023
- 2023Enhancing Chain-of-Thoughts Prompting with Iterative Bootstrapping in Large Language Models23 Apr 2023
- 2023Automatic Prompt Augmentation and Selection with Chain-of-Thought from Labeled Data24 Feb 2023
- 2023Active Prompting with Chain-of-Thought for Large Language Models23 Feb 2023
- 2023Learning by Applying: A General Framework for Mathematical Reasoning via Enhancing Explicit Knowledge Learning11 Feb 2023
- 2023Techniques to Improve Neural Math Word Problem Solvers6 Feb 2023
- 2022A Survey of Deep Learning for Mathematical Reasoning20 Dec 2022
- 2022Solving Math Word Problems via Cooperative Reasoning induced Language Models28 Oct 2022
12 newest of 15 All 15 (JSON)
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
- 2023An Independent Evaluation of ChatGPT on Mathematical Word Problems (MWP)cited by 31
- 2023Let GPT be a Math Tutor: Teaching Math Word Problem Solvers with Customized Exercise Generationcited by 27
- 2022JiuZhang: A Chinese Pre-trained Language Model for Mathematical Problem Understandingcited by 15
- 2021Solving Linear Algebra by Program Synthesiscited by 14
- 2022Chaining Simultaneous Thoughts for Numerical Reasoningcited by 14
- 2022Multi-View Reasoning: Consistent Contrastive Learning for Math Word Problemcited by 13
- 2022Why are NLP Models Fumbling at Elementary Math? A Survey of Deep Learning based Word Problem Solverscited by 9
- 2022Generalizing Math Word Problem Solvers via Solution Diversificationcited by 7
- 2022Towards Robust Numerical Question Answering: Diagnosing Numerical Capabilities of NLP Systemscited by 6
- 2024Chain-of-Translation Prompting (CoTR): A Novel Prompting Technique for Low Resource Languagescited by 5
- 2023An Expression Tree Decoding Strategy for Mathematical Equation Generationcited by 4
12 most cited of 22 All 22 (JSON)
- 2025Learnware of Language Models: Specialized Small Language Models Can Do Big19 May 2025
- 2024Chain-of-Translation Prompting (CoTR): A Novel Prompting Technique for Low Resource Languages6 Sep 2024
- 2024Shears: Unstructured Sparsity with Neural Low-rank Adapter Search16 Apr 2024
- 2024Data Augmentation with In-Context Learning and Comparative Evaluation in Math Word Problem Solving5 Apr 2024
- 2024BAIT: Benchmarking (Embedding) Architectures for Interactive Theorem-Proving6 Mar 2024
- 2024Survey of Natural Language Processing for Education: Taxonomy, Systematic Review, and Future Trends15 Jan 2024
- 2023SEGO: Sequential Subgoal Optimization for Mathematical Problem-Solving19 Oct 2023
- 2023An Expression Tree Decoding Strategy for Mathematical Equation Generation14 Oct 2023
- 2023MWPRanker: An Expression Similarity Based Math Word Problem Retriever3 Jul 2023
- 2023Chatbots put to the test in math and logic problems: A preliminary comparison and assessment of ChatGPT-3.5, ChatGPT-4, and Google Bard30 May 2023
- 2023Let GPT be a Math Tutor: Teaching Math Word Problem Solvers with Customized Exercise Generation22 May 2023
- 2023An Independent Evaluation of ChatGPT on Mathematical Word Problems (MWP)23 Feb 2023
12 newest of 22 All 22 (JSON)