Analogical Math Word Problems Solving with Enhanced Problem-Solution Association
On the map: LLM reasoning → Mathematical reasoning
Abstract (arXiv)
Math word problem (MWP) solving is an important task in question answering which requires human-like reasoning ability. Analogical reasoning has long been used in mathematical education, as it enables students to apply common relational structures of mathematical situations to solve new problems. In this paper, we propose to build a novel MWP solver by leveraging analogical MWPs, which advance the solver's generalization ability across different kinds of MWPs. The key idea, named analogy identification, is to associate the analogical MWP pairs in a latent space, i.e., encoding an MWP close to another analogical MWP, while moving away from the non-analogical ones. Moreover, a solution discriminator is integrated into the MWP solver to enhance the association between the representations of MWPs and their true solutions. The evaluation results verify that our proposed analogical learning strategy promotes the performance of MWP-BERT on Math23k over the state-of-the-art model Generate2Rank, with 5 times fewer parameters in the encoder. We also find that our model has a stronger generalization ability in solving difficult MWPs due to the analogical learning from easy MWPs.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 25 of its 51 references that are in the map. First posted on arXiv 1 Dec 2022.
Builds on
25 of 51 references.
Closest ancestors · 1
Same direction, newest first
Other references · 24
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2016Towards Evaluating the Robustness of Neural Networkscited by 2,976
- 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,341
- 2019MathQA: Towards Interpretable Math Word Problem Solving with Operation-Based Formalismscited by 653
- 2020Revisiting Pre-Trained Models for Chinese Natural Language Processingcited by 262
- 2020Nearest Neighbor Machine Translationcited by 209
- 2022A Survey on Retrieval-Augmented Text Generationcited by 157
- 2020Birds have four legs?! NumerSense: Probing Numerical Commonsense Knowledge of Pre-trained Language Modelscited by 110
- 2021Efficient Nearest Neighbor Language Modelscited by 93
- 2021Generate & Rank: A Multi-task Framework for Math Word Problemscited by 82
12 more
- 2018Translating a Math Word Problem to an Expression Treecited by 57
- 2021Neural-Symbolic Solver for Math Word Problems with Auxiliary Taskscited by 38
- 2021MWP-BERT: Numeracy-Augmented Pre-training for Math Word Problem Solvingcited by 32
- 2018The Gap of Semantic Parsing: A Survey on Automatic Math Word Problem Solverscited by 31
- 2021Seeking Patterns, Not just Memorizing Procedures: Contrastive Learning for Solving Math Word Problemscited by 30
- 2021Learning Kernel-Smoothed Machine Translation with Retrieved Examplescited by 25
- 2022Relational Memory Augmented Language Modelscited by 24
- 2022LogicSolver: Towards Interpretable Math Word Problem Solving with Logical Prompt-enhanced Learningcited by 24
- 2021Investigating Math Word Problems using Pretrained Multilingual Language Modelscited by 21
- 2020SMART: A Situation Model for Algebra Story Problems via Attributed Grammarcited by 14
- 2021Recall and Learn: A Memory-augmented Solver for Math Word Problemscited by 13
- 2021Towards Tractable Mathematical Reasoning: Challenges, Strategies, and Opportunities for Solving Math Word Problemscited by 12
Built on by
Citing papers per year: 2023: 3; 2024: 1.
4 papers.
- 2023Let GPT be a Math Tutor: Teaching Math Word Problem Solvers with Customized Exercise Generationcited by 27
- 2023MinT: Boosting Generalization in Mathematical Reasoning via Multi-View Fine-Tuningcited by 16
- 2023An Expression Tree Decoding Strategy for Mathematical Equation Generationcited by 4
- 2024From Large to Tiny: Distilling and Refining Mathematical Expertise for Math Word Problems with Weakly Supervisioncited by 2
- 2024From Large to Tiny: Distilling and Refining Mathematical Expertise for Math Word Problems with Weakly Supervision21 Mar 2024
- 2023An Expression Tree Decoding Strategy for Mathematical Equation Generation14 Oct 2023
- 2023MinT: Boosting Generalization in Mathematical Reasoning via Multi-View Fine-Tuning16 Jul 2023
- 2023Let GPT be a Math Tutor: Teaching Math Word Problem Solvers with Customized Exercise Generation22 May 2023
Similar, not cited
Close in wording, no citation either way
- 2023Math Word Problem Solving by Generating Linguistic Variants of Problem Statements
- 2024Learning by Analogy: Enhancing Few-Shot Prompting for Math Word Problem Solving with Computational Graph-Based Retrieval
- 2023MWPRanker: An Expression Similarity Based Math Word Problem Retriever
- 2023Techniques to Improve Neural Math Word Problem Solvers
- 2025MetaLadder: Ascending Mathematical Solution Quality via Analogical-Problem Reasoning Transfer
- 2022Why are NLP Models Fumbling at Elementary Math? A Survey of Deep Learning based Word Problem Solvers
- 2024Instructing Large Language Models to Identify and Ignore Irrelevant Conditions
- 2024DOP: Diagnostic-Oriented Prompting for Large Language Models in Mathematical Correction