Program of Equations Thoughts to Solve Algebra Word Problems
On the map: LLM reasoning → Mathematical reasoning
Abstract (arXiv)
Solving algebraic word problems (AWPs) has recently emerged as an important natural language processing task. Recently, large language models (LLMs) have demonstrated powerful mathematical capabilities, and the Chain-of-Thought technique, which guides LLMs through step-by-step reasoning, has yielded impressive results. However, this reasoning ability is limited by the computational weaknesses of LLMs themselves, where calculation errors can accumulate, leading to incorrect final answers. To address this, we propose Program of Equations Thoughts (POET), which transforms the task of generating step-by-step reasoning answers into a two-stage task of predicting equations and generating code, offloading complex computations to a Python interpreter to avoid calculation errors in LLMs. Furthermore, we propose Zero-shot POET, which utilizes a manually designed template to enable LLMs to directly generate Python code for one-step solving. Our method achieves accuracies of 95.3% and 98.0% on the PEN and ALG514 datasets, respectively, setting a new state-of-the-art (SOTA). Zero-shot POET also achieves the SOTA result of 95.5% on the DRAW-1K dataset.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 16 of its 24 references that are in the map. First posted on arXiv 26 May 2025.
Builds on
16 of 24 references.
Closest ancestors · 1
Same direction, newest first
Other references · 15
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023GPT-4 Technical Reportcited by 18,132
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,397
- 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,057
- 2022Automatic Chain of Thought Prompting in Large Language Modelscited by 684
- 2022PAL: Program-aided Language Modelscited by 635
- 2022Complexity-Based Prompting for Multi-Step Reasoningcited by 387
- 2023How is ChatGPT's behavior changing over time?cited by 265
3 more
- 2023Mathematical Capabilities of ChatGPTcited by 263
- 2022Language Models of Code are Few-Shot Commonsense Learnerscited by 160
- 2016Annotating Derivations: A New Evaluation Strategy and Dataset for Algebra Word Problemscited by 28
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023MathPrompter: Mathematical Reasoning using Large Language Models
- 2025Structured Reasoning with Tree-of-Thoughts for Bengali Math Word Problems
- 2023Design of Chain-of-Thought in Math Problem Solving
- 2025Token-by-Token Regeneration and Domain Biases: A Benchmark of LLMs on Advanced Mathematical Problem-Solving
- 2023Exploring Equation as a Better Intermediate Meaning Representation for Numerical Reasoning
- 2025Large Language Models Don't Make Sense of Word Problems. A Scoping Review from a Mathematics Education Perspective
- 2024MathDivide: Improved mathematical reasoning by large language models
- 2025Can LLMs Reason Abstractly Over Math Word Problems Without CoT? Disentangling Abstract Formulation From Arithmetic Computation