mlsanityData to 14 Oct 2026

SMRC: Aligning Large Language Models with Student Reasoning for Mathematical Error Correction

arXiv 2511.14684 ↗First posted 18 Nov 2025cs.CLcited by 0

On the map: LLM reasoning → Mathematical reasoning

also in 1 more
Abstract (arXiv)

Large language models (LLMs) often make reasoning errors when solving mathematical problems, and how to automatically detect and correct these errors has become an important research direction. However, existing approaches textitmainly focus on self-correction within the model, which falls short of the "teacher-style" correction required in educational settings, textiti.e., systematically guiding and revising a student' s problem-solving process. To address this gap, we propose textttSMRC (textitunderlineStudent underlineMathematical underlineReasoning underlineCorrection), a novel method that aligns LLMs with student reasoning. Specifically, textttSMRC formulates student reasoning as a multi-step sequential decision problem and introduces Monte Carlo Tree Search (MCTS) to explore optimal correction paths. To reduce the cost of the annotating process-level rewards, we leverage breadth-first search (BFS) guided by LLMs and final-answer evaluation to generate reward signals, which are then distributed across intermediate reasoning steps via a back-propagation mechanism, enabling fine-grained process supervision. Additionally, we construct a benchmark for high school mathematics, MSEB (Multi-Solution Error Benchmark), consisting of 158 instances that include problem statements, student solutions, and correct reasoning steps. We further propose a dual evaluation protocol centered on solution accuracy and correct-step retention, offering a comprehensive measure of educational applicability. Experiments demonstrate that textttSMRC significantly outperforms existing methods on two public datasets (ProcessBench and MR-GSM8K) and our MSEB in terms of effectiveness and overall performance. The code are available at https://github.com/ECNU-RAIL/SMRC-EMNLP2026.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 20 of its 21 references that are in the map. First posted on arXiv 18 Nov 2025.

Builds on

20 of 21 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025A Survey on Large Language Models for Mathematical Reasoning10 Jun
  2. 2025Large Language Models and Mathematical Reasoning Failures17 Feb

Other references · 18

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  3. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  4. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  5. 2024OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problemscited by 1,136
  6. 2022Scaling Laws for Reward Model Overoptimizationcited by 1,095
  7. 2025The Lessons of Developing Process Reward Models in Mathematical Reasoningcited by 415
  8. 2024ProcessBench: Identifying Process Errors in Mathematical Reasoningcited by 292
  9. 2022Generating Sequences by Learning to Self-Correctcited by 277
  10. 2025TokenSkip: Controllable Chain-of-Thought Compression in LLMscited by 249
  11. 2023Planning with Large Language Models for Code Generationcited by 182
  12. 2021Monte Carlo Tree Search: A Review of Recent Modifications and Applicationscited by 161
6 more
  1. 2023SelfCheck: Using LLMs to Zero-Shot Check Their Own Step-by-Step Reasoningcited by 159
  2. 2025LIMR: Less is More for RL Scalingcited by 139
  3. 2025Towards Thinking-Optimal Scaling of Test-Time Compute for LLM Reasoningcited by 119
  4. 2024Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervisioncited by 96
  5. 2024Enhancing LLM Reasoning via Critique Models with Test-Time and Training-Time Supervisioncited by 60
  6. 2023On Diversified Preferences of Large Language Model Alignmentcited by 26

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024SuperCorrect: Advancing Small LLM Reasoning with Thought Template Distillation and Self-Correction
  2. 2025LEMMA: Learning from Errors for MatheMatical Advancement in LLMs
  3. 2024Evaluating Mathematical Reasoning of Large Language Models: A Focus on Error Identification and Correction
  4. 2024Stepwise Verification and Remediation of Student Reasoning Errors with Large Language Model Tutors
  5. 2024Exposing the Achilles' Heel: Evaluating LLMs Ability to Handle Mistakes in Mathematical Reasoning
  6. 2024Physics of Language Models: Part 2.2, How to Learn From Mistakes on Grade-School Math Problems
  7. 2025UGMathBench: A Diverse and Dynamic Benchmark for Undergraduate-Level Mathematical Reasoning with Large Language Models
  8. 2024MC-NEST: Enhancing Mathematical Reasoning in Large Language Models leveraging a Monte Carlo Self-Refine Tree