mlsanityData to 7 Oct 2026

MalruleLib: Large-Scale Executable Misconception Reasoning with Step Traces for Modeling Student Thinking in Mathematics

arXiv 2601.03217 ↗First posted 6 Jan 2026cs.CLcited by 1

On the map: LLM reasoning → Mathematical reasoning

Abstract (arXiv)

Student mistakes in mathematics are often systematic: a learner applies a coherent but wrong procedure and repeats it across contexts. We introduce MalruleLib, a learning-science-grounded framework that translates documented misconceptions into executable procedures, drawing on 67 learning-science and mathematics education sources, and generates step-by-step traces of malrule-consistent student work. We formalize a core student-modeling problem as Malrule Reasoning Accuracy (MRA): infer a misconception from one worked mistake and predict the student's next answer under cross-template rephrasing. Across nine language models (4B-120B), accuracy drops from 66% on direct problem solving to 40% on cross-template misconception prediction. MalruleLib encodes 101 malrules over 498 parameterized problem templates and produces paired dual-path traces for both correct reasoning and malrule-consistent student reasoning. Because malrules are executable and templates are parameterizable, MalruleLib can generate over one million instances, enabling scalable supervision and controlled evaluation. Using MalruleLib, we observe cross-template degradations of 10-21%, while providing student step traces improves prediction by 3-15%. We release MalruleLib as infrastructure for educational AI that models student procedures across contexts, enabling diagnosis and feedback that targets the underlying misconception.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 6 of its 90 references that are in the map. First posted on arXiv 6 Jan 2026.

Builds on

6 of 90 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024Mathfish: Evaluating Language Model Math Reasoning via Grounding in Educational Curricula8 Aug

Other references · 5

  1. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  2. 2025Qwen3 Technical Reportcited by 8,195
  3. 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,258
  4. 2024Phi-4 Technical Reportcited by 675
  5. 2020qDKT: Question-centric Deep Knowledge Tracingcited by 24

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2023Novice Learner and Expert Tutor: Evaluating Math Reasoning Abilities of Large Language Models with Misconceptions
  2. 2026MisEdu-RAG: A Misconception-Aware Dual-Hypergraph RAG for Novice Math Teachers
  3. 2025Can Large Reasoning Models Improve Accuracy on Mathematical Tasks Using Flawed Thinking?
  4. 2025Learning to Make MISTAKEs: Modeling Incorrect Student Thinking And Key Errors
  5. 2026The Correct Answer Trap: Pedagogically-Grounded Detection and Feedback for Hidden Misconceptions
  6. 2026When Shallow Wins: Silent Failures and the Depth-Accuracy Paradox in Latent Reasoning
  7. 2025SMRC: Aligning Large Language Models with Student Reasoning for Mathematical Error Correction
  8. 2026Can LLMs Model Incorrect Student Reasoning? A Case Study on Distractor Generation