MalruleLib: Large-Scale Executable Misconception Reasoning with Step Traces for Modeling Student Thinking in Mathematics
On the map: LLM reasoning → Mathematical reasoning
Abstract (arXiv)
Student mistakes in mathematics are often systematic: a learner applies a coherent but wrong procedure and repeats it across contexts. We introduce MalruleLib, a learning-science-grounded framework that translates documented misconceptions into executable procedures, drawing on 67 learning-science and mathematics education sources, and generates step-by-step traces of malrule-consistent student work. We formalize a core student-modeling problem as Malrule Reasoning Accuracy (MRA): infer a misconception from one worked mistake and predict the student's next answer under cross-template rephrasing. Across nine language models (4B-120B), accuracy drops from 66% on direct problem solving to 40% on cross-template misconception prediction. MalruleLib encodes 101 malrules over 498 parameterized problem templates and produces paired dual-path traces for both correct reasoning and malrule-consistent student reasoning. Because malrules are executable and templates are parameterizable, MalruleLib can generate over one million instances, enabling scalable supervision and controlled evaluation. Using MalruleLib, we observe cross-template degradations of 10-21%, while providing student step traces improves prediction by 3-15%. We release MalruleLib as infrastructure for educational AI that models student procedures across contexts, enabling diagnosis and feedback that targets the underlying misconception.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 6 of its 90 references that are in the map. First posted on arXiv 6 Jan 2026.
Builds on
6 of 90 references.
Closest ancestors · 1
Same direction, newest first
Other references · 5
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2025Qwen3 Technical Reportcited by 8,195
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,258
- 2024Phi-4 Technical Reportcited by 675
- 2020qDKT: Question-centric Deep Knowledge Tracingcited by 24
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2023Novice Learner and Expert Tutor: Evaluating Math Reasoning Abilities of Large Language Models with Misconceptions
- 2026MisEdu-RAG: A Misconception-Aware Dual-Hypergraph RAG for Novice Math Teachers
- 2025Can Large Reasoning Models Improve Accuracy on Mathematical Tasks Using Flawed Thinking?
- 2025Learning to Make MISTAKEs: Modeling Incorrect Student Thinking And Key Errors
- 2026The Correct Answer Trap: Pedagogically-Grounded Detection and Feedback for Hidden Misconceptions
- 2026When Shallow Wins: Silent Failures and the Depth-Accuracy Paradox in Latent Reasoning
- 2025SMRC: Aligning Large Language Models with Student Reasoning for Mathematical Error Correction
- 2026Can LLMs Model Incorrect Student Reasoning? A Case Study on Distractor Generation