mlsanityData to 14 Oct 2026

Taxonomy-Targeted Error Generation for Quantitative Reasoning

arXiv 2605.29007 ↗First posted 27 May 2026cs.CLcited by 0

On the map: LLM reasoning → Mathematical reasoning

Abstract (arXiv)

Personalized tutoring, teacher preparation, and education research can benefit from worked errors annotated by the mechanisms that produced them. Authentic student errors with such cognitive labels are costly to collect and share, motivating the study of whether LLMs can generate taxonomy-targeted synthetic errors as complementary candidate material. We present a task-specific framework that generates errors targeted to a five-class Bloom-informed student-error taxonomy. A Generation Agent (GA) drafts a candidate erroneous solution conditioned on a target class, and an Examination Agent (EA) judges whether the draft is incorrect and class-consistent. The framework yields a reusable recipe for building class-stratified synthetic error datasets where authentic student corpora are unavailable. As a secondary diagnostic, targeted error generation is substantially harder than free-form incorrect-answer generation, and answer-grounding contributes more than expanded examples or external textbook content.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 16 of its 42 references that are in the map. First posted on arXiv 27 May 2026.

Builds on

16 of 42 references.

Closest ancestors · 6

Same direction, newest first

  1. 2026Can LLMs Model Incorrect Student Reasoning? A Case Study on Distractor Generation16 Mar
  2. 2025Learning to Make MISTAKEs: Modeling Incorrect Student Thinking And Key Errors13 Oct
  3. 2025Error Classification of Large Language Models on Math Word Problems: A Dynamically Adaptive Framework26 Jan
  4. 2024GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language Models7 Oct
  5. 2023WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-Instruct18 Aug
  6. 2023SciBench: Evaluating College-Level Scientific Problem-Solving Abilities of Large Language Models20 Jul

Other references · 10

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  3. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
  4. 2021Measuring Coding Challenge Competence With APPScited by 902
  5. 2022Solving math word problems with process- and outcome-based feedbackcited by 901
  6. 2023WizardCoder: Empowering Code Large Language Models with Evol-Instructcited by 733
  7. 2023TheoremQA: A Theorem-driven Question Answering datasetcited by 192
  8. 2024LLM-based Cognitive Models of Students with Misconceptionscited by 16
  9. 2024A Benchmark for Math Misconceptions: Bridging Gaps in Middle School Algebra with AI-Supported Instructioncited by 6
  10. 2024Can LLMs Identify Gaps and Misconceptions in Students' Code Explanations?cited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Stepwise Verification and Remediation of Student Reasoning Errors with Large Language Model Tutors
  2. 2025From Correctness to Comprehension: AI Agents for Personalized Error Diagnosis in Education
  3. 2026Towards Pedagogically Aligned LLM Tutors for Math Mistake Remediation
  4. 2026Catching The Correct Answer Trap: Characterising AI Tutor Blind Spots When Analysing Student Reasoning
  5. 2026MalruleLib: Large-Scale Executable Misconception Reasoning with Step Traces for Modeling Student Thinking in Mathematics
  6. 2024Physics of Language Models: Part 2.2, How to Learn From Mistakes on Grade-School Math Problems
  7. 2026The Correct Answer Trap: Pedagogically-Grounded Detection and Feedback for Hidden Misconceptions
  8. 2026Simulating Students' Java Programming Errors with Large Language Models