mlsanityData to 14 Oct 2026

Tailoring Diagnostic Modeling to Individual Learners: Personalized Distractor Generation via MCTS-Guided Reasoning Reconstruction

arXiv 2508.11184 ↗First posted 15 Aug 2025cs.CLcited by 3

Not on the map. Why?

Abstract (arXiv)

Distractors-incorrect yet plausible answer choices in multiple-choice questions (MCQs)-are vital in educational assessments, as they help identify student misconceptions by presenting potential reasoning errors. Current distractor generation methods typically produce shared distractors for all students, ignoring the individual variations in reasoning, which limits their diagnostic effectiveness. To tackle this challenge, we introduce the task of Personalized Distractor Generation, which tailors distractors to each student's specific cognitive flaws, inferred from their past question-answering (QA) history. While promising, this task is particularly demanding due to the limited number of QA records available for each student, which are insufficient for training, as well as the absence of their underlying reasoning process. To overcome this, we propose a novel, training-free two-stage framework. In the first stage, Monte Carlo Tree Search (MCTS) is used to reconstruct the student's reasoning process from past errors, creating a student-specific misconception prototype. In the second stage, this prototype guides the simulation of the student's reasoning on new questions, generating personalized distractors that resonate with their individual misconceptions. Our experiments, conducted on 1,361 students across 6 subjects, demonstrate that this approach outperforms existing methods in generating plausible, personalized distractors, and also effectively adapts to group-level settings, highlighting its robustness and versatility.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 31 of its 61 references that are in the map. First posted on arXiv 15 Aug 2025.

Builds on

31 of 61 references.

References · 31

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  4. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  5. 2023C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Modelscited by 708
  6. 2024ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree Searchcited by 344
  7. 2024AlphaMath Almost Zero: Process Supervision without Processcited by 162
  8. 2024Accessing GPT-4 level Mathematical Olympiad Solutions via Monte Carlo Tree Self-refine with LLaMa-3 8Bcited by 158
  9. 2023Bridging the Novice-Expert Gap via Models of Decision-Making: A Case Study on Remediating Math Mistakescited by 52
  10. 2024AutoGeo: Automating Geometric Image Dataset Creation for Enhanced Geometry Understandingcited by 29
  11. 2024Distractor Generation in Multiple-Choice Tasks: A Survey of Methods, Datasets, and Evaluationcited by 25
  12. 2025Embracing Imperfection: Simulating Students with Diverse Cognitive Levels Using LLM-based Agentscited by 19
19 more
  1. 2021Results and Insights from Diagnostic Questions: The NeurIPS 2020 Education Challengecited by 18
  2. 2024LLM-based Cognitive Models of Students with Misconceptionscited by 16
  3. 2023Distractor generation for multiple-choice questions with predictive prompting and large language modelscited by 15
  4. 2025Towards Transformer-Based Aligned Generation with Self-Coherence Guidancecited by 14
  5. 2024Improving Automated Distractor Generation for Math Multiple-choice Questions with Overgenerate-and-rankcited by 12
  6. 2021Option Tracing: Beyond Correctness Analysis in Knowledge Tracingcited by 11
  7. 2024ModelGPT: Unleashing LLM's Capabilities for Tailored Model Generationcited by 11
  8. 2025Knowledge is Power: Harnessing Large Language Models for Enhanced Cognitive Diagnosiscited by 10
  9. 2022No Task Left Behind: Multi-Task Learning of Knowledge Tracing and Option Tracing for Better Student Assessmentcited by 8
  10. 2025Generating Plausible Distractors for Multiple-Choice Questions via Student Choice Predictioncited by 8
  11. 2025Multiple-Choice Question Generation Using Large Language Models: Methodology and Educator Insightscited by 8
  12. 2024DiVERT: Distractor Generation with Variational Errors Represented as Text for Math Multiple-choice Questionscited by 7
  13. 2025LookAlike: Consistent Distractor Generation in Math MCQscited by 7
  14. 2024A Comprehensive Exploration of Personalized Learning in Smart Education: From Student Modeling to Personalized Recommendationscited by 5
  15. 2024DisGeM: Distractor Generation for Multiple Choice Questions with Span Maskingcited by 5
  16. 2025Sigma: Differential Rescaling of Query, Key and Value for Efficient Language Modelscited by 3
  17. 2025Diff-Prompt: Diffusion-Driven Prompt Generator with Mask Supervisioncited by 3
  18. 2025WisdomBot: Tuning Large Language Models with Artificial Intelligence Knowledgecited by 1
  19. 2025D-GEN: Automatic Distractor Generation and Evaluation for Reliable Assessment of Generative Modelcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 2.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Can LLMs Model Incorrect Student Reasoning? A Case Study on Distractor Generation
  2. 2026Beyond Fine-Tuning: In-Context Learning and Chain-of-Thought for Reasoned Distractor Generation
  3. 2024DGRC: An Effective Fine-tuning Framework for Distractor Generation in Chinese Multi-choice Reading Comprehension
  4. 2025Harnessing Structured Knowledge: A Concept Map-Based Approach for High-Quality Multiple Choice Question Generation with Effective Distractors
  5. 2025Reasoning and Sampling-Augmented MCQ Difficulty Prediction via LLMs
  6. 2024Enhancing Distractor Generation for Multiple-Choice Questions with Retrieval Augmented Pretraining and Knowledge Graph Integration
  7. 2025Do LLMs Make Mistakes Like Students? Exploring Natural Alignment between Language Models and Human Error Patterns
  8. 2025PrismRAG: Boosting RAG Factuality with Distractor Resilience and Strategized Reasoning