mlsanityData to 14 Oct 2026

Teaching Language Models How to Code Like Learners: Conversational Serialization for Student Simulation

arXiv 2604.10720 ↗First posted 12 Apr 2026cs.AI cs.CL cs.CYcited by 1

Not on the map. Why?

Abstract (arXiv)

Artificial students -- models that simulate how learners act and respond within educational systems -- are a promising tool for evaluating tutoring strategies and feedback mechanisms at scale. However, most existing approaches rely on prompting large, proprietary language models, limiting adaptability to specific courses and raising concerns around privacy, cost, and dependence. In this work, we propose a framework for training open-weight artificial programming learners directly from authentic student process data. Our approach serializes temporal log traces into a conversational format, representing each student's problem-solving process as a dialogue between the learner and their automated assessment system. Student code submissions and environment feedback, such as test outcomes, grades, and error traces, form alternating conversational turns, enabling models to learn from the iterative debugging process. We additionally introduce a training pipeline combining supervised fine-tuning with preference optimization to align models with authentic student debugging behavior. We evaluate our framework by training Qwen models at 4B and 8B scales on a large-scale dataset of real student submissions to Python programming assignments. Our results show that incorporating environment feedback strengthens models' ability to replicate student debugging behavior, improving over both prior code-only approaches and prompted large language models baselines in functional alignment and code similarity. We release our code to support reproducibility.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 26 of its 51 references that are in the map. First posted on arXiv 12 Apr 2026.

Builds on

26 of 51 references.

References · 26

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  4. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  5. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  6. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  7. 2023WizardLM: Empowering large pre-trained language models to follow complex instructionscited by 1,125
  8. 2023Enhancing Chat Language Models by Scaling High-quality Instructional Conversationscited by 839
  9. 2020CodeBLEU: a Method for Automatic Evaluation of Code Synthesiscited by 479
  10. 2023Orca: Progressive Learning from Complex Explanation Traces of GPT-4cited by 379
  11. 2022CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement Learningcited by 358
  12. 2024OpenCodeInterpreter: Integrating Code Generation with Execution and Refinementcited by 247
14 more
  1. 2024Exploring Knowledge Tracing in Tutor-Student Dialogues using LLMscited by 46
  2. 2025Training LLM-based Tutors to Improve Student Learning Outcomes in Dialoguescited by 43
  3. 2023Automating Human Tutor-Style Programming Feedback: Leveraging GPT-4 Tutor Model for Hint Generation and GPT-3.5 Student Model for Hint Validationcited by 29
  4. 2024Improving the Validity of Automatically Generated Feedback via Reinforcement Learningcited by 20
  5. 2025From Problem-Solving to Teaching Problem-Solving: Aligning LLMs with Pedagogy using Reinforcement Learningcited by 17
  6. 2024Improving Socratic Question Generation using Data Augmentation and Preference Optimizationcited by 16
  7. 2024MIND: Math Informed syNthetic Dialogues for Pretraining LLMscited by 14
  8. 2025Modeling Student Learning with 3.8 Million Program Tracescited by 10
  9. 2024Test Case-Informed Knowledge Tracing for Open-ended Coding Taskscited by 7
  10. 2024LLM-itation is the Sincerest Form of Data: Generating Synthetic Buggy Code Submissions for Computing Educationcited by 7
  11. 2026KASER: Knowledge-Aligned Student Error Simulator for Open-Ended Coding Taskscited by 7
  12. 2024Synthetic Students: A Comparative Study of Bug Distribution Between Large Language Models and Computing Studentscited by 6
  13. 2025Automated Knowledge Component Generation for Interpretable Knowledge Tracing in Coding Problemscited by 5
  14. 2025Synthesizing High-Quality Programming Tasks with LLM-based Expert and Student Agentscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026A Classroom Study of LLM-Generated Feedback Intervention in Introductory Programming
  2. 2025Embracing Imperfection: Simulating Students with Diverse Cognitive Levels Using LLM-based Agents
  3. 2026Simulated Students in Tutoring Dialogues: Substance or Illusion?
  4. 2024Hints-In-Browser: Benchmarking Language Models for Programming Feedback Generation
  5. 2025Training Turn-by-Turn Verifiers for Dialogue Tutoring Agents: The Curious Case of LLMs as Your Coding Tutors
  6. 2026Simulating Novice Students Using Machine Unlearning and Relearning in Large Language Models
  7. 2025Autograder+: A Multi-Faceted AI Framework for Rich Pedagogical Feedback in Programming Education
  8. 2026Design and Deployment of a Course-Aware AI Tutor in an Introductory Programming Course ↗