Do LLM Tutors Actually Teach? A Process-Centered Synthesis of the Tutoring Loop
Not on the map. Why?
Abstract (arXiv)
Large language models can produce fluent tu- toring dialogue, but whether they actually help students learn remains unclear. We present a process-centered synthesis of LLM tutoring that follows the path from learner-state infer- ence to pedagogical action, tutor training, eval- uation, and student simulation. This view ex- poses a central gap: implementing a tutoring component does not establish that it works or that its outputs meaningfully affect later stages. A structured study-level audit shows that peda- gogical evaluation is common, while evidence becomes much thinner for learner-conditioned intervention, human learning gains, and espe- cially transfer or delayed retention. Human studies nevertheless provide a conditional posi- tive result: LLM tutors can improve learning, but benefits depend on pedagogical structure, learner engagement, and how learning is mea- sured. We argue that progress requires validat- ing the interfaces between tutoring stages, not only improving individual components.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 57 of its 120 references that are in the map. First posted on arXiv 11 Oct 2026.
Builds on
57 of 120 references.
References · 57
- 2015Deep Knowledge Tracingcited by 332
- 2023MathDial: A Dialogue Tutoring Dataset with Rich Pedagogical Properties Grounded in Math Reasoning Problemscited by 131
- 2024Simulating Classroom Education with LLM-Empowered Agentscited by 127
- 2024CodeAid: Evaluating a Classroom Deployment of an LLM-based Programming Assistant that Balances Student and Educator Needscited by 84
- 2022The AI Teacher Test: Measuring the Pedagogical Ability of Blender and GPT-3 in Educational Dialoguescited by 79
- 2024Multi-turn Reinforcement Learning from Preference Human Feedbackcited by 67
- 2024Unifying AI Tutor Evaluation: An Evaluation Taxonomy for Pedagogical Ability Assessment of LLM-Powered AI Tutorscited by 61
- 2023Bridging the Novice-Expert Gap via Models of Decision-Making: A Case Study on Remediating Math Mistakescited by 52
- 2024Tutor CoPilot: A Human-AI Approach for Scaling Real-Time Expertisecited by 50
- 2025MathTutorBench: A Benchmark for Measuring Open-ended Pedagogical Capabilities of LLM Tutorscited by 49
- 2023CLASS: A Design Framework for building Intelligent Tutoring Systems based on Learning Science principlescited by 48
- 2024Exploring Knowledge Tracing in Tutor-Student Dialogues using LLMscited by 46
38 more
- 2022Automatic Generation of Socratic Subquestions for Teaching Math Word Problemscited by 43
- 2025Training LLM-based Tutors to Improve Student Learning Outcomes in Dialoguescited by 43
- 2024Stepwise Verification and Remediation of Student Reasoning Errors with Large Language Model Tutorscited by 41
- 2024MathVC: An LLM-Simulated Multi-Character Virtual Classroom for Mathematics Educationcited by 37
- 2024Empowering Personalized Learning through a Conversation-based Tutoring System with Student Modelingcited by 34
- 2024AutoTutor meets Large Language Models: A Language Model Tutor with Rich Pedagogy and Guardrailscited by 31
- 2023LLM-as-a-tutor in EFL Writing Education: Focusing on Evaluation of Student-LLM Interactioncited by 29
- 2024Ruffle&Riley: Insights from Designing and Evaluating a Large Language Model-Based Conversational Tutoring Systemcited by 26
- 2024Towards the Pedagogical Steering of Large Language Models for Tutoring: A Case Study with Modeling Productive Failurecited by 24
- 2025SMART: Simulated Students Aligned with Item Response Theory for Question Difficulty Predictioncited by 23
- 2024Towards Modeling Learner Performance with Large Language Modelscited by 21
- 2025ToMATO: Verbalizing the Mental States of Role-Playing LLMs for Benchmarking Theory of Mindcited by 21
- 2025Training Turn-by-Turn Verifiers for Dialogue Tutoring Agents: The Curious Case of LLMs as Your Coding Tutorscited by 20
- 2025Can Large Language Models Match Tutoring System Adaptivity? A Benchmarking Studycited by 18
- 2025Findings of the BEA 2025 Shared Task on Pedagogical Ability Assessment of AI-powered Tutorscited by 18
- 2026Simulated Students in Tutoring Dialogues: Substance or Illusion?cited by 18
- 2024Improving Socratic Question Generation using Data Augmentation and Preference Optimizationcited by 16
- 2024Boosting Large Language Models with Socratic Method for Conversational Mathematics Teachingcited by 16
- 2024Instruct, Not Assist: LLM-based Multi-Turn Planning and Hierarchical Questioning for Socratic Code Debuggingcited by 14
- 2024Scaffolding Language Learning via Multi-modal Tutoring Systems with Pedagogical Instructionscited by 12
- 2025Intent Matters: Enhancing AI Tutoring with Fine-Grained Pedagogical Intent Annotationcited by 8
- 2025Alignment Drift in CEFR-prompted LLMs for Interactive Spanish Tutoringcited by 7
- 2025A Theory of Adaptive Scaffolding for LLM-Based Pedagogical Agentscited by 7
- 2026Evaluating Answer Leakage Robustness of LLM Tutors against Adversarial Student Attackscited by 7
- 2024Student Data Paradox and Curious Case of Single Student-Tutor Model: Regressive Side Effects of Training LLMs for Personalized Learningcited by 6
- 2025CoDAE: Adapting Large Language Models for Education via Chain-of-Thought Data Augmentationcited by 5
- 2025Pedagogy-driven Evaluation of Generative AI-powered Intelligent Tutoring Systemscited by 5
- 2025Exploring LLMs for Predicting Tutor Strategy and Student Outcomes in Dialoguescited by 4
- 2026Letting Tutor Personas Speak Up for LLMs: Learning Steering Vectors from Dialogue via Preference Optimizationcited by 4
- 2026Implicit Turn-Wise Policy Optimization for Proactive User-LLM Interactioncited by 4
- 2024Awaking the Slides: A Tuning-free and Knowledge-regulated AI Tutoring System via Language Model Coordinationcited by 3
- 2025Mining the Gold: Student-AI Chat Logs as Rich Sources for Automated Knowledge Gap Detectioncited by 3
- 2026Evidence-Decision-Feedback: Theory-Driven Adaptive Scaffolding for LLM Agentscited by 3
- 2026From Untamed Black Box to Interpretable Pedagogical Orchestration: The Ensemble of Specialized LLMs Architecture for Adaptive Tutoringcited by 3
- 2026Who Am I? History-Aware Profiles for Student Simulation in Tutoring Dialoguescited by 3
- 2025AgentTutor: Empowering Personalized Learning with Multi-Turn Interactive Teaching in Intelligent Education Systemscited by 2
- 2026Interpretable Difficulty-Aware Knowledge Tracing in Tutor-Student Dialoguescited by 2
- 2026Retrieval-Augmented Tutoring for Algorithm Tracing and Problem-Solving in AI Educationcited by 2
50 most cited of 57 All 57 (JSON)
Built on by
Not cited yet.