Examining Variation in How Guided AI Tutors Resolve Student Impasses
Not on the map. Why?
Abstract (arXiv)
When a student is stuck, a tutor faces the assistance dilemma: help given too early can hinder productive struggle, while help withheld too long leaves the student in a frustrating, persistent impasse (i.e., wheel spinning). Generative AI tutors increasingly use guardrails restricting answer-giving, yet little is known about how such tutors behave once an impasse persists. We analyze 20,462 student turns from 1,260 authentic sessions with a guided LLM chemistry tutor, identifying 6,630 impasse turns of three major types: conceptual errors, expressed uncertainty, or help-seeking. We then used these impasses to simulate three tutoring conditions to study variation in AI tutor guidance through impasses: baseline, no-direct-answer, and guided tutor. For a sample of 150 impasses, prompt specificity changed pedagogy: a baseline tutor provided the answer directly in 50.7% of responses, a no-direct-answer tutor asked a follow-up question every time, and the guided tutor responded in a wide variety of ways depending on the context. We then analyzed impasse trajectories in authentic interactions, finding that each additional impasse turn lowered the odds of next-turn recovery by 12.7% (AOR = 0.873, p < .001), and early dropouts were caught in recursive concept elicitation before reaching execution. The benefit of questioning decayed as impasses persisted (scripted question x depth AOR = 0.78; follow-up x depth AOR = 0.83), whereas addressing the student's error grew more beneficial (AOR = 1.14); after a failed scripted question, repeating it was followed by recovery in 28.1% of cases, compared with 39.8% when the tutor addressed the error instead. For learning analytics, these findings identify impasse depth and type as observable, turn-level dialogue signals that analytics can use to trigger graduated, state-sensitive assistance in real time.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 49 references that are in the map. First posted on arXiv 29 Sep 2026.
Builds on
15 of 49 references.
References · 15
- 2023ChatGPT Outperforms Crowd-Workers for Text-Annotation Taskscited by 870
- 2023MathDial: A Dialogue Tutoring Dataset with Rich Pedagogical Properties Grounded in Math Reasoning Problemscited by 131
- 2022The AI Teacher Test: Measuring the Pedagogical Ability of Blender and GPT-3 in Educational Dialoguescited by 79
- 2023CodeHelp: Using Large Language Models with Guardrails for Scalable Support in Programming Classescited by 72
- 2024Unifying AI Tutor Evaluation: An Evaluation Taxonomy for Pedagogical Ability Assessment of LLM-Powered AI Tutorscited by 61
- 2024Towards Responsible Development of Generative AI for Education: An Evaluation-Driven Approachcited by 54
- 2024Tutor CoPilot: A Human-AI Approach for Scaling Real-Time Expertisecited by 50
- 2024Exploring Knowledge Tracing in Tutor-Student Dialogues using LLMscited by 46
- 2025Training LLM-based Tutors to Improve Student Learning Outcomes in Dialoguescited by 43
- 2024Stepwise Verification and Remediation of Student Reasoning Errors with Large Language Model Tutorscited by 41
- 2023Patterns of Student Help-Seeking When Using a Large Language Model-Powered Programming Assistantcited by 13
- 2023Improving Student Learning with Hybrid Human-AI Tutoring: A Three-Study Quasi-Experimental Investigationcited by 8
3 more
- 2025Intent Matters: Enhancing AI Tutoring with Fine-Grained Pedagogical Intent Annotationcited by 8
- 2023Generative Artificial Intelligence in Learning Analytics: Contextualising Opportunities and Challenges through the Learning Analytics Cyclecited by 6
- 2024AI Meets the Classroom: When Do Large Language Models Harm Learning?cited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Towards Reward Modeling for AI Tutors in Math Mistake Remediation
- 2026Large Language Models as Students Who Think Aloud: Overly Coherent, Verbose, and Confident
- 2026Catching The Correct Answer Trap: Characterising AI Tutor Blind Spots When Analysing Student Reasoning
- 2026AI Assistants Overassist
- 2026Micro-level AI Feedback Features and Student Responses in Consecutive LLM Tutoring Interactions ↗
- 2026Regulating the AI Tutor: Intentions, Help-Seeking, and Self-Regulated Learning in Adolescent GenAI Use ↗
- 2026SafeTutors: Benchmarking Pedagogical Safety in AI Tutoring Systems
- 2026Rethinking LLM-Judged Helpfulness as a Pedagogy Signal: A Pre-Registered Audit Across Tutor Models