mlsanityData to 14 Oct 2026

How Real Is AI Tutoring? Comparing Simulated and Human Dialogues in One-on-One Instruction

arXiv 2509.01914 ↗First posted 2 Sep 2025cs.AI cs.CL cs.MAcited by 2

Not on the map. Why?

Abstract (arXiv)

Heuristic and scaffolded teacher-student dialogues are widely regarded as critical for fostering students' higher-order thinking and deep learning. However, large language models (LLMs) currently face challenges in generating pedagogically rich interactions. This study systematically investigates the structural and behavioral differences between AI-simulated and authentic human tutoring dialogues. We conducted a quantitative comparison using an Initiation-Response-Feedback (IRF) coding scheme and Epistemic Network Analysis (ENA). The results show that human dialogues are significantly superior to their AI counterparts in utterance length, as well as in questioning (I-Q) and general feedback (F-F) behaviors. More importantly, ENA results reveal a fundamental divergence in interactional patterns: human dialogues are more cognitively guided and diverse, centered around a "question-factual response-feedback" teaching loop that clearly reflects pedagogical guidance and student-driven thinking; in contrast, simulated dialogues exhibit a pattern of structural simplification and behavioral convergence, revolving around an "explanation-simplistic response" loop that is essentially a simple information transfer between the teacher and student. These findings illuminate key limitations in current AI-generated tutoring and provide empirical guidance for designing and evaluating more pedagogically effective generative educational dialogue systems.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 7 of its 46 references that are in the map. First posted on arXiv 2 Sep 2025.

Builds on

7 of 46 references.

References · 7

  1. 2023Generative AIcited by 120
  2. 2024Large Language Models and Cognitive Science: A Comprehensive Review of Similarities, Differences, and Challengescited by 49
  3. 2023CGMI: Configurable General Multi-Agent Interaction Frameworkcited by 42
  4. 2024Learning-by-teaching with ChatGPT: The effect of teachable ChatGPT agent on programming educationcited by 9
  5. 2023High-Ratio Compression for Machine-Generated Datacited by 3
  6. 2025MAS-KCL: Knowledge component graph structure learning with large language model-based agentic workflowcited by 3
  7. 2025IntelliChain: An Integrated Framework for Enhanced Socratic Method Dialogue with LLMs and Knowledge Graphscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026INSIDE the Student's Mind: Jointly Modeling Latent Reasoning and Action in LLM Student Simulators
  2. 2026Simulated Students in Tutoring Dialogues: Substance or Illusion?
  3. 2023Towards Applying Powerful Large AI Models in Classroom Teaching: Opportunities, Challenges and Prospects
  4. 2025EducationQ: Evaluating LLMs' Teaching Capabilities Through Multi-Agent Dialogue Framework
  5. 2026Large Language Models as Students Who Think Aloud: Overly Coherent, Verbose, and Confident
  6. 2026Simulating Students or Sycophantic Problem Solving? On Misconception Faithfulness of LLM Simulators
  7. 2023Comparative Analysis of GPT-4 and Human Graders in Evaluating Praise Given to Students in Synthetic Dialogues
  8. 2026GRADE: Generalizable Reasoning-Aware Dialogue Evaluation for AI Tutors