mlsanityData to 13 Oct 2026

TutorTrace: A Dataset and Taxonomy for Classifying Learner Behavioral States during AI-Assisted Programming Education

arXiv 2608.26184 ↗First posted 22 Aug 2026cs.AI cs.HCcited by 0

Not on the map. Why?

Abstract (arXiv)

AI programming tutors provide scalable support, yet lack the behavioral context human tutors rely on to adapt support to learners' needs. We present TutorTrace, a dataset and behavioral abstraction pipeline that makes learners' behavioral context visible and computable in real time from low-level IDE telemetry. Across four deployments in two introductory Python courses (N=480), TutorTrace captures approximately 180K telemetry events, 13,633 behavioral segments, and 27 continuously computed metrics. From this foundation, we derive a taxonomy of learner activity before the first AI query, between consecutive queries, and across the full session, enabling systems to respond not just to what learners say, but to what they have done leading up to the help-seeking moment. In a preliminary classroom evaluation, behavior-aware prompts were associated with a decrease in intervals between queries with no independent work from 50.0% to 20.7%. As an additional demonstration of downstream utility, we evaluate TutorTrace on two held-out prediction tasks: whether a learner will query within the next 60 seconds (AUROC=.726) and whether an upcoming query reflects guided or dependent help-seeking (AUROC=.717). Together, these findings show how behavioral context can enable adaptive AI tutoring at scale.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 9 of its 41 references that are in the map. First posted on arXiv 22 Aug 2026.

Builds on

9 of 41 references.

References · 9

  1. 2022Grounded Copilot: How Programmers Interact with Code-Generating Modelscited by 217
  2. 2022Reading Between the Lines: Modeling User Behavior and Costs in AI-Assisted Programmingcited by 91
  3. 2024CodeAid: Evaluating a Classroom Deployment of an LLM-based Programming Assistant that Balances Student and Educator Needscited by 82
  4. 2025"Don't Forget the Teachers": Towards an Educator-Centered Understanding of Harms from Large Language Models in Educationcited by 14
  5. 2024CodeTailor: LLM-Powered Personalized Parsons Puzzles for Engaging Support While Learning Programmingcited by 11
  6. 2025Not Everyone Wins with LLMs: Behavioral Patterns and Pedagogical Implications for AI Literacy in Programmatic Data Sciencecited by 5
  7. 2026Behavioral Indicators of Overreliance During Interaction with Conversational Language Modelscited by 5
  8. 2025Exploring Student Behaviors and Motivations using AI TAs with Optional Guardrailscited by 3
  9. 2026Editrail: Understanding AI Usage by Visualizing Student-AI Interaction in Codecited by 3

Built on by

Not cited yet.