Does AI Assistance Leave a Temporal Fingerprint? Detecting Overreliance in AI-Assisted Writing and Programming
Not on the map. Why?
Abstract (arXiv)
The rapid adoption of generative AI has made final artifacts unreliable evidence of student learning, and AI detectors that examine only the finished product are inaccurate and ethically contentious. Process data offers an alternative, but prior work covers only English essay writing. We ask whether AI assistance carries a temporal signature, whether it generalizes from writing to programming, and whether it distinguishes ordinary collaboration from wholesale delegation. We analyze three public corpora: CoAuthor (1,447 keystroke-level co-writing sessions), RealHumanEval (editor telemetry from 243 programmer records), and a pre-LLM CS1 corpus (5.1 million keystrokes) as a human-only baseline, comparing minimal-AI work, collaborative AI use, and simulated wholesale delegation. Three findings emerge. First, the signature generalizes: AI contributions arrive in bursts far outside the author's own baseline in both mediums (paired dz = 1.13 and 3.54). Second, engagement diverges by medium: 93% of AI-inserted characters survived to writers' final documents, while only 14% of accepted code suggestions survived intact. Third, classifiers using only observable temporal features separate simulated delegation from authentic work nearly perfectly (F1 ≥ 0.997; at most 0.5% of real work misclassified), while ordinary collaboration remains hard to distinguish from unassisted work. Temporal evidence flags wholesale delegation rather than assistance, positioning process visibility as a candidate evidentiary basis for academic integrity, pending validation in authentic coursework.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 28 references that are in the map. First posted on arXiv 15 Sep 2026.
Builds on
12 of 28 references.
References · 12
- 2022CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilitiescited by 245
- 2024Detecting AI-Generated Sentences in Human-AI Collaborative Hybrid Texts: Challenges, Strategies, and Insightscited by 21
- 2024Keystroke Dynamics Against Academic Dishonesty in the Age of LLMscited by 6
- 2026Behavioral Indicators of Overreliance During Interaction with Conversational Language Modelscited by 5
- 2026Reactive Writers: How Co-Writing with AI Changes How We Engage with Ideascited by 4
- 2025LLM-Assisted Cheating Detection in Korean Language via Keystrokescited by 3
- 2026On the Insecurity of Keystroke-Based AI Authorship Detection: Timing-Forgery Attacks Against Motor-Signal Verificationcited by 2
- 2025Detecting AI Assistance in Abstract Complex Taskscited by 1
- 2026RelianceScope: An Analytical Framework for Examining Students' Reliance on Generative AI Chatbots in Problem Solvingcited by 1
- 2026AI Misuse in Education Is a Measurement Problem: Toward a Learning Visibility Frameworkcited by 1
- 2026RECAP: An End-to-End Platform for Capturing, Replaying, and Analyzing AI-Assisted Programming Interactionscited by 1
- 2026Learning from 53.6K Real-World Developer Edits of AI-Generated Codecited by 1
Built on by
Not cited yet.