mlsanityData to 14 Oct 2026

RECAP: An End-to-End Platform for Capturing, Replaying, and Analyzing AI-Assisted Programming Interactions

arXiv 2605.01104 ↗First posted 1 May 2026cs.SE cs.CL cs.HCcited by 1

Not on the map. Why?

Abstract (arXiv)

Understanding how developers interact with AI coding assistants requires more than chat logs or git histories in isolation; it requires reconstructing the full context: which prompt led to which edit, what the developer tried and discarded, and how their strategy evolved over time. We present RECAP (Replay and Examine Captured AI Programming), an open-source platform that (1) passively records AI chat sessions and fine-grained code edits inside VS Code without disrupting the developer's workflow, (2) merges them into a unified timeline for interactive session replay, and (3) exposes an extensible analysis layer, with example modules for behavioral classification and AI reliance measurement. Deployed in a university software engineering course, RECAP captured 2,034 prompts and 8,239 code edits from 41 students across a multi-week project. We demonstrate how the platform's linked data and replay capabilities enable analyses of developer-AI interaction patterns that no single data source could support.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 14 of its 28 references that are in the map. First posted on arXiv 1 May 2026.

Builds on

14 of 28 references.

References · 14

  1. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  2. 2022CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilitiescited by 249
  3. 2022Grounded Copilot: How Programmers Interact with Code-Generating Modelscited by 218
  4. 2022Reading Between the Lines: Modeling User Behavior and Costs in AI-Assisted Programmingcited by 91
  5. 2024CodeAid: Evaluating a Classroom Deployment of an LLM-based Programming Assistant that Balances Student and Educator Needscited by 84
  6. 2026SWE-chat: Coding Agent Interactions From Real Users in the Wildcited by 43
  7. 2023StudentEval: A Benchmark of Student-Written Prompts for Large Language Models of Codecited by 32
  8. 2024The RealHumanEval: Evaluating Large Language Models' Abilities to Support Programmerscited by 30
  9. 2025Code with Me or for Me? How Increasing AI Automation Transforms Developer Workflowscited by 28
  10. 2025Copilot Arena: A Platform for Code LLM Evaluation in the Wildcited by 26
  11. 2025Not Everyone Wins with LLMs: Behavioral Patterns and Pedagogical Implications for AI Literacy in Programmatic Data Sciencecited by 6
  12. 2026Evolving with AI: A Longitudinal Analysis of Developer Logscited by 4
2 more
  1. 2025KOALA: a Configurable Tool for Collecting IDE Data When Solving Programming Taskscited by 3
  2. 2025CodeWatcher: IDE Telemetry Data Extraction Tool for Understanding Coding Interactions with LLMscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.