mlsanityData to 14 Oct 2026

Toward Measuring AI's Effects on Skill Formation: The Stock-Formation Gap

arXiv 2605.16283 ↗First posted 12 Apr 2026cs.CY cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Large-scale AI deployment data and controlled learning experiments characterize different consequences of the same technology. Deployment telemetry shows that AI use is concentrated in skilled work and frequently supports immediate task performance. It observes tasks, interaction patterns, and outputs, however, not whether users become more capable of performing those tasks independently. Controlled studies measure independent capability more directly, but only in narrower populations and settings, with outcomes that vary substantially by interaction design. We formulate this discrepancy as a stock--formation measurement gap: current systems observe the use of existing expertise more readily than the formation of future expertise. Because formation has historically been society's recovery mechanism through technological change, the gap matters well beyond any single classroom. We synthesize the experimental and observational evidence by identification strength, use public deployment data as a descriptive illustration of the gap, and identify the missing bridge between interaction traces and unassisted retention and transfer. We then propose a research program that links consented usage records to independent assessments while experimentally varying whether AI supplies answers, hints, feedback, or evaluation. The claim is not that AI has been shown to erode skill formation at population scale. It is that existing measurement cannot determine whether it does, and that this question is both measurable and designable.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 40 references that are in the map. First posted on arXiv 12 Apr 2026.

Builds on

10 of 40 references.

References · 10

  1. 2025Which Economic Tasks are Performed with AI? Evidence from Millions of Claude Conversationscited by 96
  2. 2024Beware of Metacognitive Laziness: Effects of Generative Artificial Intelligence on Learning Motivation, Processes, and Performancecited by 58
  3. 2025Can Large Language Models Match Tutoring System Adaptivity? A Benchmarking Studycited by 18
  4. 2024Promises and challenges of generative artificial intelligence for human learningcited by 17
  5. 2025The StudyChat Dataset: Analyzing Student Dialogues With ChatGPT in an Artificial Intelligence Coursecited by 9
  6. 2025Disentangling Learning from Judgment: Representation Learning for Open Response Analyticscited by 5
  7. 2026Practicing with Language Models Cultivates Human Empathic Communicationcited by 3
  8. 2024Does the Doer Effect Exist Beyond WEIRD Populations? Toward Analytics in Radio and Phone-Based Learningcited by 1
  9. 2025Toward Sufficient Statistical Power in Algorithmic Bias Assessment: A Test for ABROCAcited by 1
  10. 2026LLAMA LIMA: A Living Meta-Analysis on the Effects of Generative AI on Learning Mathematicscited by 1

Built on by

Not cited yet.