mlsanityData to 14 Oct 2026

The Impact of Large Language Models on Open-source Innovation: Evidence from GitHub Copilot

arXiv 2409.08379 ↗First posted 12 Sep 2024cs.SE cs.AI econ.GNcited by 13

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) are reshaping knowledge work, yet their impact on voluntary, self-guided open innovation forums (contributors choose tasks without managerial direction) may differ fundamentally from effects observed in organizational settings. We study this question in open-source software development, where individuals' contributions collectively drive innovation at a community level. Unlike product innovation, where typologies for classifying innovation are well established, knowledge work in open-source settings calls for a distinction grounded in the cognitive demand a task places on the contributor. Burgeoning literature distinguishes substantive contributions, which require creative problem formulation to introduce new functionality, from incremental contributions, which draw on comprehension of existing code to maintain and refine it. We exploit a natural experiment around GitHub Copilot's launch in October 2021, where Copilot supported languages like Python while not supporting R for business reasons, creating an exogenous partition between otherwise comparable ecosystems. Using three complementary identification strategies and two classification approaches, we find that Copilot availability increases open-source contributions by 28 to 40 percent. The increase in incremental contributions is significantly larger than the increase in substantive contributions across all specifications. This disparity is more pronounced in projects with higher activity levels and widens following a model upgrade: LLMs function more effectively when existing context helps define the problem and constrain solutions, tilting collaborative innovation toward exploitation of established codebases rather than exploration of new functionality. This paper provides a rare instance of causal field evidence on LLM effects, given the speed at which GenAI has exploded across the knowledge economy.

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 4 of its 48 references that are in the map. First posted on arXiv 12 Sep 2024.

Builds on

4 of 48 references.

References · 4

  1. 2023The Impact of AI on Developer Productivity: Evidence from GitHub Copilotcited by 274
  2. 2022The Turing Trap: The Promise & Peril of Human-Like Artificial Intelligencecited by 42
  3. 2018Synthetic Difference in Differencescited by 41
  4. 2016Crowdsourcing the Robin Hood effect in citiescited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 2; 2025: 7; 2026: 4.

13 papers.

Sort:

By area: