The Impact of Large Language Models on Open-source Innovation: Evidence from GitHub Copilot
Not on the map. Why?
Abstract (arXiv)
Large Language Models (LLMs) are reshaping knowledge work, yet their impact on voluntary, self-guided open innovation forums (contributors choose tasks without managerial direction) may differ fundamentally from effects observed in organizational settings. We study this question in open-source software development, where individuals' contributions collectively drive innovation at a community level. Unlike product innovation, where typologies for classifying innovation are well established, knowledge work in open-source settings calls for a distinction grounded in the cognitive demand a task places on the contributor. Burgeoning literature distinguishes substantive contributions, which require creative problem formulation to introduce new functionality, from incremental contributions, which draw on comprehension of existing code to maintain and refine it. We exploit a natural experiment around GitHub Copilot's launch in October 2021, where Copilot supported languages like Python while not supporting R for business reasons, creating an exogenous partition between otherwise comparable ecosystems. Using three complementary identification strategies and two classification approaches, we find that Copilot availability increases open-source contributions by 28 to 40 percent. The increase in incremental contributions is significantly larger than the increase in substantive contributions across all specifications. This disparity is more pronounced in projects with higher activity levels and widens following a model upgrade: LLMs function more effectively when existing context helps define the problem and constrain solutions, tilting collaborative innovation toward exploitation of established codebases rather than exploration of new functionality. This paper provides a rare instance of causal field evidence on LLM effects, given the speed at which GenAI has exploded across the knowledge economy.
Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 4 of its 48 references that are in the map. First posted on arXiv 12 Sep 2024.
Builds on
4 of 48 references.
References · 4
- 2023The Impact of AI on Developer Productivity: Evidence from GitHub Copilotcited by 274
- 2022The Turing Trap: The Promise & Peril of Human-Like Artificial Intelligencecited by 42
- 2018Synthetic Difference in Differencescited by 41
- 2016Crowdsourcing the Robin Hood effect in citiescited by 1
Built on by
Citing papers per year: 2024: 2; 2025: 7; 2026: 4.
13 papers.
Sort:
By area:
- 2025Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivitycited by 101
- 2025CWM: An Open-Weights LLM for Research on Code Generation with World Modelscited by 93
- 2025Speed at the Cost of Quality: How Cursor AI Increases Short-Term Velocity and Long-Term Complexity in Open-Source Projectscited by 24
- 2026AIDev: Studying AI Coding Agents on GitHubcited by 17
- 2024The Impact of Generative AI on Collaborative Open-Source Software Development: Evidence from GitHub Copilotcited by 11
- 2026From Future of Work to Future of Workers: Addressing Asymptomatic AI Harms for Dignified Human-AI Interactioncited by 6
- 2025Flattening Supply Chains: When do Technology Improvements lead to Disintermediation?cited by 2
- 2025When Content is Goliath and Algorithm is David: The Style and Semantic Effects of Generative Search Enginecited by 2
- 2024GAI: Generative Agents for Innovationcited by 1
- 2025Can Vibe Coding Beat Graduate CS Students? An LLM vs. Human Coding Tournament on Market-driven Strategic Planningcited by 1
- 2026Adoption and Impact of Command-Line AI Coding Agents: A Study of Microsoft's Early 2026 Rollout of Claude Code and GitHub Copilot CLIcited by 1
- 2025Generative AI in Live Operations: Evidence of Productivity Gains in Cybersecurity and Endpoint Managementcited by 0
- 2026The Hitchhiker's Guide to Monoculture: AI Homogenizes Syntax, Not (Necessarily) Semantics12 Jul 2026
- 2026Adoption and Impact of Command-Line AI Coding Agents: A Study of Microsoft's Early 2026 Rollout of Claude Code and GitHub Copilot CLI1 Jul 2026
- 2026AIDev: Studying AI Coding Agents on GitHub9 Feb 2026
- 2026From Future of Work to Future of Workers: Addressing Asymptomatic AI Harms for Dignified Human-AI Interaction29 Jan 2026
- 2025Can Vibe Coding Beat Graduate CS Students? An LLM vs. Human Coding Tournament on Market-driven Strategic Planning25 Nov 2025
- 2025Speed at the Cost of Quality: How Cursor AI Increases Short-Term Velocity and Long-Term Complexity in Open-Source Projects6 Nov 2025
- 2025CWM: An Open-Weights LLM for Research on Code Generation with World Models30 Sep 2025
- 2025When Content is Goliath and Algorithm is David: The Style and Semantic Effects of Generative Search Engine17 Sep 2025
- 2025Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity12 Jul 2025
- 2025Generative AI in Live Operations: Evidence of Productivity Gains in Cybersecurity and Endpoint Management9 Apr 2025
- 2025Flattening Supply Chains: When do Technology Improvements lead to Disintermediation?28 Feb 2025
- 2024GAI: Generative Agents for Innovation25 Dec 2024
- 2025Speed at the Cost of Quality: How Cursor AI Increases Short-Term Velocity and Long-Term Complexity in Open-Source Projectscited by 24
- 2026AIDev: Studying AI Coding Agents on GitHubcited by 17
- 2024GAI: Generative Agents for Innovationcited by 1
- 2026Adoption and Impact of Command-Line AI Coding Agents: A Study of Microsoft's Early 2026 Rollout of Claude Code and GitHub Copilot CLIcited by 1
- 2026Adoption and Impact of Command-Line AI Coding Agents: A Study of Microsoft's Early 2026 Rollout of Claude Code and GitHub Copilot CLI1 Jul 2026
- 2026AIDev: Studying AI Coding Agents on GitHub9 Feb 2026
- 2025Speed at the Cost of Quality: How Cursor AI Increases Short-Term Velocity and Long-Term Complexity in Open-Source Projects6 Nov 2025
- 2024GAI: Generative Agents for Innovation25 Dec 2024
- 2025Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivitycited by 101
- 2024The Impact of Generative AI on Collaborative Open-Source Software Development: Evidence from GitHub Copilotcited by 11
- 2026From Future of Work to Future of Workers: Addressing Asymptomatic AI Harms for Dignified Human-AI Interactioncited by 6
- 2025Flattening Supply Chains: When do Technology Improvements lead to Disintermediation?cited by 2
- 2025When Content is Goliath and Algorithm is David: The Style and Semantic Effects of Generative Search Enginecited by 2
- 2025Can Vibe Coding Beat Graduate CS Students? An LLM vs. Human Coding Tournament on Market-driven Strategic Planningcited by 1
- 2025Generative AI in Live Operations: Evidence of Productivity Gains in Cybersecurity and Endpoint Managementcited by 0
- 2026The Hitchhiker's Guide to Monoculture: AI Homogenizes Syntax, Not (Necessarily) Semanticscited by 0
- 2026The Hitchhiker's Guide to Monoculture: AI Homogenizes Syntax, Not (Necessarily) Semantics12 Jul 2026
- 2026From Future of Work to Future of Workers: Addressing Asymptomatic AI Harms for Dignified Human-AI Interaction29 Jan 2026
- 2025Can Vibe Coding Beat Graduate CS Students? An LLM vs. Human Coding Tournament on Market-driven Strategic Planning25 Nov 2025
- 2025When Content is Goliath and Algorithm is David: The Style and Semantic Effects of Generative Search Engine17 Sep 2025
- 2025Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity12 Jul 2025
- 2025Generative AI in Live Operations: Evidence of Productivity Gains in Cybersecurity and Endpoint Management9 Apr 2025
- 2025Flattening Supply Chains: When do Technology Improvements lead to Disintermediation?28 Feb 2025
- 2024The Impact of Generative AI on Collaborative Open-Source Software Development: Evidence from GitHub Copilot2 Oct 2024