# The Impact of Large Language Models on Open-source Innovation: Evidence from GitHub Copilot

arXiv: https://arxiv.org/abs/2409.08379 · HTML: https://mlsanity.com/paper/2409.08379/

## Key facts

- Cited by 13 papers in the map (data through 14 Oct 2026).
- Builds on 4 of its 48 references that are in the map.
- First posted on arXiv 12 Sep 2024.

## Builds on (most cited first, 4 of 4)

- [The Impact of AI on Developer Productivity: Evidence from GitHub Copilot](https://mlsanity.com/paper/2302.06590/) (2023)
- [The Turing Trap: The Promise & Peril of Human-Like Artificial Intelligence](https://mlsanity.com/paper/2201.04200/) (2022)
- [Synthetic Difference in Differences](https://mlsanity.com/paper/1812.09970/) (2018)
- [Crowdsourcing the Robin Hood effect in cities](https://mlsanity.com/paper/1604.08394/) (2016)

## Built on by (most cited first, 13 of 13)

- [Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity](https://mlsanity.com/paper/2507.09089/) (2025)
- [CWM: An Open-Weights LLM for Research on Code Generation with World Models](https://mlsanity.com/paper/2510.02387/) (2025)
- [Speed at the Cost of Quality: How Cursor AI Increases Short-Term Velocity and Long-Term Complexity in Open-Source Projects](https://mlsanity.com/paper/2511.04427/) (2025)
- [AIDev: Studying AI Coding Agents on GitHub](https://mlsanity.com/paper/2602.09185/) (2026)
- [The Impact of Generative AI on Collaborative Open-Source Software Development: Evidence from GitHub Copilot](https://mlsanity.com/paper/2410.02091/) (2024)
- [From Future of Work to Future of Workers: Addressing Asymptomatic AI Harms for Dignified Human-AI Interaction](https://mlsanity.com/paper/2601.21920/) (2026)
- [Flattening Supply Chains: When do Technology Improvements lead to Disintermediation?](https://mlsanity.com/paper/2502.20783/) (2025)
- [When Content is Goliath and Algorithm is David: The Style and Semantic Effects of Generative Search Engine](https://mlsanity.com/paper/2509.14436/) (2025)
- [GAI: Generative Agents for Innovation](https://mlsanity.com/paper/2412.18899/) (2024)
- [Can Vibe Coding Beat Graduate CS Students? An LLM vs. Human Coding Tournament on Market-driven Strategic Planning](https://mlsanity.com/paper/2511.20613/) (2025)
- [Adoption and Impact of Command-Line AI Coding Agents: A Study of Microsoft's Early 2026 Rollout of Claude Code and GitHub Copilot CLI](https://mlsanity.com/paper/2607.01418/) (2026)
- [Generative AI in Live Operations: Evidence of Productivity Gains in Cybersecurity and Endpoint Management](https://mlsanity.com/paper/2504.08805/) (2025)
- [The Hitchhiker's Guide to Monoculture: AI Homogenizes Syntax, Not (Necessarily) Semantics](https://mlsanity.com/paper/2607.13077/) (2026)

## Abstract (arXiv)

Large Language Models (LLMs) are reshaping knowledge work, yet their impact on voluntary, self-guided open innovation forums (contributors choose tasks without managerial direction) may differ fundamentally from effects observed in organizational settings. We study this question in open-source software development, where individuals' contributions collectively drive innovation at a community level. Unlike product innovation, where typologies for classifying innovation are well established, knowledge work in open-source settings calls for a distinction grounded in the cognitive demand a task places on the contributor. Burgeoning literature distinguishes substantive contributions, which require creative problem formulation to introduce new functionality, from incremental contributions, which draw on comprehension of existing code to maintain and refine it. We exploit a natural experiment around GitHub Copilot's launch in October 2021, where Copilot supported languages like Python while not supporting R for business reasons, creating an exogenous partition between otherwise comparable ecosystems. Using three complementary identification strategies and two classification approaches, we find that Copilot availability increases open-source contributions by 28 to 40 percent. The increase in incremental contributions is significantly larger than the increase in substantive contributions across all specifications. This disparity is more pronounced in projects with higher activity levels and widens following a model upgrade: LLMs function more effectively when existing context helps define the problem and constrain solutions, tilting collaborative innovation toward exploitation of established codebases rather than exploration of new functionality. This paper provides a rare instance of causal field evidence on LLM effects, given the speed at which GenAI has exploded across the knowledge economy.
