The Uneven Decline of Collective Knowledge Production: Evidence from Stack Overflow After Generative AI
Not on the map. Why?
Abstract (arXiv)
Generative AI (Gen AI) is reshaping how individuals learn and work, but its consequences for collective knowledge, the shared body of knowledge that online communities produce together, remain poorly understood. Prior work has documented an aggregate decline in participation on knowledge-sharing platforms, but it remains unclear which specific kinds of knowledge are being lost first. We study this question using Stack Overflow, one of the largest online communities for software engineering, treating the release of ChatGPT-3.5 as a natural shock. Analyzing over two million questions posted between 2020 and 2025, we track how two dimensions of collective knowledge, difficulty and data availability, change following Gen AI's release. Using diverse methods and robust checks, we find consistent patterns. Easy questions decline sharply while difficult questions become more common, a pattern corroborated by rising code complexity. Data-rich topics and tags lose share of questions, while data-scarce ones gain ground. The two dimensions also interact: the decline in easy questions is concentrated specifically within data-rich domains, while difficult questions increase regardless of data availability. This pattern extends beyond Python across programming languages, with more prevalent languages showing sharper shifts. Together, our findings reveal that Gen AI's impact on collective knowledge is uneven, eroding easy, accessible knowledge first while more complex, less common knowledge persists.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 53 references that are in the map. First posted on arXiv 28 Sep 2026.
Builds on
17 of 53 references.
References · 17
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,411
- 2022Competition-Level Code Generation with AlphaCodecited by 1,462
- 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 798
- 2023Foundation Models in Robotics: Applications, Challenges, and the Futurecited by 216
- 2023ChatGPT Beyond English: Towards a Comprehensive Evaluation of Large Language Models in Multilingual Learningcited by 206
- 2025Your Brain on ChatGPT: Accumulation of Cognitive Debt when Using an AI Assistant for Essay Writing Taskcited by 106
- 2024A Survey on LLM-based Code Generation for Low-Resource and Domain-Specific Programming Languagescited by 66
- 2024A Survey on Large Language Models with Multilingualism: Recent Advances and New Frontierscited by 40
- 2024AI and the Problem of Knowledge Collapsecited by 34
5 more
- 2023Are Large Language Models a Threat to Digital Public Goods? Evidence from Activity on Stack Overflowcited by 22
- 2025Who is using AI to code? Global diffusion and impact of generative AIcited by 18
- 2018Usage and Attribution of Stack Overflow Code Snippets in GitHub Projectscited by 6
- 2025Wikipedia Contributions in the Wake of ChatGPTcited by 5
- 2024Exploring the Impact of ChatGPT on Wikipedia Engagementcited by 3
Built on by
Not cited yet.