The Shrinking Lifespan of LLMs in Science
Not on the map. Why?
Abstract (arXiv)
Scaling laws describe how language model capabilities grow with compute and data, but say nothing about how long a model matters once released. We introduce time-to-peak and lifespan as measures of model obsolescence and use them to characterize the scientific adoption trajectories of 62 LLMs across more than 108k citing papers (2019-2025), separating active adoption from background citation to recover per-model trajectories that citation counts cannot resolve. We find that a model's longevity is shaped more by when it was released than by its characteristics: release year predicts time-to-peak and lifespan more strongly than architecture, openness, or scale. LLM adoption follows an inverted-U curve (rising after release, peaking, and then declining), but this pattern is rapidly compressing. Each successive release year is associated with a 27% shorter time-to-peak and a 23% shorter lifespan (p < 0.001), robust to minimum-age thresholds and controls for model size. These adoption-side dynamics are invisible to scaling laws and suggest that specialization on any single model may be a depreciating investment, with costs falling on reproducibility and migration.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 24 of its 41 references that are in the map. First posted on arXiv 8 Apr 2026.
Builds on
24 of 41 references.
References · 24
- 2017Attention Is All You Needcited by 59,932
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2022Training Compute-Optimal Large Language Modelscited by 2,927
- 2022Emergent Abilities of Large Language Modelscited by 2,483
- 2023How is ChatGPT's behavior changing over time?cited by 265
- 2023Can Large Language Models Transform Computational Social Science?cited by 245
- 2023Nougat: Neural Optical Understanding for Academic Documentscited by 240
- 2022Compute Trends Across Three Eras of Machine Learningcited by 161
- 2024Mapping the Increasing Use of LLMs in Scientific Paperscited by 112
- 2023The Semantic Scholar Open Data Platformcited by 109
12 more
- 2023ChatGPT-4 Outperforms Experts and Crowd Workers in Annotating Political Twitter Messages with Zero-Shot Learningcited by 97
- 2024Delving into LLM-assisted writing in biomedical publications through excess vocabularycited by 75
- 2023A Bibliometric Review of Large Language Models Research from 2017 to 2023cited by 56
- 2024LLMs as Research Tools: A Large Scale Survey of Researchers' Usage and Perceptionscited by 45
- 2024LLMs Meet Library Evolution: Evaluating Deprecated API Usage in LLM-based Code Completioncited by 29
- 2024The AI Community Building the Future? A Quantitative Analysis of Development Activity on Hugging Face Hubcited by 18
- 2025Human-LLM Coevolution: Evidence from Academic Writingcited by 15
- 2021An Artificial Intelligence Life Cycle: From Conception to Productioncited by 11
- 2023Artificial intelligence adoption in the physical sciences, natural sciences, life sciences, social sciences and the arts and humanities: A bibliometric analysis of research publications from 1960-2021cited by 8
- 2025Science Is Falling Behind the Frontier: Foundation Model Adoption Across Half a Million Paperscited by 5
- 2024Transforming Scholarly Landscapes: Influence of Large Language Models on Academic Fields beyond Computer Sciencecited by 4
- 2025On the Shelf Life of Fine-Tuned LLM-Judges: Future-Proofing, Backward-Compatibility, and Question Generalizationcited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Wasted large language models: A life cycle thinking approach17 Aug 2026