mlsanityData to 14 Oct 2026

Most biomedical publications show signs of LLM-assisted writing

arXiv 2608.10715 ↗First posted 11 Aug 2026cs.CL cs.AI cs.CYcited by 2

Not on the map. Why?

Abstract (arXiv)

Over the past several years, LLM-powered chatbots and agents have become widely used as a tool for academic writing. LLM-assisted writing can be valuable by removing language barriers but at the same time causes concerns about misconduct and fraud. To inform policy decisions, it is necessary to monitor the prevalence of LLM-altered texts in scholarly publications. Despite some recent progress in this direction, no existing method can produce reliable estimates. Here we suggest and validate a new unbiased approach to estimate LLM usage in a corpus of texts based on changing word frequencies. We apply our method to the full texts of open-access biomedical papers from Pubmed Central, and show that by the end of 2025, 89% of papers show excess of LLM-associated vocabulary. We also find that LLMs are twice as likely to be used when writing a paragraph in the Discussion section (68%) compared to a paragraph in the Methods section (32%), but even inside the Methods section, the overall prevalence of LLM usage is over 50%. We believe that our estimates are crucial to shape future guidelines and policies.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 19 of its 46 references that are in the map. First posted on arXiv 11 Aug 2026.

Builds on

19 of 46 references.

References · 19

  1. 2024Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer Reviewscited by 164
  2. 2024Mapping the Increasing Use of LLMs in Scientific Paperscited by 118
  3. 2023Testing of Detection Tools for AI-Generated Textcited by 90
  4. 2024Delving into LLM-assisted writing in biomedical publications through excess vocabularycited by 78
  5. 2024LLMs as Research Tools: A Large Scale Survey of Researchers' Usage and Perceptionscited by 47
  6. 2025The Homogenizing Effect of Large Language Models on Human Expression and Thoughtcited by 35
  7. 2024ChatGPT "contamination": estimating the prevalence of LLMs in the scholarly literaturecited by 26
  8. 2024Is ChatGPT Transforming Academics' Writing Style?cited by 26
  9. 2025Human-LLM Coevolution: Evidence from Academic Writingcited by 15
  10. 2024Towards the relationship between AIGC in manuscript writing and author profiles: evidence from preprints in LLMscited by 14
  11. 2025How much are LLMs changing the language of academic papers after ChatGPT? A multi-database and full text analysiscited by 8
  12. 2024Delving into the Utilisation of ChatGPT in Scientific Publications in Astronomycited by 7
7 more
  1. 2026LLM hallucinations in the wild: Large-scale evidence from non-existent citationscited by 7
  2. 2024Where there's a will there's a way: ChatGPT is used more for science in countries where it is prohibitedcited by 6
  3. 2024Enhancing Robustness of LLM-Synthetic Text Detectors for Academic Writing: A Comprehensive Analysiscited by 4
  4. 2024Detecting LLM-assisted writing in scientific communication: Are we there yet?cited by 4
  5. 2025Estimating the prevalence of LLM-assisted text in scholarly writingcited by 4
  6. 2024Quantitative Analysis of AI-Generated Texts in Academic Research: A Study of AI Presence in Arxiv Submissions using AI Detection Toolcited by 3
  7. 2025Does GenAI Rewrite How We Write? An Empirical Study on Two-Million Preprintscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.