mlsanityData to 14 Oct 2026

Is ChatGPT Transforming Academics' Writing Style?

arXiv 2404.08627 ↗First posted 12 Apr 2024cs.CL cs.AI cs.DLcited by 26

Not on the map. Why?

Abstract (arXiv)

Based on one million arXiv papers submitted from May 2018 to January 2024, we assess the textual density of ChatGPT's writing style in their abstracts through a statistical analysis of word frequency changes. Our model is calibrated and validated on a mixture of real abstracts and ChatGPT-modified abstracts (simulated data) after a careful noise analysis. The words used for estimation are not fixed but adaptive, including those with decreasing frequency. We find that large language models (LLMs), represented by ChatGPT, are having an increasing impact on arXiv abstracts, especially in the field of computer science, where the fraction of LLM-style abstracts is estimated to be approximately 35%, if we take the responses of GPT-3.5 to one simple prompt, "revise the following sentences", as a baseline. We conclude with an analysis of both positive and negative aspects of the penetration of LLMs into academics' writing style.

Key facts. Cited by 26 papers in the map (data through 14 Oct 2026). Builds on 7 of its 26 references that are in the map. First posted on arXiv 12 Apr 2024.

Builds on

7 of 26 references.

References · 7

  1. 2023A Survey of Large Language Modelscited by 2,576
  2. 2023A Watermark for Large Language Modelscited by 725
  3. 2024Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer Reviewscited by 164
  4. 2024Mapping the Increasing Use of LLMs in Scientific Paperscited by 118
  5. 2023The Impact of Large Language Models on Scientific Discovery: a Preliminary Study using GPT-4cited by 112
  6. 2023Extracting Accurate Materials Data from Research Papers with Conversational Language Models and Prompt Engineeringcited by 86
  7. 2023ChatGPT and a New Academic Reality: Artificial Intelligence-Written Research Papers and the Ethics of the Large Language Models in Scholarly Publishingcited by 52

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 12; 2025: 9; 2026: 5.

26 papers.

Sort:

By area:

  1. 2024Delving into LLM-assisted writing in biomedical publications through excess vocabularycited by 78
  2. 2024Benchmarking Linguistic Diversity of Large Language Modelscited by 38
  3. 2024Empirical evidence of Large Language Model's influence on human spoken communicationcited by 27
  4. 2024The Impact of Large Language Models in Academia: from Writing to Speakingcited by 18
  5. 2024AIGS: Generating Science from AI-Powered Automated Falsificationcited by 18
  6. 2024SilverSpeak: Evading AI-Generated Text Detectors using Homoglyphscited by 13
  7. 2024Delving into the Utilisation of ChatGPT in Scientific Publications in Astronomycited by 7
  8. 2025Examining Linguistic Shifts in Academic Writing Before and After the Launch of ChatGPT: A Study on Preprint Paperscited by 6
  9. 2025How Large Language Models Are Changing MOOC Essay Answers: A Comparison of Pre- and Post-LLM Responsescited by 5
  10. 2024Understanding Generative AI Content with Embedding Modelscited by 4
  11. 2024What is the Role of Large Language Models in the Evolution of Astronomy Research?cited by 4
  12. 2025Wikipedia in the Era of LLMs: Evolution and Riskscited by 4
14 more
  1. 2024NLLG Quarterly arXiv Report 09/24: What are the most influential current AI Papers?cited by 3
  2. 2025On the Detectability of LLM-Generated Text: What Exactly Is LLM-Generated Text?cited by 3
  3. 2024Generative AI Tools in Academic Research: Applications and Implications for Qualitative and Quantitative Research Methodologiescited by 2
  4. 2025Humans Coexist, So Must Embodied Artificial Agentscited by 2
  5. 2026Most biomedical publications show signs of LLM-assisted writingcited by 2
  6. 2025Exploring the change in scientific readability following the release of ChatGPTcited by 1
  7. 2025Does Scientific Writing Converge to U.S. English? Evidence from Generative AI-Assisted Publicationscited by 1
  8. 2025Accepted with Minor Revisions: Value of AI-Assisted Scientific Writingcited by 1
  9. 2026Beyond Via: Analysis and Estimation of the Impact of Large Language Models in Academic Paperscited by 1
  10. 2026Impact of large language models on peer review opinions from a fine-grained perspective: Evidence from top conference proceedings in AIcited by 1
  11. 2024Impact of ChatGPT on the writing style of condensed matter physicistscited by 0
  12. 2025Co-Creative Learning via Metropolis-Hastings Interaction between Humans and AIcited by 0
  13. 2026Isolating LLM Lexical Bias: A Curation-Free Triangulated Metric for Preference-Stage Learningcited by 0
  14. 2026War in the Abstract: The Rise and Consequences of Militarized Language in Scientific Communicationcited by 0