mlsanityData to 14 Oct 2026

Impact of ChatGPT on the writing style of condensed matter physicists

arXiv 2408.17325 ↗First posted 30 Aug 2024cs.CL cond-mat.dis-nn cond-mat.stat-mechcited by 0

Not on the map. Why?

Abstract (arXiv)

We apply a state-of-the-art difference-in-differences approach to estimate the impact of ChatGPT's release on the writing style of condensed matter papers on arXiv. Our analysis reveals a statistically significant improvement in the English quality of abstracts written by non-native English speakers. Importantly, this improvement remains robust even after accounting for other potential factors, confirming that it can be attributed to the release of ChatGPT. This indicates widespread adoption of the tool. Following the release of ChatGPT, there is a significant increase in the use of unique words, while the frequency of rare words decreases. Across language families, the changes in writing style are significant for authors from the Latin and Ural-Altaic groups, but not for those from the Germanic or other Indo-European groups.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 38 references that are in the map. First posted on arXiv 30 Aug 2024.

Builds on

13 of 38 references.

References · 13

  1. 2023A Comprehensive Capability Analysis of GPT-3 and GPT-3.5 Series Modelscited by 246
  2. 2024Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer Reviewscited by 164
  3. 2024Mapping the Increasing Use of LLMs in Scientific Paperscited by 118
  4. 2022GPT Takes the Bar Examcited by 65
  5. 2023ChatGPT may Pass the Bar Exam soon, but has a Long Way to Go for the LexGLUE benchmarkcited by 33
  6. 2023Large Language Models (GPT) Struggle to Answer Multiple-Choice Questions about Codecited by 32
  7. 2024ChatGPT "contamination": estimating the prevalence of LLMs in the scholarly literaturecited by 26
  8. 2024Is ChatGPT Transforming Academics' Writing Style?cited by 26
  9. 2023Evaluating GPT-3.5 and GPT-4 Models on Brazilian University Admission Examscited by 25
  10. 2023Transforming Sentiment Analysis in the Financial Domain with ChatGPTcited by 25
  11. 2024Towards the relationship between AIGC in manuscript writing and author profiles: evidence from preprints in LLMscited by 14
  12. 2024Delving into the Utilisation of ChatGPT in Scientific Publications in Astronomycited by 7
1 more
  1. 2022Towards Zero-Shot and Few-Shot Table Question Answering using GPT-3cited by 4

Built on by

Not cited yet.