mlsanityData to 14 Oct 2026

Playing with words: Comparing the vocabulary and lexical diversity of ChatGPT and humans

arXiv 2308.07462 ↗First posted 14 Aug 2023cs.CL cs.AIcited by 8

Not on the map. Why?

Abstract (arXiv)

The introduction of Artificial Intelligence (AI) generative language models such as GPT (Generative Pre-trained Transformer) and tools such as ChatGPT has triggered a revolution that can transform how text is generated. This has many implications, for example, as AI-generated text becomes a significant fraction of the text, would this have an effect on the language capabilities of readers and also on the training of newer AI tools? Would it affect the evolution of languages? Focusing on one specific aspect of the language: words; will the use of tools such as ChatGPT increase or reduce the vocabulary used or the lexical richness? This has implications for words, as those not included in AI-generated content will tend to be less and less popular and may eventually be lost. In this work, we perform an initial comparison of the vocabulary and lexical richness of ChatGPT and humans when performing the same tasks. In more detail, two datasets containing the answers to different types of questions answered by ChatGPT and humans, and a third dataset in which ChatGPT paraphrases sentences and questions are used. The analysis shows that ChatGPT tends to use fewer distinct words and lower lexical richness than humans. These results are very preliminary and additional datasets and ChatGPT configurations have to be evaluated to extract more general conclusions. Therefore, further research is needed to understand how the use of ChatGPT and more broadly generative AI tools will affect the vocabulary and lexical richness in different types of text and languages.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 20 of its 61 references that are in the map. First posted on arXiv 14 Aug 2023.

Builds on

20 of 61 references.

References · 20

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  4. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  5. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  6. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  7. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  8. 2022Training Compute-Optimal Large Language Modelscited by 3,019
  9. 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,312
  10. 2023How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detectioncited by 481
  11. 2020Reliable Fidelity and Diversity Metrics for Generative Modelscited by 434
  12. 2023The Curse of Recursion: Training on Generated Data Makes Models Forgetcited by 356
8 more
  1. 2023Do All Languages Cost the Same? Tokenization in the Era of Commercial Language Modelscited by 192
  2. 2023Don't Trust ChatGPT when Your Question is not in English: A Study of Multilingual Abilities and Types of LLMscited by 104
  3. 2023Towards Understanding the Interplay of Generative Artificial Intelligence and the Internetcited by 54
  4. 2023CHEAT: A Large-scale Dataset for Detecting ChatGPT-writtEn AbsTractscited by 40
  5. 2023Linguistic ambiguity analysis in ChatGPTcited by 14
  6. 2023Emergence of a phonological bias in ChatGPTcited by 8
  7. 2022Text to Image Generation: Leaving no Language Behindcited by 4
  8. 2023"Genlangs" and Zipf's Law: Do languages generated by ChatGPT statistically look human?cited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 5; 2026: 3.

8 papers.

  1. 2025Human-LLM Coevolution: Evidence from Academic Writingcited by 15
  2. 2025How Large Language Models Are Changing MOOC Essay Answers: A Comparison of Pre- and Post-LLM Responsescited by 5
  3. 2025DiffSampling: Enhancing Diversity and Accuracy in Neural Text Generationcited by 3
  4. 2025Losing our Tail, Again: (Un)Natural Selection & Multilingual LLMscited by 1
  5. 2025Do LLMs produce texts with "human-like" lexical diversity?cited by 1
  6. 2026Beyond Via: Analysis and Estimation of the Impact of Large Language Models in Academic Paperscited by 1
  7. 2026Does AI Homogenize Student Thinking? A Multi-Dimensional Analysis of Structural Convergence in AI-Augmented Essayscited by 0
  8. 2026Can Humans Detect AI? Mining Textual Signals of AI-Assisted Writing Under Varying Scrutiny Conditionscited by 0