mlsanityData to 14 Oct 2026

A Survey on Detection of LLMs-Generated Content

arXiv 2310.15654 ↗First posted 24 Oct 2023cs.CL cs.AI cs.CYcited by 71

Not on the map. Why?

Abstract (arXiv)

The burgeoning capabilities of advanced large language models (LLMs) such as ChatGPT have led to an increase in synthetic content generation with implications across a variety of sectors, including media, cybersecurity, public discourse, and education. As such, the ability to detect LLMs-generated content has become of paramount importance. We aim to provide a detailed overview of existing detection strategies and benchmarks, scrutinizing their differences and identifying key challenges and prospects in the field, advocating for more adaptable and robust models to enhance detection accuracy. We also posit the necessity for a multi-faceted approach to defend against various attacks to counter the rapidly advancing capabilities of LLMs. To the best of our knowledge, this work is the first comprehensive survey on the detection in the era of LLMs. We hope it will provide a broad understanding of the current landscape of LLMs-generated content detection, offering a guiding reference for researchers and practitioners striving to uphold the integrity of digital information in an era increasingly dominated by synthetic content. The relevant papers are summarized and will be consistently updated at https://github.com/Xianjun-Yang/Awesome_papers_on_LLMs_detection.git.

Key facts. Cited by 71 papers in the map (data through 14 Oct 2026). Builds on 96 of its 160 references that are in the map. First posted on arXiv 24 Oct 2023.

Builds on

96 of 160 references.

References · 96

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2022Training language models to follow instructions with human feedbackcited by 15,971
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  6. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  7. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  8. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  9. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  10. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
  11. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,512
  12. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
38 more
  1. 2019The Curious Case of Neural Text Degenerationcited by 2,916
  2. 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,739
  3. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  4. 2022Competition-Level Code Generation with AlphaCodecited by 1,462
  5. 2018Hierarchical Neural Story Generationcited by 1,193
  6. 2021Measuring Coding Challenge Competence With APPScited by 902
  7. 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 726
  8. 2017The NarrativeQA Reading Comprehension Challengecited by 597
  9. 2019ELI5: Long Form Question Answeringcited by 575
  10. 2019Defending Against Neural Fake Newscited by 559
  11. 2019Release Strategies and the Social Impacts of Language Modelscited by 513
  12. 2019GLTR: Statistical Detection and Visualization of Generated Textcited by 496
  13. 2023Is ChatGPT a General-Purpose Natural Language Processing Task Solver?cited by 488
  14. 2023How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detectioncited by 481
  15. 2023Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defensecited by 429
  16. 2018Generating Natural Language Adversarial Examplescited by 424
  17. 2023Scaling Speech Technology to 1,000+ Languagescited by 411
  18. 2023Can AI-Generated Text be Reliably Detected?cited by 386
  19. 2023Robust Distortion-free Watermarks for Language Modelscited by 320
  20. 2023Provable Robust Watermarking for AI-Generated Textcited by 299
  21. 2019Mitigating Gender Bias in Natural Language Processing: Literature Reviewcited by 287
  22. 2023Fast-DetectGPT: Efficient Zero-Shot Detection of Machine-Generated Text via Conditional Probability Curvaturecited by 287
  23. 2019Automatic Detection of Generated Text is Easiest when Humans are Fooledcited by 261
  24. 2023DetectLLM: Leveraging Log Rank Information for Zero-Shot Detection of Machine-Generated Textcited by 210
  25. 2023RADAR: Robust AI-Text Detection via Adversarial Learningcited by 190
  26. 2023Tree-Ring Watermarks: Fingerprints for Diffusion Images that are Invisible and Robustcited by 187
  27. 2023GPT detectors are biased against non-native English writerscited by 178
  28. 2020Automatic Detection of Machine Generated Text: A Critical Surveycited by 166
  29. 2020MedDialog: Two Large-scale Medical Dialogue Datasetscited by 161
  30. 2023A Recipe for Watermarking Diffusion Modelscited by 141
  31. 2023Who Wrote this Code? Watermarking for Code Generationcited by 141
  32. 2020Adversarial Watermarking Transformer: Towards Tracing Text Provenance with Data Hidingcited by 130
  33. 2023DNA-GPT: Divergent N-Gram Analysis for Training-Free Detection of GPT-Generated Textcited by 129
  34. 2023Exploring the Limits of ChatGPT for Query or Aspect-based Text Summarizationcited by 122
  35. 2023M4: Multi-generator, Multi-domain, and Multi-lingual Black-Box Machine-Generated Text Detectioncited by 121
  36. 2021TURINGBENCH: A Benchmark Environment for Turing Test in the Age of Neural Text Generationcited by 120
  37. 2023Intrinsic Dimension Estimation for Robust Detection of AI-Generated Textscited by 112
  38. 2023Regulating ChatGPT and other Large Generative AI Modelscited by 104

50 most cited of 96 All 96 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 2; 2024: 31; 2025: 21; 2026: 17.

71 papers.

Sort:

By area:

  1. 2024LLM Evaluators Recognize and Favor Their Own Generationscited by 686
  2. 2024Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer Reviewscited by 164
  3. 2024Mapping the Increasing Use of LLMs in Scientific Paperscited by 118
  4. 2024From Matching to Generation: A Survey on Generative Information Retrievalcited by 89
  5. 2024Detecting Multimedia Generated by Large AI Models: A Surveycited by 76
  6. 2024Unified Hallucination Detection for Multimodal Large Language Modelscited by 75
  7. 2024SoK: Watermarking for AI-Generated Contentcited by 51
  8. 2024Can Large Language Models Identify Authorship?cited by 41
  9. 2024DetectRL: Benchmarking LLM-Generated Text Detection in Real-World Scenarioscited by 38
  10. 2025Are You Getting What You Pay For? Auditing Model Substitution in LLM APIscited by 38
  11. 2024GumbelSoft: Diversified Language Model Watermarking via the GumbelMax-trickcited by 37
  12. 2024Bypassing LLM Watermarks with Color-Aware Substitutionscited by 28
38 more
  1. 2024Between Lines of Code: Unraveling the Distinct Patterns of Machine and Human Programmerscited by 27
  2. 2023A Ship of Theseus: Curious Cases of Paraphrasing in LLM-Generated Textscited by 23
  3. 2024Detecting AI-Generated Text: Factors Influencing Detectability with Current Methodscited by 23
  4. 2025AdaDetectGPT: Adaptive Detection of LLM-Generated Text with Statistical Guaranteescited by 21
  5. 2023AI-generated text boundary detection with RoFTcited by 20
  6. 2024Ten Words Only Still Help: Improving Black-Box AI-Generated Text Detection via Proxy-Guided Efficient Re-Samplingcited by 20
  7. 2024CrossCheckGPT: Universal Hallucination Ranking for Multimodal Foundation Modelscited by 18
  8. 2025An Expanded Massive Multilingual Dataset for High-Performance Language Technologies (HPLT)cited by 16
  9. 2024Detecting Machine-Generated Texts: Not Just "AI vs Humans" and Explainability is Complicatedcited by 15
  10. 2024Regurgitative Training: The Value of Real Data in Training Large Language Modelscited by 15
  11. 2025Feature-Level Insights into Artificial Text Detection with Sparse Autoencoderscited by 15
  12. 2024Glimpse: Enabling White-Box Methods to Use Proprietary Models for Zero-Shot LLM-Generated Text Detectioncited by 14
  13. 2024DALD: Improving Logits-based Detector without Logits from Black-box LLMscited by 13
  14. 2024A Practical Examination of AI-Generated Text Detectors for Large Language Modelscited by 11
  15. 2024Incentivizing Quality Text Generation via Statistical Contractscited by 10
  16. 2025Marking Code Without Breaking It: Code Watermarking for Detecting LLM-Generated Codecited by 10
  17. 2025In-Context Watermarks for Large Language Modelscited by 10
  18. 2025TH-Bench: Evaluating Evading Attacks via Humanizing AI Text on Machine-Generated Text Detectorscited by 8
  19. 2025Human Texts Are Outliers: Detecting LLM-generated Texts via Out-of-distribution Detectioncited by 8
  20. 2024B4: A Black-Box Scrubbing Attack on LLM Watermarkscited by 7
  21. 2024Measuring Human Contribution in AI-Assisted Content Generationcited by 6
  22. 2024Humanizing the Machine: Proxy Attacks to Mislead LLM Detectorscited by 6
  23. 2025Decoupling Content and Expression: Two-Dimensional Detection of AI-Generated Textcited by 6
  24. 2025WETBench: A Benchmark for Detecting Task-Specific Machine-Generated Text on Wikipediacited by 6
  25. 2025DAMASHA: Detecting AI in Mixed Adversarial Texts via Segmentation with Human-interpretable Attributioncited by 5
  26. 2024PetKaz at SemEval-2024 Task 8: Can Linguistics Capture the Specifics of LLM-generated Text?cited by 4
  27. 2024Synthetic Lyrics Detection Across Languages and Genrescited by 4
  28. 2026When AI Settles Down: Late-Stage Stability as a Signature of AI-Generated Text Detectioncited by 4
  29. 2024Towards Reliable Detection of LLM-Generated Texts: A Comprehensive Evaluation Framework with CUDRTcited by 3
  30. 2025Watermarking for AI Content Detection: A Review on Text, Visual, and Audio Modalitiescited by 3
  31. 2025AI-generated Text Detection: A Multifaceted Approach to Binary and Multiclass Classificationcited by 3
  32. 2025The Arabic AI Fingerprint: Stylometric Analysis and Detection of Large Language Models Textcited by 3
  33. 2025Prompt-Induced Linguistic Fingerprints for LLM-Generated Fake News Detectioncited by 3
  34. 2025On the Detectability of LLM-Generated Text: What Exactly Is LLM-Generated Text?cited by 3
  35. 2026Minimizing Mismatch Risk: A Prototype-Based Routing Framework for Zero-shot LLM-generated Text Detectioncited by 3
  36. 2024MUGC: Machine Generated versus User Generated Content Detectioncited by 2
  37. 2025Understanding the Effects of RLHF on the Quality and Detectability of LLM-Generated Textscited by 2
  38. 2025SimKey: A Semantically Aware Key Module for Watermarking Language Modelscited by 2

50 most cited of 71 All 71 (JSON)