Automatic Detection of Machine Generated Text: A Critical Survey
Not on the map. Why?
Abstract (arXiv)
Text generative models (TGMs) excel in producing text that matches the style of human language reasonably well. Such TGMs can be misused by adversaries, e.g., by automatically generating fake news and fake product reviews that can look authentic and fool humans. Detectors that can distinguish text generated by TGM from human written text play a vital role in mitigating such misuse of TGMs. Recently, there has been a flurry of works from both natural language processing (NLP) and machine learning (ML) communities to build accurate detectors for English. Despite the importance of this problem, there is currently no work that surveys this fast-growing literature and introduces newcomers to important research challenges. In this work, we fill this void by providing a critical survey and review of this literature to facilitate a comprehensive understanding of this problem. We conduct an in-depth error analysis of the state-of-the-art detector and discuss research directions to guide future work in this exciting area.
Key facts. Cited by 160 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Nov 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 17; 2023: 53; 2024: 49; 2025: 24; 2026: 9.
160 papers.
Sort:
By area:
- 2021Ethical and social risks of harm from Language Modelscited by 957
- 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 705
- 2023A Watermark for Large Language Modelscited by 667
- 2024LLM Evaluators Recognize and Favor Their Own Generationscited by 651
- 2023How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detectioncited by 472
- 2023Can AI-Generated Text be Reliably Detected?cited by 372
- 2023Robust Distortion-free Watermarks for Language Modelscited by 279
- 2023Fast-DetectGPT: Efficient Zero-Shot Detection of Machine-Generated Text via Conditional Probability Curvaturecited by 278
- 2024Knowledge Conflicts for LLMs: A Surveycited by 274
- 2023Large Language Model Alignment: A Surveycited by 241
- 2023Undetectable Watermarks for Language Modelscited by 208
- 2023DetectLLM: Leveraging Log Rank Information for Zero-Shot Detection of Machine-Generated Textcited by 207
38 more
- 2023GPT detectors are biased against non-native English writerscited by 175
- 2023Can LLM-Generated Misinformation Be Detected?cited by 173
- 2023On the Reliability of Watermarks for Large Language Modelscited by 170
- 2024Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer Reviewscited by 160
- 2022mGPT: Few-Shot Learners Go Multilingualcited by 141
- 2023AI Transparency in the Age of LLMs: A Human-Centered Research Roadmapcited by 119
- 2021TURINGBENCH: A Benchmark Environment for Turing Test in the Age of Neural Text Generationcited by 118
- 2024Mapping the Increasing Use of LLMs in Scientific Paperscited by 112
- 2023A Survey on LLM-Generated Text Detection: Necessity, Methods, and Future Directionscited by 101
- 2023Language Model Behavior: A Comprehensive Surveycited by 92
- 2023Ghostbuster: Detecting Text Ghostwritten by Large Language Modelscited by 90
- 2023Identifying and Mitigating the Security Risks of Generative AIcited by 90
- 2022Language Generation Models Can Cause Harm: So What Can We Do About It? An Actionable Surveycited by 80
- 2022Machine Generated Text: A Comprehensive Survey of Threat Models and Detection Methodscited by 75
- 2023On the Learnability of Watermarks for Language Modelscited by 72
- 2023A Survey on Detection of LLMs-Generated Contentcited by 70
- 2023Publicly-Detectable Watermarking for Language Modelscited by 69
- 2023The Gradient of Generative AI Release: Methods and Considerationscited by 63
- 2023Stylometric Detection of AI-Generated Text in Twitter Timelinescited by 57
- 2024Raidar: geneRative AI Detection viA Rewritingcited by 51
- 2024Community Forensics: Using Thousands of Generators to Train Fake Image Detectorscited by 50
- 2021Artificial Text Detection via Examining the Topology of Attention Mapscited by 49
- 2023Watermarking Conditional Text Generation for AI Detection: Unveiling Challenges and a Semantic-Aware Watermark Remedycited by 45
- 2023Towards Codable Watermarking for Injecting Multi-bits Information to LLMscited by 43
- 2022Attribution and Obfuscation of Neural Text Authorship: A Data Mining Perspectivecited by 40
- 2023GPT-Sentinel: Distinguishing Human and ChatGPT Generated Contentcited by 40
- 2024Few-Shot Detection of Machine-Generated Text using Style Representationscited by 40
- 2024AI as Humanity's Salieri: Quantifying Linguistic Creativity of Language Models via Systematic Attribution of Machine Text against Web Textcited by 40
- 2023Origin Tracing and Detecting of LLMscited by 39
- 2023GPT-who: An Information Density-based Machine-Generated Text Detectorcited by 38
- 2023ConDA: Contrastive Domain Adaptation for AI-generated Text Detectioncited by 37
- 2023Smaller Language Models are Better Black-box Machine-Generated Text Detectorscited by 35
- 2024Training-free LLM-generated Text Detection by Mining Token Probability Sequencescited by 33
- 2025Idiosyncrasies in Large Language Modelscited by 32
- 2024SemEval-2024 Task 8: Multidomain, Multimodel and Multilingual Machine-Generated Text Detectioncited by 30
- 2022Findings of the The RuATD Shared Task 2022 on Artificial Text Detection in Russiancited by 29
- 2023Towards Possibilities & Impossibilities of AI-generated Text Detection: A Surveycited by 28
- 2024Who Wrote This? The Key to Zero-Shot LLM-Generated Text Detection Is GECScorecited by 27
50 most cited of 160 All 160 (JSON)
- 2026Rethinking Multimodal Fake News Detection in the Generative AI Era29 Sep 2026
- 2026TripPattern: A Pattern-based Text Watermarking Method for Large Language Models11 Sep 2026
- 2026Efficient Online LLM Watermark Detection via Rao-Blackwellized E-Processes24 Jul 2026
- 2026Hitting a Moving Target: Test-Time Adaptation for AI Text Detection under Continual Distribution Shift23 Jun 2026
- 2026SV-Detect: AI-generated Text Detection with Steering Vectors5 Jun 2026
- 2026Sem-Detect: Semantic Level Detection of AI Generated Peer-Reviews20 May 2026
- 2026Lightweight Stylistic Consistency Profiling: Robust Detection of LLM-Generated Textual Content for Multimedia Moderation7 May 2026
- 2026Luminol-AIDetect: Fast Zero-shot Machine-Generated Text Detection based on Perplexity under Text Shuffling28 Apr 2026
- 2026The Truncation Blind Spot: How Decoding Strategies Systematically Exclude Human-Like Token Choices19 Mar 2026
- 2025DAMASHA: Detecting AI in Mixed Adversarial Texts via Segmentation with Human-interpretable Attribution4 Dec 2025
- 2025A Cross-Cultural Assessment of Human Ability to Detect LLM-Generated Fake News about South Africa21 Nov 2025
- 2025A Theoretical Analysis of Detecting Large Model-Generated Time Series10 Nov 2025
38 more
- 2025Watermarking Discrete Diffusion Language Models3 Nov 2025
- 2025ALHD: A Large-Scale and Multigenre Benchmark Dataset for Arabic LLM-Generated Text Detection3 Oct 2025
- 2025Every Step Counts: Decoding Trajectories as Authorship Fingerprints of dLLMs2 Oct 2025
- 2025DetectAnyLLM: Towards Generalizable and Robust Detection of Machine-Generated Text Across Domains and Models15 Sep 2025
- 2025LLM Encoder vs. Decoder: Robust Detection of Chinese AI-Generated Text with LoRA31 Aug 2025
- 2025A Multi-Strategy Approach for AI-Generated Text Detection30 Aug 2025
- 2025Two Birds with One Stone: Multi-Task Detection and Attribution of LLM-Generated Text19 Aug 2025
- 2025SAEMark: Steering Personalized Multilingual LLM Watermarks with Sparse Autoencoders11 Aug 2025
- 2025AI-Generated Text is Non-Stationary: Detection via Temporal Tomography3 Aug 2025
- 2025Authorship Attribution in Multilingual Machine-Generated Texts3 Aug 2025
- 2025Linguistic and Embedding-Based Profiling of Texts generated by Humans and Large Language Models18 Jul 2025
- 2025textttDroid: A Resource Suite for AI-Generated Code Detection11 Jul 2025
- 2025Zero-Shot Detection of LLM-Generated Code via Approximated Task Conditioning6 Jun 2025
- 2025Watermarking Degrades Alignment in Language Models: Analysis and Mitigation4 Jun 2025
- 2025AGENT-X: Adaptive Guideline-based Expert Network for Threshold-free AI-generated teXt detection21 May 2025
- 2025OpenTuringBench: An Open-Model-based Benchmark and Framework for Machine-Generated Text Detection and Attribution15 Apr 2025
- 2025Is Your Paper Being Reviewed by an LLM? Benchmarking AI Text Detection in Peer Review26 Feb 2025
- 2025Idiosyncrasies in Large Language Models17 Feb 2025
- 2025A Comparison of DeepSeek and Other LLMs6 Feb 2025
- 2025BiMarker: Enhancing Text Watermark Detection for Large Language Models with Bipolar Watermarks21 Jan 2025
- 2025A Training-free Method for LLM Text Attribution4 Jan 2025
- 2024Using Machine Learning to Distinguish Human-written from Machine-generated Creative Fiction15 Dec 2024
- 2024A Practical Examination of AI-Generated Text Detectors for Large Language Models6 Dec 2024
- 2024Ensemble Watermarks for Large Language Models29 Nov 2024
- 2024Multi-head Span-based Detector for AI-generated Fragments in Scientific Papers11 Nov 2024
- 2024Community Forensics: Using Thousands of Generators to Train Fake Image Detectors6 Nov 2024
- 2024Online Detection of LLM-Generated Texts via Sequential Hypothesis Testing by Betting29 Oct 2024
- 2024A Survey on Automatic Credibility Assessment Using Textual Credibility Signals in the Era of Large Language Models28 Oct 2024
- 2024Improving Model Evaluation using SMART Filtering of Benchmark Datasets26 Oct 2024
- 2024Are AI Detectors Good Enough? A Survey on Quality of Datasets With Machine-Generated Texts18 Oct 2024
- 2024Beyond Binary: Towards Fine-Grained LLM-Generated Text Detection via Role Recognition and Involvement Measurement18 Oct 2024
- 2024Robust AI-Generated Text Detection by Restricted Embeddings10 Oct 2024
- 2024Training-free LLM-generated Text Detection by Mining Token Probability Sequences8 Oct 2024
- 2024AI as Humanity's Salieri: Quantifying Linguistic Creativity of Language Models via Systematic Attribution of Machine Text against Web Text5 Oct 2024
- 2024Is Your Paper Being Reviewed by an LLM? Investigating AI Text Detectability in Peer Review3 Oct 2024
- 2024HULLMI: Human vs LLM identification with explainability7 Sep 2024
- 2024Automatic Detection of LLM-Generated Code: A Comparative Case Study of Contemporary Models Across Function and Class Granularities2 Sep 2024
- 2024SYNTHEVAL: Hybrid Behavioral Testing of NLP Models with Synthetic CheckLists30 Aug 2024
50 newest of 160 All 160 (JSON)
- 2023A Watermark for Large Language Modelscited by 667
- 2023Can AI-Generated Text be Reliably Detected?cited by 372
- 2023Robust Distortion-free Watermarks for Language Modelscited by 279
- 2023Undetectable Watermarks for Language Modelscited by 208
- 2023On the Reliability of Watermarks for Large Language Modelscited by 170
- 2023On the Learnability of Watermarks for Language Modelscited by 72
- 2023Publicly-Detectable Watermarking for Language Modelscited by 69
- 2023Watermarking Conditional Text Generation for AI Detection: Unveiling Challenges and a Semantic-Aware Watermark Remedycited by 45
- 2023Towards Codable Watermarking for Injecting Multi-bits Information to LLMscited by 43
- 2023From Text to Source: Results in Detecting Large Language Model-Generated Contentcited by 25
- 2024Ensemble Watermarks for Large Language Modelscited by 6
- 2025SAEMark: Steering Personalized Multilingual LLM Watermarks with Sparse Autoencoderscited by 5
12 most cited of 17 All 17 (JSON)
- 2026TripPattern: A Pattern-based Text Watermarking Method for Large Language Models11 Sep 2026
- 2026Efficient Online LLM Watermark Detection via Rao-Blackwellized E-Processes24 Jul 2026
- 2025SAEMark: Steering Personalized Multilingual LLM Watermarks with Sparse Autoencoders11 Aug 2025
- 2025BiMarker: Enhancing Text Watermark Detection for Large Language Models with Bipolar Watermarks21 Jan 2025
- 2024Ensemble Watermarks for Large Language Models29 Nov 2024
- 2024Stylometric Watermarks for Large Language Models14 May 2024
- 2024Generative Models are Self-Watermarked: Declaring Model Authentication through Re-Generation23 Feb 2024
- 2023On the Learnability of Watermarks for Language Models7 Dec 2023
- 2023Publicly-Detectable Watermarking for Language Models27 Oct 2023
- 2023From Text to Source: Results in Detecting Large Language Model-Generated Content23 Sep 2023
- 2023Towards Codable Watermarking for Injecting Multi-bits Information to LLMs29 Jul 2023
- 2023Robust Distortion-free Watermarks for Language Models28 Jul 2023
12 newest of 17 All 17 (JSON)
- 2024LLM Evaluators Recognize and Favor Their Own Generationscited by 651
- 2023Large Language Model Alignment: A Surveycited by 241
- 2025Watermarking Degrades Alignment in Language Models: Analysis and Mitigationcited by 3
- 2025Watermarking Degrades Alignment in Language Models: Analysis and Mitigation4 Jun 2025
- 2024LLM Evaluators Recognize and Favor Their Own Generations15 Apr 2024
- 2023Large Language Model Alignment: A Survey26 Sep 2023
- 2021Ethical and social risks of harm from Language Modelscited by 957
- 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 705
- 2023How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detectioncited by 472
- 2023Fast-DetectGPT: Efficient Zero-Shot Detection of Machine-Generated Text via Conditional Probability Curvaturecited by 278
- 2024Knowledge Conflicts for LLMs: A Surveycited by 274
- 2023DetectLLM: Leveraging Log Rank Information for Zero-Shot Detection of Machine-Generated Textcited by 207
- 2023GPT detectors are biased against non-native English writerscited by 175
- 2023Can LLM-Generated Misinformation Be Detected?cited by 173
- 2024Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer Reviewscited by 160
- 2022mGPT: Few-Shot Learners Go Multilingualcited by 141
- 2023AI Transparency in the Age of LLMs: A Human-Centered Research Roadmapcited by 119
- 2021TURINGBENCH: A Benchmark Environment for Turing Test in the Age of Neural Text Generationcited by 118
12 most cited of 138 All 138 (JSON)
- 2026Rethinking Multimodal Fake News Detection in the Generative AI Era29 Sep 2026
- 2026Hitting a Moving Target: Test-Time Adaptation for AI Text Detection under Continual Distribution Shift23 Jun 2026
- 2026SV-Detect: AI-generated Text Detection with Steering Vectors5 Jun 2026
- 2026Sem-Detect: Semantic Level Detection of AI Generated Peer-Reviews20 May 2026
- 2026Lightweight Stylistic Consistency Profiling: Robust Detection of LLM-Generated Textual Content for Multimedia Moderation7 May 2026
- 2026Luminol-AIDetect: Fast Zero-shot Machine-Generated Text Detection based on Perplexity under Text Shuffling28 Apr 2026
- 2026The Truncation Blind Spot: How Decoding Strategies Systematically Exclude Human-Like Token Choices19 Mar 2026
- 2025DAMASHA: Detecting AI in Mixed Adversarial Texts via Segmentation with Human-interpretable Attribution4 Dec 2025
- 2025A Cross-Cultural Assessment of Human Ability to Detect LLM-Generated Fake News about South Africa21 Nov 2025
- 2025A Theoretical Analysis of Detecting Large Model-Generated Time Series10 Nov 2025
- 2025ALHD: A Large-Scale and Multigenre Benchmark Dataset for Arabic LLM-Generated Text Detection3 Oct 2025
- 2025DetectAnyLLM: Towards Generalizable and Robust Detection of Machine-Generated Text Across Domains and Models15 Sep 2025
12 newest of 138 All 138 (JSON)