Human Texts Are Outliers: Detecting LLM-generated Texts via Out-of-distribution Detection
Not on the map. Why?
Abstract (arXiv)
The rapid advancement of large language models (LLMs) such as ChatGPT, DeepSeek, and Claude has significantly increased the presence of AI-generated text in digital communication. This trend has heightened the need for reliable detection methods to distinguish between human-authored and machine-generated content. Existing approaches both zero-shot methods and supervised classifiers largely conceptualize this task as a binary classification problem, often leading to poor generalization across domains and models. In this paper, we argue that such a binary formulation fundamentally mischaracterizes the detection task by assuming a coherent representation of human-written texts. In reality, human texts do not constitute a unified distribution, and their diversity cannot be effectively captured through limited sampling. This causes previous classifiers to memorize observed OOD characteristics rather than learn the essence of `non-ID' behavior, limiting generalization to unseen human-authored inputs. Based on this observation, we propose reframing the detection task as an out-of-distribution (OOD) detection problem, treating human-written texts as distributional outliers while machine-generated texts are in-distribution (ID) samples. To this end, we develop a detection framework using one-class learning method including DeepSVDD and HRN, and score-based learning techniques such as energy-based method, enabling robust and generalizable performance. Extensive experiments across multiple datasets validate the effectiveness of our OOD-based approach. Specifically, the OOD-based method achieves 98.3% AUROC and AUPR with only 8.9% FPR95 on DeepFake dataset. Moreover, we test our detection framework on multilingual, attacked, and unseen-model and -domain text settings, demonstrating the robustness and generalizability of our framework. Code, pretrained weights, and demo will be released.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 61 of its 83 references that are in the map. First posted on arXiv 7 Oct 2025.
Builds on
61 of 83 references.
References · 61
- 2023GPT-4 Technical Reportcited by 18,396
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
- 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,485
- 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,328
- 2020Energy-based Out-of-distribution Detectioncited by 1,299
- 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 726
- 2023A Watermark for Large Language Modelscited by 725
- 2019GLTR: Statistical Detection and Visualization of Generated Textcited by 496
- 2019Likelihood Ratios for Out-of-Distribution Detectioncited by 453
38 more
- 2023Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defensecited by 429
- 2020Generalized ODIN: Detecting Out-of-distribution Image without Learning from Out-of-distribution Datacited by 408
- 2023Can AI-Generated Text be Reliably Detected?cited by 386
- 2023Fast-DetectGPT: Efficient Zero-Shot Detection of Machine-Generated Text via Conditional Probability Curvaturecited by 287
- 2024Spotting LLMs With Binoculars: Zero-Shot Detection of Machine-Generated Textcited by 263
- 2019Automatic Detection of Generated Text is Easiest when Humans are Fooledcited by 261
- 2018Learning Confidence for Out-of-Distribution Detection in Neural Networkscited by 245
- 2023Undetectable Watermarks for Language Modelscited by 226
- 2023DetectLLM: Leveraging Log Rank Information for Zero-Shot Detection of Machine-Generated Textcited by 210
- 2018WikiHow: A Large Scale Text Summarization Datasetcited by 204
- 2018Adversarially Learned One-Class Classifier for Novelty Detectioncited by 202
- 2019OCGAN: One-class Novelty Detection Using GANs with Constrained Latent Representationscited by 199
- 2023RADAR: Robust AI-Text Detection via Adversarial Learningcited by 190
- 2021Anomaly Detection on Attributed Networks via Contrastive Self-Supervised Learningcited by 177
- 2024RAID: A Shared Benchmark for Robust Evaluation of Machine-Generated Text Detectorscited by 163
- 2018A Dataset of Peer Reviews (PeerRead): Collection, Insights and NLP Applicationscited by 136
- 2023The Troubling Emergence of Hallucination in Large Language Models -- An Extensive Definition, Quantification, and Prescriptive Remediationscited by 131
- 2020Adversarial Watermarking Transformer: Towards Tracing Text Provenance with Data Hidingcited by 130
- 2023DNA-GPT: Divergent N-Gram Analysis for Training-Free Detection of GPT-Generated Textcited by 129
- 2023M4: Multi-generator, Multi-domain, and Multi-lingual Black-Box Machine-Generated Text Detectioncited by 121
- 2020ATOM: Robustifying Out-of-distribution Detection Using Outlier Miningcited by 116
- 2023Intrinsic Dimension Estimation for Robust Detection of AI-Generated Textscited by 112
- 2023Ghostbuster: Detecting Text Ghostwritten by Large Language Modelscited by 91
- 2023On the Possibilities of AI-Generated Text Detectioncited by 88
- 2018Anomaly Detection using One-Class Neural Networkscited by 82
- 2023Robust Multi-bit Natural Language Watermarking through Invariant Featurescited by 82
- 2022Do Language Models Plagiarize?cited by 73
- 2023A Survey on Detection of LLMs-Generated Contentcited by 71
- 2023SeqXGPT: Sentence-Level AI-Generated Text Detectioncited by 56
- 2024DeTeCtive: Detecting AI-generated Text via Multi-Level Contrastive Learningcited by 53
- 2019Generating Sentiment-Preserving Fake Online Reviews Using Neural Language Models and Their Human- and Machine-based Detectioncited by 52
- 2024Raidar: geneRative AI Detection viA Rewritingcited by 52
- 2023GPT-Sentinel: Distinguishing Human and ChatGPT Generated Contentcited by 43
- 2023Origin Tracing and Detecting of LLMscited by 40
- 2023GPT-who: An Information Density-based Machine-Generated Text Detectorcited by 40
- 2023Smaller Language Models are Better Black-box Machine-Generated Text Detectorscited by 35
- 2022CoCo: Coherence-Enhanced Machine-Generated Text Detection Under Data Limitation With Contrastive Learningcited by 33
- 2023A Survey on Out-of-Distribution Detection in NLPcited by 31
50 most cited of 61 All 61 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 7.
8 papers.
- 2025On the Detectability of LLM-Generated Text: What Exactly Is LLM-Generated Text?cited by 3
- 2026MELD: Multi-Task Equilibrated Learning Detector for AI-Generated Textcited by 1
- 2026DetectZoo: A Unified Toolkit for AI-Generated Content Detection Across Text, Audio, and Image Modalitiescited by 1
- 2026Operation-Guided Progressive Human-to-AI Text Transformation Benchmark for Multi-Granularity AI-Text Detectioncited by 1
- 2026Multi-Level Contextual Token Relation Modeling for Machine-Generated Text Detectioncited by 0
- 2026Hidden Human-Like Nature of Machine-Generated Texts: Theory and Detection Enhancementcited by 0
- 2026DWT-Fusion: A Signal-Based Framework for Training-Free LLM-Generated Text Detectioncited by 0
- 2026Build it, Break it, Repeat: Benchmarking and improving LLM-manipulated disinformation detection in social media postscited by 0
- 2026Build it, Break it, Repeat: Benchmarking and improving LLM-manipulated disinformation detection in social media posts10 Aug 2026
- 2026DWT-Fusion: A Signal-Based Framework for Training-Free LLM-Generated Text Detection24 Jul 2026
- 2026Operation-Guided Progressive Human-to-AI Text Transformation Benchmark for Multi-Granularity AI-Text Detection4 Jun 2026
- 2026DetectZoo: A Unified Toolkit for AI-Generated Content Detection Across Text, Audio, and Image Modalities2 Jun 2026
- 2026Hidden Human-Like Nature of Machine-Generated Texts: Theory and Detection Enhancement22 May 2026
- 2026Multi-Level Contextual Token Relation Modeling for Machine-Generated Text Detection15 May 2026
- 2026MELD: Multi-Task Equilibrated Learning Detector for AI-Generated Text7 May 2026
- 2025On the Detectability of LLM-Generated Text: What Exactly Is LLM-Generated Text?23 Oct 2025