Can You Detect the Difference?
Not on the map. Why?
Abstract (arXiv)
The rapid advancement of large language models (LLMs) has raised concerns about reliably detecting AI-generated text. Stylometric metrics work well on autoregressive (AR) outputs, but their effectiveness on diffusion-based models is unknown. We present the first systematic comparison of diffusion-generated text (LLaDA) and AR-generated text (LLaMA) using 2 000 samples. Perplexity, burstiness, lexical diversity, readability, and BLEU/ROUGE scores show that LLaDA closely mimics human text in perplexity and burstiness, yielding high false-negative rates for AR-oriented detectors. LLaMA shows much lower perplexity but reduced lexical fidelity. Relying on any single metric fails to separate diffusion outputs from human writing. We highlight the need for diffusion-aware detectors and outline directions such as hybrid models, diffusion-specific stylometric signatures, and robust watermarking.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 9 of its 17 references that are in the map. First posted on arXiv 14 Jul 2025.
Builds on
9 of 17 references.
References · 9
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2025Large Language Diffusion Modelscited by 912
- 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 726
- 2023A Watermark for Large Language Modelscited by 725
- 2023A Robust Semantics-based Watermark for Large Language Model against Paraphrasingcited by 82
- 2025DAMAGE: Detecting Adversarially Modified AI Generated Textcited by 20
- 2025Improved Unbiased Watermark for Large Language Modelscited by 17
- 2025In-Context Watermarks for Large Language Modelscited by 10
Built on by
Citing papers per year: 2025: 1.
1 paper.
- 2025Watermarking Diffusion Language Modelscited by 10
- 2025Watermarking Diffusion Language Models29 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2026Differences in Text Generated by Diffusion and Autoregressive Language Models
- 2023A Survey on LLM-Generated Text Detection: Necessity, Methods, and Future Directions
- 2026Detecting the Machine: A Comprehensive Benchmark of AI-Generated Text Detectors Across Architectures, Domains, and Adversarial Conditions
- 2024Scaling Diffusion Language Models via Adaptation from Autoregressive Models
- 2025RepreGuard: Detecting LLM-Generated Text by Revealing Hidden Representation Patterns
- 2026Hacking Generative Perplexity: Why Unconditional Text Evaluation Needs Distributional Metrics
- 2023AR-Diffusion: Auto-Regressive Diffusion Model for Text Generation
- 2026Beyond Perplexity: Character Distribution Signatures and the MDTA Benchmark for AI Text Detection