mlsanityData to 14 Oct 2026

Can You Detect the Difference?

arXiv 2507.10475 ↗First posted 14 Jul 2025cs.CL cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

The rapid advancement of large language models (LLMs) has raised concerns about reliably detecting AI-generated text. Stylometric metrics work well on autoregressive (AR) outputs, but their effectiveness on diffusion-based models is unknown. We present the first systematic comparison of diffusion-generated text (LLaDA) and AR-generated text (LLaMA) using 2 000 samples. Perplexity, burstiness, lexical diversity, readability, and BLEU/ROUGE scores show that LLaDA closely mimics human text in perplexity and burstiness, yielding high false-negative rates for AR-oriented detectors. LLaMA shows much lower perplexity but reduced lexical fidelity. Relying on any single metric fails to separate diffusion outputs from human writing. We highlight the need for diffusion-aware detectors and outline directions such as hybrid models, diffusion-specific stylometric signatures, and robust watermarking.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 9 of its 17 references that are in the map. First posted on arXiv 14 Jul 2025.

Builds on

9 of 17 references.

References · 9

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  3. 2025Large Language Diffusion Modelscited by 912
  4. 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 726
  5. 2023A Watermark for Large Language Modelscited by 725
  6. 2023A Robust Semantics-based Watermark for Large Language Model against Paraphrasingcited by 82
  7. 2025DAMAGE: Detecting Adversarially Modified AI Generated Textcited by 20
  8. 2025Improved Unbiased Watermark for Large Language Modelscited by 17
  9. 2025In-Context Watermarks for Large Language Modelscited by 10

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Differences in Text Generated by Diffusion and Autoregressive Language Models
  2. 2023A Survey on LLM-Generated Text Detection: Necessity, Methods, and Future Directions
  3. 2026Detecting the Machine: A Comprehensive Benchmark of AI-Generated Text Detectors Across Architectures, Domains, and Adversarial Conditions
  4. 2024Scaling Diffusion Language Models via Adaptation from Autoregressive Models
  5. 2025RepreGuard: Detecting LLM-Generated Text by Revealing Hidden Representation Patterns
  6. 2026Hacking Generative Perplexity: Why Unconditional Text Evaluation Needs Distributional Metrics
  7. 2023AR-Diffusion: Auto-Regressive Diffusion Model for Text Generation
  8. 2026Beyond Perplexity: Character Distribution Signatures and the MDTA Benchmark for AI Text Detection