mlsanityData to 7 Oct 2026

A Training-free Method for LLM Text Attribution

arXiv 2501.02406 ↗First posted 4 Jan 2025stat.ML cs.AI cs.CLcited by 4

Not on the map. Why?

Abstract (arXiv)

Verifying the provenance of text is increasingly important for firms, educational institutions, and online platforms as Large Language Models (LLMs) produce output that is nearly indistinguishable from human-generated content. We study the problem of determining whether a given text was generated by a particular LLM while controlling the false positive rate. We model LLM-generated text as a sequential stochastic process and develop training-free statistical tests to (i) distinguish between text produced by two known sets of LLMs and (ii) determine whether text was generated by a known LLM or by a distinguishable unknown source, such as a human or another model. We prove that both Type I and Type II errors decay exponentially with text length, establish analogous guarantees for black-box access via sampling, and provide an information-theoretic lower bound showing that there exist model pairs for which no statistical test can make both errors decay faster than exponentially with text length. Numerical experiments empirically evaluate the tests in practical settings and demonstrate strong overall performance, including under many adversarial edits. Our framework provides rigorous guarantees for LLM provenance detection, with applications to content verification, institutional compliance, and misinformation mitigation.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 30 of its 69 references that are in the map. First posted on arXiv 4 Jan 2025.

Builds on

30 of 69 references.

References · 30

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  3. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  4. 2016The LAMBADA dataset: Word prediction requiring a broad discourse contextcited by 960
  5. 2019Release Strategies and the Social Impacts of Language Modelscited by 505
  6. 2019GLTR: Statistical Detection and Visualization of Generated Textcited by 490
  7. 2023How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detectioncited by 472
  8. 2021MAUVE: Measuring the Gap Between Neural Text and Human Text using Divergence Frontierscited by 466
  9. 2023Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defensecited by 401
  10. 2023Fast-DetectGPT: Efficient Zero-Shot Detection of Machine-Generated Text via Conditional Probability Curvaturecited by 278
  11. 2019Automatic Detection of Generated Text is Easiest when Humans are Fooledcited by 260
  12. 2024Spotting LLMs With Binoculars: Zero-Shot Detection of Machine-Generated Textcited by 255
18 more
  1. 2023DetectLLM: Leveraging Log Rank Information for Zero-Shot Detection of Machine-Generated Textcited by 207
  2. 2023RADAR: Robust AI-Text Detection via Adversarial Learningcited by 187
  3. 2020Automatic Detection of Machine Generated Text: A Critical Surveycited by 160
  4. 2024RAID: A Shared Benchmark for Robust Evaluation of Machine-Generated Text Detectorscited by 157
  5. 2023Co-Writing with Opinionated Language Models Affects Users' Viewscited by 145
  6. 2023DNA-GPT: Divergent N-Gram Analysis for Training-Free Detection of GPT-Generated Textcited by 127
  7. 2020TweepFake: about Detecting Deepfake Tweetscited by 117
  8. 2023Ghostbuster: Detecting Text Ghostwritten by Large Language Modelscited by 90
  9. 2019Generalization Bounds in the Predict-then-Optimize Frameworkcited by 54
  10. 2024DeTeCtive: Detecting AI-generated Text via Multi-Level Contrastive Learningcited by 52
  11. 2023CAME: Confidence-guided Adaptive Memory Efficient Optimizationcited by 34
  12. 2023HowkGPT: Investigating the Detection of ChatGPT-generated University Student Homework through Context-Aware Perplexity Analysiscited by 30
  13. 2024Robust Detection of Watermarks for Large Language Models Under Human Editscited by 29
  14. 2023Evade ChatGPT Detectors via A Single Spacecited by 18
  15. 2024DALD: Improving Logits-based Detector without Logits from Black-box LLMscited by 12
  16. 2023J-Guard: Journalism Guided Adversarially Robust Detection of AI-generated Newscited by 10
  17. 2023Mutation-Based Adversarial Attacks on Neural Text Detectorscited by 9
  18. 2020TS-UCB: Improving on Thompson Sampling With Little to No Additional Computationcited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 3.

4 papers.