mlsanityData to 14 Oct 2026

Is Contrasting All You Need? Contrastive Learning for the Detection and Attribution of AI-generated Text

arXiv 2407.09364 ↗First posted 12 Jul 2024cs.CL cs.AI cs.CYcited by 11

Not on the map. Why?

Abstract (arXiv)

The significant progress in the development of Large Language Models has contributed to blurring the distinction between human and AI-generated text. The increasing pervasiveness of AI-generated text and the difficulty in detecting it poses new challenges for our society. In this paper, we tackle the problem of detecting and attributing AI-generated text by proposing WhosAI, a triplet-network contrastive learning framework designed to predict whether a given input text has been generated by humans or AI and to unveil the authorship of the text. Unlike most existing approaches, our proposed framework is conceived to learn semantic similarity representations from multiple generators at once, thus equally handling both detection and attribution tasks. Furthermore, WhosAI is model-agnostic and scalable to the release of new AI text-generation models by incorporating their generated instances into the embedding space learned by our framework. Experimental results on the TuringBench benchmark of 200K news articles show that our proposed framework achieves outstanding results in both the Turing Test and Authorship Attribution tasks, outperforming all the methods listed in the TuringBench benchmark leaderboards.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 46 of its 55 references that are in the map. First posted on arXiv 12 Jul 2024.

Builds on

46 of 55 references.

References · 46

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  4. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  5. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  6. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
  7. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,811
  8. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
  9. 2019Transformer-XL: Attentive Language Models Beyond a Fixed-Length Contextcited by 1,850
  10. 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,216
  11. 2019Cross-lingual Language Model Pretrainingcited by 1,090
  12. 2019Plug and Play Language Models: A Simple Approach to Controlled Text Generationcited by 799
34 more
  1. 2019CTRL: A Conditional Transformer Language Model for Controllable Generationcited by 762
  2. 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 726
  3. 2023A Watermark for Large Language Modelscited by 725
  4. 2019Defending Against Neural Fake Newscited by 559
  5. 2019GLTR: Statistical Detection and Visualization of Generated Textcited by 496
  6. 2023Can AI-Generated Text be Reliably Detected?cited by 386
  7. 2019Multi-Similarity Loss with General Pair Weighting for Deep Metric Learningcited by 368
  8. 2023Fast-DetectGPT: Efficient Zero-Shot Detection of Machine-Generated Text via Conditional Probability Curvaturecited by 287
  9. 2019On The Power of Curriculum Learning in Training Deep Networkscited by 286
  10. 2019Automatic Detection of Generated Text is Easiest when Humans are Fooledcited by 261
  11. 2023DetectLLM: Leveraging Log Rank Information for Zero-Shot Detection of Machine-Generated Textcited by 210
  12. 2019Facebook FAIR's WMT19 News Translation Task Submissioncited by 179
  13. 2020Automatic Detection of Machine Generated Text: A Critical Surveycited by 166
  14. 2023The Science of Detecting LLM-Generated Textscited by 128
  15. 2021TURINGBENCH: A Benchmark Environment for Turing Test in the Age of Neural Text Generationcited by 120
  16. 2023Intrinsic Dimension Estimation for Robust Detection of AI-Generated Textscited by 112
  17. 2022Human heuristics for AI-generated language are flawedcited by 105
  18. 2023Ghostbuster: Detecting Text Ghostwritten by Large Language Modelscited by 91
  19. 2023Robust Multi-bit Natural Language Watermarking through Invariant Featurescited by 82
  20. 2023SeqXGPT: Sentence-Level AI-Generated Text Detectioncited by 56
  21. 2021Few-Shot Intent Detection via Contrastive Pre-Training and Fine-Tuningcited by 46
  22. 2023GPT-who: An Information Density-based Machine-Generated Text Detectorcited by 40
  23. 2023Fighting Fire with Fire: Can ChatGPT Detect AI-generated Text?cited by 39
  24. 2021Improved Text Classification via Contrastive Adversarial Trainingcited by 38
  25. 2023ConDA: Contrastive Domain Adaptation for AI-generated Text Detectioncited by 37
  26. 2023Anatomy of an AI-powered malicious social botnetcited by 36
  27. 2023HowkGPT: Investigating the Detection of ChatGPT-generated University Student Homework through Context-Aware Perplexity Analysiscited by 30
  28. 2024Learning to Watermark LLM-generated Text via Reinforcement Learningcited by 22
  29. 2024Open Models, Closed Minds? On Agents Capabilities in Mimicking Human Personalities through Open Large Language Modelscited by 20
  30. 2023Efficient Detection of LLM-generated Texts with a Bayesian Surrogate Modelcited by 18
  31. 2024Threads of Subtlety: Detecting Machine-Generated Texts Through Discourse Motifscited by 18
  32. 2020Facebook AI's WMT20 News Translation Task Submissioncited by 17
  33. 2023ContrastNet: A Contrastive Learning Framework for Few-Shot Text Classificationcited by 17
  34. 2024EAGLE: A Domain Generalization Framework for AI-generated Text Detectioncited by 13

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 5; 2026: 6.

11 papers.