mlsanityData to 7 Oct 2026

MAGE: Machine-generated Text Detection in the Wild

arXiv 2305.13242 ↗First posted 22 May 2023cs.CLcited by 130

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) have achieved human-level text generation, emphasizing the need for effective AI-generated text detection to mitigate risks like the spread of fake news and plagiarism. Existing research has been constrained by evaluating detection methods on specific domains or particular language models. In practical scenarios, however, the detector faces texts from various domains or LLMs without knowing their sources. To this end, we build a comprehensive testbed by gathering texts from diverse human writings and texts generated by different LLMs. Empirical results show challenges in distinguishing machine-generated texts from human-authored ones across various scenarios, especially out-of-distribution. These challenges are due to the decreasing linguistic distinctions between the two sources. Despite challenges, the top-performing detector can identify 86.54% out-of-domain texts generated by a new LLM, indicating the feasibility for application scenarios. We release our resources at https://github.com/yafuly/MAGE.

Key facts. Cited by 130 papers in the map (data through 7 Oct 2026). Builds on 37 of its 64 references that are in the map. First posted on arXiv 22 May 2023.

Builds on

37 of 64 references.

References · 37

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  5. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  6. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  7. 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,018
  8. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
  9. 2020Longformer: The Long-Document Transformercited by 3,362
  10. 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
  11. 2015Character-level Convolutional Networks for Text Classificationcited by 2,293
  12. 2018Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarizationcited by 1,308
25 more
  1. 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,281
  2. 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,271
  3. 2018Hierarchical Neural Story Generationcited by 1,182
  4. 2016Bag of Tricks for Efficient Text Classificationcited by 869
  5. 2020Stanza: A Python Natural Language Processing Toolkit for Many Human Languagescited by 719
  6. 2022GPT-NeoX-20B: An Open-Source Autoregressive Language Modelcited by 711
  7. 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 705
  8. 2019ELI5: Long Form Question Answeringcited by 567
  9. 2019Defending Against Neural Fake Newscited by 553
  10. 2019GLTR: Statistical Detection and Visualization of Generated Textcited by 490
  11. 2023How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detectioncited by 472
  12. 2016A Corpus and Evaluation Framework for Deeper Understanding of Commonsense Storiescited by 413
  13. 2023Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defensecited by 401
  14. 2023Can AI-Generated Text be Reliably Detected?cited by 372
  15. 2021DialogSum: A Real-Life Scenario Dialogue Summarization Datasetcited by 181
  16. 2023GPT detectors are biased against non-native English writerscited by 175
  17. 2020TweepFake: about Detecting Deepfake Tweetscited by 117
  18. 2021XLM-T: Multilingual Language Models in Twitter for Sentiment Analysis and Beyondcited by 114
  19. 2016Winning Arguments: Interaction Dynamics and Persuasion Strategies in Good-faith Online Discussionscited by 106
  20. 2019Real or Fake? Learning to Discriminate Machine from Human Generated Textcited by 98
  21. 2023Protecting Language Generation Models via Invisible Watermarkingcited by 81
  22. 2020Neural Deepfake Detection with Factual Structure of Textcited by 40
  23. 2022SynGEC: Syntax-Enhanced Grammatical Error Correction with a Tailored GEC-Oriented Parsercited by 32
  24. 2019SemEval-2013 Task 2: Sentiment Analysis in Twittercited by 22
  25. 2021SciXGen: A Scientific Paper Dataset for Context-Aware Text Generationcited by 22

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 17; 2025: 58; 2026: 54.

130 papers.

Sort:

By area:

  1. 2024Detecting Multimedia Generated by Large AI Models: A Surveycited by 73
  2. 2025People who frequently use ChatGPT for writing tasks are accurate and robust detectors of AI-generated textcited by 39
  3. 2024DetectRL: Benchmarking LLM-Generated Text Detection in Real-World Scenarioscited by 37
  4. 2024Are We in the AI-Generated Text World Already? Quantifying and Monitoring AIGT on Social Mediacited by 35
  5. 2024Beemo: Benchmark of Expert-edited Machine-generated Outputscited by 26
  6. 2025Advancing Sequential Numerical Prediction in Autoregressive Modelscited by 26
  7. 2024Under the Surface: Tracking the Artifactuality of LLM-Generated Datacited by 23
  8. 2024Detecting AI-Generated Text: Factors Influencing Detectability with Current Methodscited by 23
  9. 2024Evaluation of LLM Vulnerabilities to Being Misused for Personalized Disinformation Generationcited by 20
  10. 2024Is Your Paper Being Reviewed by an LLM? Investigating AI Text Detectability in Peer Reviewcited by 19
  11. 2025Is Your Paper Being Reviewed by an LLM? Benchmarking AI Text Detection in Peer Reviewcited by 18
  12. 2025Adversarial Paraphrasing: A Universal Attack for Humanizing AI-Generated Textcited by 16
38 more
  1. 2023On the Trustworthiness Landscape of State-of-the-art Generative Models: A Survey and Outlookcited by 15
  2. 2024MiRAGeNews: Multimodal Realistic AI-Generated News Detectioncited by 15
  3. 2024Glimpse: Enabling White-Box Methods to Use Proprietary Models for Zero-Shot LLM-Generated Text Detectioncited by 14
  4. 2025Unveiling Attractor Cycles in Large Language Models: A Dynamical Systems View of Successive Paraphrasingcited by 14
  5. 2025Machine-generated text detection prevents language model collapsecited by 14
  6. 2025Survey on AI-Generated Media Detection: From Non-MLLM to MLLMcited by 12
  7. 2025DETree: DEtecting Human-AI Collaborative Texts via Tree-Structured Hierarchical Representation Learningcited by 12
  8. 2024A Practical Examination of AI-Generated Text Detectors for Large Language Modelscited by 11
  9. 2025GenAI Content Detection Task 1: English and Multilingual Machine-Generated Text Detection: AI vs. Humancited by 11
  10. 2025Reliably Bounding False Positives: A Zero-Shot Machine-Generated Text Detection Framework via Multiscaled Conformal Predictioncited by 10
  11. 2025Stress-testing Machine Generated Text Detection: Shifting Language Models Writing Style to Fool Detectorscited by 9
  12. 2025textttDroid: A Resource Suite for AI-Generated Code Detectioncited by 9
  13. 2025MoSEs: Uncertainty-Aware AI-Generated Text Detection via Mixture of Stylistics Experts with Conditional Thresholdscited by 9
  14. 2024Are AI Detectors Good Enough? A Survey on Quality of Datasets With Machine-Generated Textscited by 8
  15. 2025Increasing the Robustness of the Fine-tuned Multilingual Machine-Generated Text Detectorscited by 8
  16. 2025DetectAnyLLM: Towards Generalizable and Robust Detection of Machine-Generated Text Across Domains and Modelscited by 8
  17. 2025GenAI Content Detection Task 3: Cross-Domain Machine-Generated Text Detection Challengecited by 7
  18. 2025Large Language Models Penetration in Scholarly Writing and Peer Reviewcited by 6
  19. 2025Decoupling Content and Expression: Two-Dimensional Detection of AI-Generated Textcited by 6
  20. 2025WETBench: A Benchmark for Detecting Task-Specific Machine-Generated Text on Wikipediacited by 6
  21. 2025DatasetAgent: A Novel Multi-Agent System for Auto-Constructing Datasets from Real-World Imagescited by 6
  22. 2025Stop DDoS Attacking the Research Community with AI-Generated Survey Paperscited by 6
  23. 2025Align to Structure: Aligning Large Language Models with Structural Informationcited by 5
  24. 2025FAID: Fine-Grained AI-Generated Text Detection Using Multi-Task Auxiliary and Multi-Level Contrastive Learningcited by 5
  25. 2025How does Misinformation Affect Large Language Model Behaviors and Preferences?cited by 5
  26. 2025DAMASHA: Detecting AI in Mixed Adversarial Texts via Segmentation with Human-interpretable Attributioncited by 5
  27. 2024Synthetic Lyrics Detection Across Languages and Genrescited by 4
  28. 2024LLM Detectors Still Fall Short of Real World: Case of LLM-Generated Short News-Like Postscited by 4
  29. 2025FDLLM: A Dedicated Detector for Black-Box LLMs Fingerprintingcited by 4
  30. 2025When Detection Fails: The Power of Fine-Tuned Models to Generate Human-Like Social Media Textcited by 4
  31. 2025MGT-Prism: Enhancing Domain Generalization for Machine-Generated Text Detection via Spectral Alignmentcited by 4
  32. 2025How Sampling Affects the Detectability of Machine-written texts: A Comprehensive Studycited by 4
  33. 2026When AI Settles Down: Late-Stage Stability as a Signature of AI-Generated Text Detectioncited by 4
  34. 2026StealthRL: Reinforcement Learning Paraphrase Attacks for Multi-Detector Evasion of AI-Text Detectorscited by 4
  35. 2026Retrieval Collapses When AI Pollutes the Webcited by 4
  36. 2024A Survey on Automatic Credibility Assessment Using Textual Credibility Signals in the Era of Large Language Modelscited by 3
  37. 2024GigaCheck: Detecting LLM-generated Content via Object-Centric Span Localizationcited by 3
  38. 2025Not all tokens are created equal: Perplexity Attention Weighted Networks for AI generated text detectioncited by 3

50 most cited of 130 All 130 (JSON)