mlsanityData to 7 Oct 2026

An Empirical Study of AI Generated Text Detection Tools

arXiv 2310.01423 ↗First posted 27 Sep 2023cs.CL cs.AI cs.LGcited by 9

Not on the map. Why?

Abstract (arXiv)

Since ChatGPT has emerged as a major AIGC model, providing high-quality responses across a wide range of applications (including software development and maintenance), it has attracted much interest from many individuals. ChatGPT has great promise, but there are serious problems that might arise from its misuse, especially in the realms of education and public safety. Several AIGC detectors are available, and they have all been tested on genuine text. However, more study is needed to see how effective they are for multi-domain ChatGPT material. This study aims to fill this need by creating a multi-domain dataset for testing the state-of-the-art APIs and tools for detecting artificially generated information used by universities and other research institutions. A large dataset consisting of articles, abstracts, stories, news, and product reviews was created for this study. The second step is to use the newly created dataset to put six tools through their paces. Six different artificial intelligence (AI) text identification systems, including "GPTkit," "GPTZero," "Originality," "Sapling," "Writer," and "Zylalab," have accuracy rates between 55.29 and 97.0%. Although all the tools fared well in the evaluations, originality was particularly effective across the board.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 15 of its 44 references that are in the map. First posted on arXiv 27 Sep 2023.

Builds on

15 of 44 references.

References · 15

  1. 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 705
  2. 2019Defending Against Neural Fake Newscited by 553
  3. 2019Release Strategies and the Social Impacts of Language Modelscited by 505
  4. 2019GLTR: Statistical Detection and Visualization of Generated Textcited by 490
  5. 2023How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detectioncited by 472
  6. 2023Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defensecited by 401
  7. 2017PubMed 200k RCT: a Dataset for Sequential Sentence Classification in Medical Abstractscited by 123
  8. 2020You Autocomplete Me: Poisoning Vulnerabilities in Neural Code Completioncited by 112
  9. 2023Testing of Detection Tools for AI-Generated Textcited by 86
  10. 2023ChatGPT or Human? Detect and Explain. Explaining Decisions of Machine Learning Model for Detecting Short ChatGPT-generated Textcited by 84
  11. 2021Artificial Text Detection via Examining the Topology of Attention Mapscited by 49
  12. 2022Order-Disorder: Imitation Adversarial Attacks for Black-box Neural Ranking Modelscited by 37
3 more
  1. 2023To ChatGPT, or not to ChatGPT: That is the question!cited by 20
  2. 2020Mining Disinformation and Fake News: Concepts, Methods, and Recent Advancementscited by 17
  3. 2023Evaluating AIGC Detectors on Code Contentcited by 12

Built on by

Cited by year

Citing papers per year: 2023: 1; 2024: 6; 2025: 2.

9 papers.