GPT-Sentinel: Distinguishing Human and ChatGPT Generated Content
Not on the map. Why?
Abstract (arXiv)
This paper presents a novel approach for detecting ChatGPT-generated vs. human-written text using language models. To this end, we first collected and released a pre-processed dataset named OpenGPTText, which consists of rephrased content generated using ChatGPT. We then designed, implemented, and trained two different models for text classification, using Robustly Optimized BERT Pretraining Approach (RoBERTa) and Text-to-Text Transfer Transformer (T5), respectively. Our models achieved remarkable results, with an accuracy of over 97% on the test dataset, as evaluated through various metrics. Furthermore, we conducted an interpretability study to showcase our model's ability to extract and differentiate key features between human-written and ChatGPT-generated text. Our findings provide important insights into the effective use of language models to detect generated text.
Key facts. Cited by 40 papers in the map (data through 7 Oct 2026). Builds on 13 of its 34 references that are in the map. First posted on arXiv 13 May 2023.
Builds on
13 of 34 references.
References · 13
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
- 2017Axiomatic Attribution for Deep Networkscited by 3,350
- 2017Decoupled Weight Decay Regularizationcited by 1,722
- 2019ELI5: Long Form Question Answeringcited by 567
- 2019Defending Against Neural Fake Newscited by 553
- 2019Release Strategies and the Social Impacts of Language Modelscited by 505
- 2019GLTR: Statistical Detection and Visualization of Generated Textcited by 490
- 2019Automatic Detection of Generated Text is Easiest when Humans are Fooledcited by 260
1 more
- 2020Automatic Detection of Machine Generated Text: A Critical Surveycited by 160
Built on by
Citing papers per year: 2023: 7; 2024: 24; 2025: 7; 2026: 2.
40 papers.
Sort:
By area:
- 2024Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer Reviewscited by 160
- 2023DNA-GPT: Divergent N-Gram Analysis for Training-Free Detection of GPT-Generated Textcited by 127
- 2024Mapping the Increasing Use of LLMs in Scientific Paperscited by 112
- 2023A Survey on LLM-Generated Text Detection: Necessity, Methods, and Future Directionscited by 101
- 2024Detecting Multimedia Generated by Large AI Models: A Surveycited by 73
- 2023A Survey on Detection of LLMs-Generated Contentcited by 70
- 2024DeTeCtive: Detecting AI-generated Text via Multi-Level Contrastive Learningcited by 52
- 2024TRAP: Targeted Random Adversarial Prompt Honeypot for Black-Box Identificationcited by 33
- 2023Towards Possibilities & Impossibilities of AI-generated Text Detection: A Surveycited by 28
- 2024Between Lines of Code: Unraveling the Distinct Patterns of Machine and Human Programmerscited by 27
- 2024Who Wrote This? The Key to Zero-Shot LLM-Generated Text Detection Is GECScorecited by 27
- 2025RepreGuard: Detecting LLM-Generated Text by Revealing Hidden Representation Patternscited by 24
28 more
- 2024Detecting AI-Generated Text: Factors Influencing Detectability with Current Methodscited by 23
- 2024Permute-and-Flip: An optimally stable and watermarkable decoder for LLMscited by 17
- 2025Improving Your Model Ranking on Chatbot Arena by Vote Riggingcited by 16
- 2023On the Trustworthiness Landscape of State-of-the-art Generative Models: A Survey and Outlookcited by 15
- 2024Zero-Shot Detection of LLM-Generated Text using Token Cohesivenesscited by 13
- 2024DALD: Improving Logits-based Detector without Logits from Black-box LLMscited by 12
- 2025DETree: DEtecting Human-AI Collaborative Texts via Tree-Structured Hierarchical Representation Learningcited by 12
- 2024Does DetectGPT Fully Utilize Perturbation? Bridging Selective Perturbation to Fine-tuned Contrastive Learning Detector would be Bettercited by 11
- 2023On the Generalization of Training-based ChatGPT Detection Methodscited by 9
- 2024'Quis custodiet ipsos custodes?' Who will watch the watchmen? On Detecting AI-generated peer-reviewscited by 8
- 2025Human Texts Are Outliers: Detecting LLM-generated Texts via Out-of-distribution Detectioncited by 8
- 2024Humanizing the Machine: Proxy Attacks to Mislead LLM Detectorscited by 6
- 2024Deciphering Textual Authenticity: A Generalized Strategy through the Lens of Large Language Semantics for Detecting Human vs. Machine-Generated Textcited by 5
- 2024Survey on Plagiarism Detection in Large Language Models: The Impact of ChatGPT and Gemini on Academic Integritycited by 5
- 2024Using Machine Learning to Distinguish Human-written from Machine-generated Creative Fictioncited by 4
- 2025Synthetic Artifact Auditing: Tracing LLM-Generated Synthetic Data Usage in Downstream Applicationscited by 4
- 2024Generative Models are Self-Watermarked: Declaring Model Authentication through Re-Generationcited by 3
- 2024HULLMI: Human vs LLM identification with explainabilitycited by 3
- 2024OffensiveLang: A Community Based Implicit Offensive Language Datasetcited by 2
- 2023Large Language Models for Conducting Advanced Text Analytics Information Systems Researchcited by 1
- 2024Investigating the Influence of Prompt-Specific Shortcuts in AI Generated Text Detectioncited by 1
- 2024Discourse Features Enhance Detection of Document-Level Machine-Generated Contentcited by 1
- 2025A Practical Synthesis of Detecting AI-Generated Textual, Visual, and Audio Contentcited by 1
- 2026Different Time, Different Language: Revisiting the Bias Against Non-Native Speakers in GPT Detectorscited by 1
- 2024TextMachina: Seamless Generation of Machine-Generated Text Datasetscited by 0
- 2024Who Writes the Review, Human or AI?cited by 0
- 2025Measuring Human Involvement in AI-Generated Text: A Case Study on Academic Writingcited by 0
- 2026DeBERTa-Sentinel: Toward Transparent and Trustworthy Detection of AI-Generated Textcited by 0
- 2026DeBERTa-Sentinel: Toward Transparent and Trustworthy Detection of AI-Generated Text2 Aug 2026
- 2026Different Time, Different Language: Revisiting the Bias Against Non-Native Speakers in GPT Detectors5 Feb 2026
- 2025DETree: DEtecting Human-AI Collaborative Texts via Tree-Structured Hierarchical Representation Learning20 Oct 2025
- 2025Human Texts Are Outliers: Detecting LLM-generated Texts via Out-of-distribution Detection7 Oct 2025
- 2025RepreGuard: Detecting LLM-Generated Text by Revealing Hidden Representation Patterns18 Aug 2025
- 2025Measuring Human Involvement in AI-Generated Text: A Case Study on Academic Writing4 Jun 2025
- 2025A Practical Synthesis of Detecting AI-Generated Textual, Visual, and Audio Content2 Apr 2025
- 2025Synthetic Artifact Auditing: Tracing LLM-Generated Synthetic Data Usage in Downstream Applications2 Feb 2025
- 2025Improving Your Model Ranking on Chatbot Arena by Vote Rigging29 Jan 2025
- 2024Discourse Features Enhance Detection of Document-Level Machine-Generated Content17 Dec 2024
- 2024Using Machine Learning to Distinguish Human-written from Machine-generated Creative Fiction15 Dec 2024
- 2024DeTeCtive: Detecting AI-generated Text via Multi-Level Contrastive Learning28 Oct 2024
28 more
- 2024Humanizing the Machine: Proxy Attacks to Mislead LLM Detectors25 Oct 2024
- 2024'Quis custodiet ipsos custodes?' Who will watch the watchmen? On Detecting AI-generated peer-reviews13 Oct 2024
- 2024Zero-Shot Detection of LLM-Generated Text using Token Cohesiveness25 Sep 2024
- 2024HULLMI: Human vs LLM identification with explainability7 Sep 2024
- 2024Investigating the Influence of Prompt-Specific Shortcuts in AI Generated Text Detection24 Jun 2024
- 2024Detecting AI-Generated Text: Factors Influencing Detectability with Current Methods21 Jun 2024
- 2024DALD: Improving Logits-based Detector without Logits from Black-box LLMs7 Jun 2024
- 2024Survey on Plagiarism Detection in Large Language Models: The Impact of ChatGPT and Gemini on Academic Integrity4 Jun 2024
- 2024Who Writes the Review, Human or AI?30 May 2024
- 2024Who Wrote This? The Key to Zero-Shot LLM-Generated Text Detection Is GECScore7 May 2024
- 2024Mapping the Increasing Use of LLMs in Scientific Papers1 Apr 2024
- 2024Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer Reviews11 Mar 2024
- 2024OffensiveLang: A Community Based Implicit Offensive Language Dataset4 Mar 2024
- 2024Generative Models are Self-Watermarked: Declaring Model Authentication through Re-Generation23 Feb 2024
- 2024TRAP: Targeted Random Adversarial Prompt Honeypot for Black-Box Identification20 Feb 2024
- 2024Permute-and-Flip: An optimally stable and watermarkable decoder for LLMs8 Feb 2024
- 2024Does DetectGPT Fully Utilize Perturbation? Bridging Selective Perturbation to Fine-tuned Contrastive Learning Detector would be Better1 Feb 2024
- 2024Detecting Multimedia Generated by Large AI Models: A Survey22 Jan 2024
- 2024Deciphering Textual Authenticity: A Generalized Strategy through the Lens of Large Language Semantics for Detecting Human vs. Machine-Generated Text17 Jan 2024
- 2024Between Lines of Code: Unraveling the Distinct Patterns of Machine and Human Programmers12 Jan 2024
- 2024TextMachina: Seamless Generation of Machine-Generated Text Datasets8 Jan 2024
- 2023Large Language Models for Conducting Advanced Text Analytics Information Systems Research27 Dec 2023
- 2023A Survey on Detection of LLMs-Generated Content24 Oct 2023
- 2023Towards Possibilities & Impossibilities of AI-generated Text Detection: A Survey23 Oct 2023
- 2023A Survey on LLM-Generated Text Detection: Necessity, Methods, and Future Directions23 Oct 2023
- 2023On the Generalization of Training-based ChatGPT Detection Methods2 Oct 2023
- 2023On the Trustworthiness Landscape of State-of-the-art Generative Models: A Survey and Outlook31 Jul 2023
- 2023DNA-GPT: Divergent N-Gram Analysis for Training-Free Detection of GPT-Generated Text27 May 2023
- 2024Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer Reviewscited by 160
- 2023DNA-GPT: Divergent N-Gram Analysis for Training-Free Detection of GPT-Generated Textcited by 127
- 2024Mapping the Increasing Use of LLMs in Scientific Paperscited by 112
- 2023A Survey on LLM-Generated Text Detection: Necessity, Methods, and Future Directionscited by 101
- 2023A Survey on Detection of LLMs-Generated Contentcited by 70
- 2024DeTeCtive: Detecting AI-generated Text via Multi-Level Contrastive Learningcited by 52
- 2023Towards Possibilities & Impossibilities of AI-generated Text Detection: A Surveycited by 28
- 2024Between Lines of Code: Unraveling the Distinct Patterns of Machine and Human Programmerscited by 27
- 2024Who Wrote This? The Key to Zero-Shot LLM-Generated Text Detection Is GECScorecited by 27
- 2025RepreGuard: Detecting LLM-Generated Text by Revealing Hidden Representation Patternscited by 24
- 2024Detecting AI-Generated Text: Factors Influencing Detectability with Current Methodscited by 23
- 2025Improving Your Model Ranking on Chatbot Arena by Vote Riggingcited by 16
12 most cited of 34 All 34 (JSON)
- 2026DeBERTa-Sentinel: Toward Transparent and Trustworthy Detection of AI-Generated Text2 Aug 2026
- 2026Different Time, Different Language: Revisiting the Bias Against Non-Native Speakers in GPT Detectors5 Feb 2026
- 2025DETree: DEtecting Human-AI Collaborative Texts via Tree-Structured Hierarchical Representation Learning20 Oct 2025
- 2025Human Texts Are Outliers: Detecting LLM-generated Texts via Out-of-distribution Detection7 Oct 2025
- 2025RepreGuard: Detecting LLM-Generated Text by Revealing Hidden Representation Patterns18 Aug 2025
- 2025Measuring Human Involvement in AI-Generated Text: A Case Study on Academic Writing4 Jun 2025
- 2025A Practical Synthesis of Detecting AI-Generated Textual, Visual, and Audio Content2 Apr 2025
- 2025Improving Your Model Ranking on Chatbot Arena by Vote Rigging29 Jan 2025
- 2024Discourse Features Enhance Detection of Document-Level Machine-Generated Content17 Dec 2024
- 2024Using Machine Learning to Distinguish Human-written from Machine-generated Creative Fiction15 Dec 2024
- 2024DeTeCtive: Detecting AI-generated Text via Multi-Level Contrastive Learning28 Oct 2024
- 2024Humanizing the Machine: Proxy Attacks to Mislead LLM Detectors25 Oct 2024
12 newest of 34 All 34 (JSON)