Decoding the AI Pen: Techniques and Challenges in Detecting AI-Generated Text
Not on the map. Why?
Abstract (arXiv)
Large Language Models (LLMs) have revolutionized the field of Natural Language Generation (NLG) by demonstrating an impressive ability to generate human-like text. However, their widespread usage introduces challenges that necessitate thoughtful examination, ethical scrutiny, and responsible practices. In this study, we delve into these challenges, explore existing strategies for mitigating them, with a particular emphasis on identifying AI-generated text as the ultimate solution. Additionally, we assess the feasibility of detection from a theoretical perspective and propose novel research directions to address the current limitations in this domain.
Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Builds on 46 of its 64 references that are in the map. First posted on arXiv 9 Mar 2024.
Builds on
46 of 64 references.
References · 46
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2017Deep reinforcement learning from human preferencescited by 3,912
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2019Fine-Tuning Language Models from Human Preferencescited by 2,150
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
- 2022Language Models (Mostly) Know What They Knowcited by 1,856
- 2022Solving Quantitative Reasoning Problems with Language Modelscited by 1,392
- 2020RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Modelscited by 1,255
- 2017Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoningcited by 1,055
- 2021Show Your Work: Scratchpads for Intermediate Computation with Language Modelscited by 886
34 more
- 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 726
- 2019Release Strategies and the Social Impacts of Language Modelscited by 513
- 2019GLTR: Statistical Detection and Visualization of Generated Textcited by 496
- 2023Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defensecited by 429
- 2019Explain Yourself! Leveraging Language Models for Commonsense Reasoningcited by 367
- 2023Toxicity in ChatGPT: Analyzing Persona-assigned Language Modelscited by 360
- 2023Survey of Vulnerabilities in Large Language Models Revealed by Adversarial Attackscited by 194
- 2023GPT detectors are biased against non-native English writerscited by 178
- 2023DNA-GPT: Divergent N-Gram Analysis for Training-Free Detection of GPT-Generated Textcited by 129
- 2023On the Risk of Misinformation Pollution with Large Language Modelscited by 128
- 2020Just How Toxic is Data Poisoning? A Unified Benchmark for Backdoor and Data Poisoning Attackscited by 116
- 2024Relying on the Unreliable: The Impact of Language Models' Reluctance to Express Uncertaintycited by 106
- 2021Be Careful about Poisoned Word Embeddings: Exploring the Vulnerability of the Embedding Layers in NLP Modelscited by 105
- 2019Real or Fake? Learning to Discriminate Machine from Human Generated Textcited by 99
- 2023Testing of Detection Tools for AI-Generated Textcited by 90
- 2023On the Possibilities of AI-Generated Text Detectioncited by 88
- 2023Watermarks in the Sand: Impossibility of Strong Watermarking for Generative Modelscited by 87
- 2023Use of LLMs for Illicit Purposes: Threats, Prevention Measures, and Vulnerabilitiescited by 82
- 2023Watermarking Text Generated by Black-Box Language Modelscited by 76
- 2023Are You Copying My Model? Protecting the Copyright of Large Language Models for EaaS via Backdoor Watermarkcited by 67
- 2023RCOT: Detecting and Rectifying Factual Inconsistency in Reasoning by Reversing Chain-of-Thoughtcited by 47
- 2023Large Language Models can be Guided to Evade AI-Generated Text Detectioncited by 44
- 2020Attacking Neural Text Detectorscited by 39
- 2023SentimentGPT: Exploiting GPT for Advanced Sentiment Analysis and its Departure from Current Machine Learningcited by 38
- 2022Validating Large Language Models with ReLMcited by 33
- 2023HowkGPT: Investigating the Detection of ChatGPT-generated University Student Homework through Context-Aware Perplexity Analysiscited by 30
- 2023Bot or Human? Detecting ChatGPT Imposters with A Single Questioncited by 26
- 2023FFT: Towards Harmlessness Evaluation and Analysis for LLMs with Factuality, Fairness, Toxicitycited by 25
- 2023Towards a Robust Detection of Language Model Generated Text: Is ChatGPT that Easy to Detect?cited by 23
- 2021BERT-CoQAC: BERT-based Conversational Question Answering in Contextcited by 13
- 2023Reliability Check: An Analysis of GPT-3's Response to Sensitive Topics and Prompt Wordingcited by 13
- 2021BERT-Based Sentiment Analysis: A Software Engineering Perspectivecited by 9
- 2023Investigating Answerability of LLMs for Long-Form Question Answeringcited by 9
- 2022Controlled Text Generation using T5 based Encoder-Decoder Soft Prompt Tuning and Analysis of the Utility of Generated Text in AIcited by 6
Built on by
Citing papers per year: 2024: 3; 2025: 10; 2026: 1.
14 papers.
Sort:
By area:
- 2025LLM Unlearning via Neural Activation Redirectioncited by 41
- 2025Rethinking Data Protection in the (Generative) Artificial Intelligence Eracited by 18
- 2025Feature-Level Insights into Artificial Text Detection with Sparse Autoencoderscited by 15
- 2025Detecting Stylistic Fingerprints of Large Language Modelscited by 11
- 2025Diversity Boosts AI-Generated Text Detectioncited by 6
- 2025FDLLM: A Dedicated Detector for Black-Box LLMs Fingerprintingcited by 4
- 2024HULLMI: Human vs LLM identification with explainabilitycited by 3
- 2025On the Detectability of LLM-Generated Text: What Exactly Is LLM-Generated Text?cited by 3
- 2025AI Generated Text Detection Using Instruction Fine-tuned Large Language and Transformer-Based Modelscited by 2
- 2025Self-reflecting Large Language Models: A Hegelian Dialectical Approachcited by 1
- 2025Position: It's Time to Act on the Risk of Efficient Personalized Text Generationcited by 1
- 2024ConvNLP: Image-based AI Text Detectioncited by 0
- 2026Inverse Turing Bench: Evaluating Language Models as Judges of Human vs. AI Dialogue20 Jun 2026
- 2025On the Detectability of LLM-Generated Text: What Exactly Is LLM-Generated Text?23 Oct 2025
- 2025Diversity Boosts AI-Generated Text Detection23 Sep 2025
- 2025AI Generated Text Detection Using Instruction Fine-tuned Large Language and Transformer-Based Models7 Jul 2025
- 2025Rethinking Data Protection in the (Generative) Artificial Intelligence Era3 Jul 2025
- 2025Feature-Level Insights into Artificial Text Detection with Sparse Autoencoders5 Mar 2025
- 2025Detecting Stylistic Fingerprints of Large Language Models3 Mar 2025
- 2025LLM Unlearning via Neural Activation Redirection11 Feb 2025
- 2025Position: It's Time to Act on the Risk of Efficient Personalized Text Generation10 Feb 2025
- 2025FDLLM: A Dedicated Detector for Black-Box LLMs Fingerprinting27 Jan 2025
- 2025Self-reflecting Large Language Models: A Hegelian Dialectical Approach24 Jan 2025
- 2024HULLMI: Human vs LLM identification with explainability7 Sep 2024
- 2025LLM Unlearning via Neural Activation Redirectioncited by 41
- 2025LLM Unlearning via Neural Activation Redirection11 Feb 2025
- 2025Rethinking Data Protection in the (Generative) Artificial Intelligence Eracited by 18
- 2025Detecting Stylistic Fingerprints of Large Language Modelscited by 11
- 2025Diversity Boosts AI-Generated Text Detectioncited by 6
- 2025FDLLM: A Dedicated Detector for Black-Box LLMs Fingerprintingcited by 4
- 2024HULLMI: Human vs LLM identification with explainabilitycited by 3
- 2025On the Detectability of LLM-Generated Text: What Exactly Is LLM-Generated Text?cited by 3
- 2025AI Generated Text Detection Using Instruction Fine-tuned Large Language and Transformer-Based Modelscited by 2
- 2025Self-reflecting Large Language Models: A Hegelian Dialectical Approachcited by 1
- 2025Position: It's Time to Act on the Risk of Efficient Personalized Text Generationcited by 1
- 2024ConvNLP: Image-based AI Text Detectioncited by 0
- 2024SMLT-MUGC: Small, Medium, and Large Texts -- Machine versus User-Generated Content Detection and Comparisoncited by 0
- 2026Inverse Turing Bench: Evaluating Language Models as Judges of Human vs. AI Dialoguecited by 0
- 2026Inverse Turing Bench: Evaluating Language Models as Judges of Human vs. AI Dialogue20 Jun 2026
- 2025On the Detectability of LLM-Generated Text: What Exactly Is LLM-Generated Text?23 Oct 2025
- 2025Diversity Boosts AI-Generated Text Detection23 Sep 2025
- 2025AI Generated Text Detection Using Instruction Fine-tuned Large Language and Transformer-Based Models7 Jul 2025
- 2025Rethinking Data Protection in the (Generative) Artificial Intelligence Era3 Jul 2025
- 2025Detecting Stylistic Fingerprints of Large Language Models3 Mar 2025
- 2025Position: It's Time to Act on the Risk of Efficient Personalized Text Generation10 Feb 2025
- 2025FDLLM: A Dedicated Detector for Black-Box LLMs Fingerprinting27 Jan 2025
- 2025Self-reflecting Large Language Models: A Hegelian Dialectical Approach24 Jan 2025
- 2024HULLMI: Human vs LLM identification with explainability7 Sep 2024
- 2024ConvNLP: Image-based AI Text Detection9 Jul 2024
- 2024SMLT-MUGC: Small, Medium, and Large Texts -- Machine versus User-Generated Content Detection and Comparison28 Jun 2024