Attacking Neural Text Detectors
Not on the map. Why?
Abstract (arXiv)
Machine learning based language models have recently made significant progress, which introduces a danger to spread misinformation. To combat this potential danger, several methods have been proposed for detecting text written by these language models. This paper presents two classes of black-box attacks on these detectors, one which randomly replaces characters with homoglyphs, and the other a simple scheme to purposefully misspell words. The homoglyph and misspelling attacks decrease a popular neural text detector's recall on neural text from 97.44% to 0.26% and 22.68%, respectively. Results also indicate that the attacks are transferable to other neural text detectors.
Key facts. Cited by 37 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 Feb 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2022: 7; 2023: 11; 2024: 13; 2025: 1; 2026: 5.
37 papers.
Sort:
By area:
- 2023A Watermark for Large Language Modelscited by 667
- 2023Can AI-Generated Text be Reliably Detected?cited by 372
- 2023Provable Robust Watermarking for AI-Generated Textcited by 259
- 2024Spotting LLMs With Binoculars: Zero-Shot Detection of Machine-Generated Textcited by 255
- 2023On the Reliability of Watermarks for Large Language Modelscited by 170
- 2024Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer Reviewscited by 160
- 2024RAID: A Shared Benchmark for Robust Evaluation of Machine-Generated Text Detectorscited by 157
- 2024Mapping the Increasing Use of LLMs in Scientific Paperscited by 112
- 2022Do Language Models Plagiarize?cited by 72
- 2023Watermarking Text Generated by Black-Box Language Modelscited by 68
- 2022Attribution and Obfuscation of Neural Text Authorship: A Data Mining Perspectivecited by 40
- 2024Securing Large Language Models: Threats, Vulnerabilities and Responsible Practicescited by 36
25 more
- 2024Token-Specific Watermarking with Enhanced Detectability and Semantic Coherence for Large Language Modelscited by 30
- 2023Towards Possibilities & Impossibilities of AI-generated Text Detection: A Surveycited by 28
- 2022Adversarial Robustness of Neural-Statistical Features in Detection of Generative Transformerscited by 25
- 2023WatME: Towards Lossless Watermarking Through Lexical Redundancycited by 22
- 2022A Benchmark Corpus for the Detection of Automatically Generated Text in Academic Publicationscited by 18
- 2024Permute-and-Flip: An optimally stable and watermarkable decoder for LLMscited by 17
- 2024Decoding the AI Pen: Techniques and Challenges in Detecting AI-Generated Textcited by 14
- 2022SynSciPass: detecting appropriate uses of scientific text generationcited by 10
- 2023Mutation-Based Adversarial Attacks on Neural Text Detectorscited by 9
- 2023Stochastic Parrots Looking for Stochastic Parrots: LLMs are Easy to Fine-Tune and Hard to Detect with other LLMscited by 8
- 2024'Quis custodiet ipsos custodes?' Who will watch the watchmen? On Detecting AI-generated peer-reviewscited by 8
- 2023Dual Use Concerns of Generative AI and Large Language Modelscited by 6
- 2024ToBlend: Token-Level Blending With an Ensemble of LLMs to Attack AI-Generated Text Detectioncited by 6
- 2024Understanding the Effects of Human-written Paraphrases in LLM-generated Text Detectioncited by 6
- 2025Diversity Boosts AI-Generated Text Detectioncited by 6
- 2022Synthetic Text Detection: Systemic Literature Reviewcited by 2
- 2024Don't be a Fool: Pooling Strategies in Offensive Language Detection from User-Intended Adversarial Attackscited by 2
- 2026Detecting the Machine: A Comprehensive Benchmark of AI-Generated Text Detectors Across Architectures, Domains, and Adversarial Conditionscited by 2
- 2022A Mutation-based Text Generation for Adversarial Machine Learning Applicationscited by 1
- 2024Benchmarking of LLM Detection: Comparing Two Competing Approachescited by 1
- 2026Block-wise Codeword Embedding for Reliable Multi-bit Text Watermarkingcited by 1
- 2026MELD: Multi-Task Equilibrated Learning Detector for AI-Generated Textcited by 1
- 2023Studying the impacts of pre-training using ChatGPT-generated text on downstream taskscited by 0
- 2026Homoglyph-based Adversarial Perturbation of Introductory Computer Science Theory Problemscited by 0
- 2026CORE-BREW: LLR-Based Soft Decoding for Robust Multi-Bit LLM Watermarkingcited by 0
- 2026CORE-BREW: LLR-Based Soft Decoding for Robust Multi-Bit LLM Watermarking23 Jun 2026
- 2026MELD: Multi-Task Equilibrated Learning Detector for AI-Generated Text7 May 2026
- 2026Block-wise Codeword Embedding for Reliable Multi-bit Text Watermarking1 May 2026
- 2026Homoglyph-based Adversarial Perturbation of Introductory Computer Science Theory Problems13 Apr 2026
- 2026Detecting the Machine: A Comprehensive Benchmark of AI-Generated Text Detectors Across Architectures, Domains, and Adversarial Conditions18 Mar 2026
- 2025Diversity Boosts AI-Generated Text Detection23 Sep 2025
- 2024Understanding the Effects of Human-written Paraphrases in LLM-generated Text Detection6 Nov 2024
- 2024'Quis custodiet ipsos custodes?' Who will watch the watchmen? On Detecting AI-generated peer-reviews13 Oct 2024
- 2024Benchmarking of LLM Detection: Comparing Two Competing Approaches17 Jun 2024
- 2024RAID: A Shared Benchmark for Robust Evaluation of Machine-Generated Text Detectors13 May 2024
- 2024Mapping the Increasing Use of LLMs in Scientific Papers1 Apr 2024
- 2024Don't be a Fool: Pooling Strategies in Offensive Language Detection from User-Intended Adversarial Attacks20 Mar 2024
25 more
- 2024Securing Large Language Models: Threats, Vulnerabilities and Responsible Practices19 Mar 2024
- 2024Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer Reviews11 Mar 2024
- 2024Decoding the AI Pen: Techniques and Challenges in Detecting AI-Generated Text9 Mar 2024
- 2024Token-Specific Watermarking with Enhanced Detectability and Semantic Coherence for Large Language Models28 Feb 2024
- 2024ToBlend: Token-Level Blending With an Ensemble of LLMs to Attack AI-Generated Text Detection17 Feb 2024
- 2024Permute-and-Flip: An optimally stable and watermarkable decoder for LLMs8 Feb 2024
- 2024Spotting LLMs With Binoculars: Zero-Shot Detection of Machine-Generated Text22 Jan 2024
- 2023WatME: Towards Lossless Watermarking Through Lexical Redundancy16 Nov 2023
- 2023Towards Possibilities & Impossibilities of AI-generated Text Detection: A Survey23 Oct 2023
- 2023Studying the impacts of pre-training using ChatGPT-generated text on downstream tasks2 Sep 2023
- 2023Provable Robust Watermarking for AI-Generated Text30 Jun 2023
- 2023On the Reliability of Watermarks for Large Language Models7 Jun 2023
- 2023Watermarking Text Generated by Black-Box Language Models14 May 2023
- 2023Dual Use Concerns of Generative AI and Large Language Models13 May 2023
- 2023Stochastic Parrots Looking for Stochastic Parrots: LLMs are Easy to Fine-Tune and Hard to Detect with other LLMs18 Apr 2023
- 2023Can AI-Generated Text be Reliably Detected?17 Mar 2023
- 2023Mutation-Based Adversarial Attacks on Neural Text Detectors11 Feb 2023
- 2023A Watermark for Large Language Models24 Jan 2023
- 2022A Mutation-based Text Generation for Adversarial Machine Learning Applications21 Dec 2022
- 2022Attribution and Obfuscation of Neural Text Authorship: A Data Mining Perspective19 Oct 2022
- 2022Synthetic Text Detection: Systemic Literature Review1 Oct 2022
- 2022SynSciPass: detecting appropriate uses of scientific text generation7 Sep 2022
- 2022Do Language Models Plagiarize?15 Mar 2022
- 2022Adversarial Robustness of Neural-Statistical Features in Detection of Generative Transformers2 Mar 2022
- 2022A Benchmark Corpus for the Detection of Automatically Generated Text in Academic Publications4 Feb 2022
- 2023A Watermark for Large Language Modelscited by 667
- 2023Can AI-Generated Text be Reliably Detected?cited by 372
- 2023Provable Robust Watermarking for AI-Generated Textcited by 259
- 2023On the Reliability of Watermarks for Large Language Modelscited by 170
- 2023Watermarking Text Generated by Black-Box Language Modelscited by 68
- 2024Token-Specific Watermarking with Enhanced Detectability and Semantic Coherence for Large Language Modelscited by 30
- 2024Permute-and-Flip: An optimally stable and watermarkable decoder for LLMscited by 17
- 2024Understanding the Effects of Human-written Paraphrases in LLM-generated Text Detectioncited by 6
- 2026Block-wise Codeword Embedding for Reliable Multi-bit Text Watermarkingcited by 1
- 2026CORE-BREW: LLR-Based Soft Decoding for Robust Multi-Bit LLM Watermarkingcited by 0
- 2026CORE-BREW: LLR-Based Soft Decoding for Robust Multi-Bit LLM Watermarking23 Jun 2026
- 2026Block-wise Codeword Embedding for Reliable Multi-bit Text Watermarking1 May 2026
- 2024Understanding the Effects of Human-written Paraphrases in LLM-generated Text Detection6 Nov 2024
- 2024Token-Specific Watermarking with Enhanced Detectability and Semantic Coherence for Large Language Models28 Feb 2024
- 2024Permute-and-Flip: An optimally stable and watermarkable decoder for LLMs8 Feb 2024
- 2023Provable Robust Watermarking for AI-Generated Text30 Jun 2023
- 2023On the Reliability of Watermarks for Large Language Models7 Jun 2023
- 2023Watermarking Text Generated by Black-Box Language Models14 May 2023
- 2023Can AI-Generated Text be Reliably Detected?17 Mar 2023
- 2023A Watermark for Large Language Models24 Jan 2023
- 2024Spotting LLMs With Binoculars: Zero-Shot Detection of Machine-Generated Textcited by 255
- 2024Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer Reviewscited by 160
- 2024RAID: A Shared Benchmark for Robust Evaluation of Machine-Generated Text Detectorscited by 157
- 2024Mapping the Increasing Use of LLMs in Scientific Paperscited by 112
- 2022Do Language Models Plagiarize?cited by 72
- 2022Attribution and Obfuscation of Neural Text Authorship: A Data Mining Perspectivecited by 40
- 2024Securing Large Language Models: Threats, Vulnerabilities and Responsible Practicescited by 36
- 2023Towards Possibilities & Impossibilities of AI-generated Text Detection: A Surveycited by 28
- 2022Adversarial Robustness of Neural-Statistical Features in Detection of Generative Transformerscited by 25
- 2023WatME: Towards Lossless Watermarking Through Lexical Redundancycited by 22
- 2022A Benchmark Corpus for the Detection of Automatically Generated Text in Academic Publicationscited by 18
- 2024Decoding the AI Pen: Techniques and Challenges in Detecting AI-Generated Textcited by 14
12 most cited of 27 All 27 (JSON)
- 2026MELD: Multi-Task Equilibrated Learning Detector for AI-Generated Text7 May 2026
- 2026Homoglyph-based Adversarial Perturbation of Introductory Computer Science Theory Problems13 Apr 2026
- 2026Detecting the Machine: A Comprehensive Benchmark of AI-Generated Text Detectors Across Architectures, Domains, and Adversarial Conditions18 Mar 2026
- 2025Diversity Boosts AI-Generated Text Detection23 Sep 2025
- 2024'Quis custodiet ipsos custodes?' Who will watch the watchmen? On Detecting AI-generated peer-reviews13 Oct 2024
- 2024Benchmarking of LLM Detection: Comparing Two Competing Approaches17 Jun 2024
- 2024RAID: A Shared Benchmark for Robust Evaluation of Machine-Generated Text Detectors13 May 2024
- 2024Mapping the Increasing Use of LLMs in Scientific Papers1 Apr 2024
- 2024Don't be a Fool: Pooling Strategies in Offensive Language Detection from User-Intended Adversarial Attacks20 Mar 2024
- 2024Securing Large Language Models: Threats, Vulnerabilities and Responsible Practices19 Mar 2024
- 2024Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer Reviews11 Mar 2024
- 2024Decoding the AI Pen: Techniques and Challenges in Detecting AI-Generated Text9 Mar 2024
12 newest of 27 All 27 (JSON)