mlsanityData to 7 Oct 2026

Fight Poison with Poison: Enhancing Robustness in Few-shot Machine-Generated Text Detection with Adversarial Training

arXiv 2605.02374 ↗First posted 4 May 2026cs.CR cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Machine-generated text (MGT) detection is critical for regulating online information ecosystems, yet existing detectors often underperform in few-shot settings and remain vulnerable to adversarial, humanizing attacks. To build accurate and robust detectors under limited supervision, we adopt a threat-modeling perspective and study detector vulnerabilities from an attacker's viewpoint under an output-only black-box setting. Motivated by this perspective, we propose RAG-GuidEd Attacker Strengthens ConTrastive Few-shot Detector (REACT), an adversarial training framework that improves both few-shot detection performance and robustness against attacks. REACT couples a humanization-oriented attacker with a target detector: the attacker leverages retrieval-augmented generation (RAG) to craft highly human-like adversarial examples to evade detection, while the detector learns from these adversaries with a contrastive objective to stabilize few-shot representation learning and enhance robustness. We alternately update the attacker and the detector to enable their co-evolution. Experiments on 4 datasets with 4 shot sizes and 3 random seeds show that REACT improves average detection F1 by 4.95 points over 8 state-of-the-art (SOTA) detectors and reduces the average attack success rate (ASR) under 4 strong attacks by 3.66 percentage points.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 26 of its 29 references that are in the map. First posted on arXiv 4 May 2026.

Builds on

26 of 29 references.

References · 26

  1. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  3. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  4. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
  5. 2015Improving Neural Machine Translation Models with Monolingual Datacited by 784
  6. 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 705
  7. 2019Is BERT Really Robust? A Strong Baseline for Natural Language Attack on Text Classification and Entailmentcited by 663
  8. 2020BERT-ATTACK: Adversarial Attack Against BERT Using BERTcited by 488
  9. 2023How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detectioncited by 472
  10. 2017Wild Patterns: Ten Years After the Rise of Adversarial Machine Learningcited by 411
  11. 2023Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defensecited by 401
  12. 2023Fast-DetectGPT: Efficient Zero-Shot Detection of Machine-Generated Text via Conditional Probability Curvaturecited by 278
14 more
  1. 2024Spotting LLMs With Binoculars: Zero-Shot Detection of Machine-Generated Textcited by 255
  2. 2023DetectLLM: Leveraging Log Rank Information for Zero-Shot Detection of Machine-Generated Textcited by 207
  3. 2023RADAR: Robust AI-Text Detection via Adversarial Learningcited by 187
  4. 2024RAID: A Shared Benchmark for Robust Evaluation of Machine-Generated Text Detectorscited by 157
  5. 2023OUTFOX: LLM-Generated Essay Detection Through In-Context Learning with Adversarially Generated Examplescited by 80
  6. 2024Training-free LLM-generated Text Detection by Mining Token Probability Sequencescited by 33
  7. 2022CoCo: Coherence-Enhanced Machine-Generated Text Detection Under Data Limitation With Contrastive Learningcited by 32
  8. 2024Humanizing Machine-Generated Content: Evading AI-Text Detection through Adversarial Attackcited by 27
  9. 2024Stumbling Blocks: Stress Testing the Robustness of Machine-Generated Text Detectors Under Attackscited by 25
  10. 2024Does DetectGPT Fully Utilize Perturbation? Bridging Selective Perturbation to Fine-tuned Contrastive Learning Detector would be Bettercited by 11
  11. 2025DNA-DetectLLM: Unveiling AI-Generated Text via a DNA-Inspired Mutation-Repair Paradigmcited by 10
  12. 2025Iron Sharpens Iron: Defending Against Attacks in Machine-Generated Text Detection with Adversarial Trainingcited by 9
  13. 2025DACTYL: Diverse Adversarial Corpus of Texts Yielded from Large Language Modelscited by 3
  14. 2025DAC-LoRA: Dynamic Adversarial Curriculum for Efficient and Robust Few-Shot Adaptationcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Safeguarding RAG Pipelines with GMTP: A Gradient-based Masked Token Probability Method for Poisoned Document Detection
  2. 2025RAGPart & RAGMask: Retrieval-Stage Defenses Against Corpus Poisoning in Retrieval-Augmented Generation
  3. 2026When Context Bites: Detecting RAG Poisoning via Document-Level Attention Collapse
  4. 2026Semantic Chameleon: Corpus-Dependent Poisoning Attacks and Defenses in RAG Systems
  5. 2026Confundo: Learning to Generate Robust Poison for Practical RAG Systems
  6. 2025Uncovering Competing Poisoning Attacks in Retrieval-Augmented Generation
  7. 2024Towards More Robust Retrieval-Augmented Generation: Evaluating RAG Under Adversarial Poisoning Attacks
  8. 2025Securing AI Agents Against Prompt Injection Attacks