DeBERTa-ConPara: Attack-Aware and Deployment-Realistic Detection of AI-Generated Text
Not on the map. Why?
Abstract (arXiv)
Robust detection of AI-generated text under deployment conditions is challenging: distribution shifts across domains and generators, adversarial perturbations of the input surface, and the absence of target-domain labels for threshold calibration all degrade detectors that perform well in-domain. We present DeBERTa-ConPara, a deployment-oriented detector combining attack-aware Unicode preprocessing with a contextual transformer encoder trained over HC3 Plus, M4, MAGE and RAID. Our central finding is that preprocessing acts in opposite directions depending on where it is applied: normalising the training corpus deduplicates it, collapsing 35.4% of RAID rows into copies of their clean siblings and deleting the adversarial supervision, whereas normalising at inference is an effective defence. A factorial varying the two placements independently identifies raw training with normalised inference as the best configuration, reaching 99.61% AUROC, 99.01% TPR@5% FPR and 96.57% TPR@1% FPR on the official RAID hidden test, alongside 93.14% average balanced accuracy across HC3 Plus and MAGE under a fixed threshold. The gain is confined to two of twelve attack classes: homoglyph and zero-width-space insertion rise from 11.05% and 1.12% to 96.98%. The same signature reproduces in a zero-shot detector of different architecture, showing the effect belongs to the attacks rather than to our model. We additionally report two negative results: semantic-invariance augmentation through paraphrasing and supervised contrastive learning (ConPara) does not improve the best configuration, and the handcrafted feature-fusion branch is inert in distribution and harmful outside it.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 38 references that are in the map. First posted on arXiv 1 Oct 2026.
Builds on
20 of 38 references.
References · 20
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2020Supervised Contrastive Learningcited by 2,803
- 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,219
- 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 705
- 2019GLTR: Statistical Detection and Visualization of Generated Textcited by 490
- 2023How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detectioncited by 472
- 2023Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defensecited by 401
- 2023Fast-DetectGPT: Efficient Zero-Shot Detection of Machine-Generated Text via Conditional Probability Curvaturecited by 278
- 2024Spotting LLMs With Binoculars: Zero-Shot Detection of Machine-Generated Textcited by 255
- 2023Generative Language Models and Automated Influence Operations: Emerging Threats and Potential Mitigationscited by 157
- 2024RAID: A Shared Benchmark for Robust Evaluation of Machine-Generated Text Detectorscited by 157
8 more
- 2023MAGE: Machine-generated Text Detection in the Wildcited by 130
- 2023Ghostbuster: Detecting Text Ghostwritten by Large Language Modelscited by 90
- 2023HC3 Plus: A Semantic-Invariant Human ChatGPT Comparison Corpuscited by 33
- 2025RepreGuard: Detecting LLM-Generated Text by Revealing Hidden Representation Patternscited by 24
- 2025MGT-Prism: Enhancing Domain Generalization for Machine-Generated Text Detection via Spectral Alignmentcited by 4
- 2026Feature-Augmented Transformers for Robust AI-Text Detection Across Domains and Generatorscited by 2
- 2024Discourse Features Enhance Detection of Document-Level Machine-Generated Contentcited by 1
- 2025Black-Box Detection of LLM-Generated Text Using Generalized Jensen-Shannon Divergencecited by 1
Built on by
Not cited yet.