Amplifying, Not Learning: The Price of Out-of-Distribution Generalization in AI-Text Detection
Not on the map. Why?
Abstract (arXiv)
AI-text detectors gate decisions in education, hiring, and publishing, yet they flag the most fluent, formal human writing as machine-generated: they rate the median formal-native human essay as 99.5% likely AI while clearing genuine high-temperature AI at 10.5%. Deployed detectors share it (chatgpt-detector-roberta flags 56% of formal essays at a 1% false-alarm rate). This is not a calibration bug but the signature of one mechanism: a fine-tuned detector does not learn an AI-versus-human boundary, it amplifies an inherited typicality axis (predictability under a language model) that pre-exists fine-tuning, rescaling it rather than constructing one. Decomposing the detector into this inherited reading and a fine-tuned residual, the inherited part carries the bulk of cross-generator transfer and produces the over-flagging of formal humans, while the residual is generator-specific and does not transfer; a frozen-representation probe fit on ~25 labels per class matches the fully fine-tuned detector on unseen generators (cross-generator AUROC 0.893 vs 0.831). This yields a no-go: because the axis that transfers is the axis that over-flags, no training objective, threshold, concept-erasure, or ensemble we test removes the harm while preserving cross-generator detection, across three architectures, fine-tuned decoders, and zero-shot perplexity detectors. A closed-form, training-free operator relocates and diagnoses the bias (reviving a dead deployed detector, true-positive rate 0 to 0.904 at a 1% false-alarm rate) but, consistent with the no-go, is AUROC-neutral on cross-generator detection: it moves the bias, it cannot erase it. The mechanism is not specific to English prose: the over-flag and the decomposition replicate in Chinese and in code. Detector unfairness is a predictable, structural property of the detection paradigm, the price of out-of-distribution generalization.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 27 references that are in the map. First posted on arXiv 20 May 2026.
Builds on
16 of 27 references.
References · 16
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,157
- 2020Shortcut Learning in Deep Neural Networkscited by 1,928
- 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 705
- 2016Fair prediction with disparate impact: A study of bias in recidivism prediction instrumentscited by 671
- 2016Inherent Trade-Offs in the Fair Determination of Risk Scorescited by 582
- 2019Release Strategies and the Social Impacts of Language Modelscited by 505
- 2019GLTR: Statistical Detection and Visualization of Generated Textcited by 490
- 2023How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detectioncited by 472
- 2020Null It Out: Guarding Protected Attributes by Iterative Nullspace Projectioncited by 442
- 2023Fast-DetectGPT: Efficient Zero-Shot Detection of Machine-Generated Text via Conditional Probability Curvaturecited by 278
- 2024Spotting LLMs With Binoculars: Zero-Shot Detection of Machine-Generated Textcited by 255
4 more
- 2023LEACE: Perfect linear concept erasure in closed formcited by 254
- 2023RADAR: Robust AI-Text Detection via Adversarial Learningcited by 187
- 2024RAID: A Shared Benchmark for Robust Evaluation of Machine-Generated Text Detectorscited by 157
- 2024Robust AI-Generated Text Detection by Restricted Embeddingscited by 18
Built on by
Not cited yet.