mlsanityData to 7 Oct 2026

Amplifying, Not Learning: The Price of Out-of-Distribution Generalization in AI-Text Detection

arXiv 2605.21653 ↗First posted 20 May 2026cs.LG cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

AI-text detectors gate decisions in education, hiring, and publishing, yet they flag the most fluent, formal human writing as machine-generated: they rate the median formal-native human essay as 99.5% likely AI while clearing genuine high-temperature AI at 10.5%. Deployed detectors share it (chatgpt-detector-roberta flags 56% of formal essays at a 1% false-alarm rate). This is not a calibration bug but the signature of one mechanism: a fine-tuned detector does not learn an AI-versus-human boundary, it amplifies an inherited typicality axis (predictability under a language model) that pre-exists fine-tuning, rescaling it rather than constructing one. Decomposing the detector into this inherited reading and a fine-tuned residual, the inherited part carries the bulk of cross-generator transfer and produces the over-flagging of formal humans, while the residual is generator-specific and does not transfer; a frozen-representation probe fit on ~25 labels per class matches the fully fine-tuned detector on unseen generators (cross-generator AUROC 0.893 vs 0.831). This yields a no-go: because the axis that transfers is the axis that over-flags, no training objective, threshold, concept-erasure, or ensemble we test removes the harm while preserving cross-generator detection, across three architectures, fine-tuned decoders, and zero-shot perplexity detectors. A closed-form, training-free operator relocates and diagnoses the bias (reviving a dead deployed detector, true-positive rate 0 to 0.904 at a 1% false-alarm rate) but, consistent with the no-go, is AUROC-neutral on cross-generator detection: it moves the bias, it cannot erase it. The mechanism is not specific to English prose: the over-flag and the decomposition replicate in Chinese and in code. Detector unfairness is a predictable, structural property of the detection paradigm, the price of out-of-distribution generalization.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 27 references that are in the map. First posted on arXiv 20 May 2026.

Builds on

16 of 27 references.

References · 16

  1. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  2. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,157
  3. 2020Shortcut Learning in Deep Neural Networkscited by 1,928
  4. 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 705
  5. 2016Fair prediction with disparate impact: A study of bias in recidivism prediction instrumentscited by 671
  6. 2016Inherent Trade-Offs in the Fair Determination of Risk Scorescited by 582
  7. 2019Release Strategies and the Social Impacts of Language Modelscited by 505
  8. 2019GLTR: Statistical Detection and Visualization of Generated Textcited by 490
  9. 2023How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detectioncited by 472
  10. 2020Null It Out: Guarding Protected Attributes by Iterative Nullspace Projectioncited by 442
  11. 2023Fast-DetectGPT: Efficient Zero-Shot Detection of Machine-Generated Text via Conditional Probability Curvaturecited by 278
  12. 2024Spotting LLMs With Binoculars: Zero-Shot Detection of Machine-Generated Textcited by 255
4 more
  1. 2023LEACE: Perfect linear concept erasure in closed formcited by 254
  2. 2023RADAR: Robust AI-Text Detection via Adversarial Learningcited by 187
  3. 2024RAID: A Shared Benchmark for Robust Evaluation of Machine-Generated Text Detectorscited by 157
  4. 2024Robust AI-Generated Text Detection by Restricted Embeddingscited by 18

Built on by

Not cited yet.