mlsanityData to 14 Oct 2026

C-HAT-Bench: Benchmarking Chinese AI-Text Detection Beyond Fully Generated Text

arXiv 2609.32770 ↗First posted 26 Sep 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) increasingly participate in writing by modifying or extending human drafts, causing machine involvement to vary in both form and extent. Yet most Machine-Generated Text (MGT) detectors are evaluated only on fully human-written versus fully AI-generated text. Because human--AI collaboration can weaken or redistribute cues associated with machine generation, strong performance under this binary setting may overstate detector reliability. This mismatch remains underexplored in Chinese: detection cues are shaped by tokenization and language-specific text distributions, yet controlled resources spanning production settings, domains, and generators remain limited. To fill this gap, we present a Chinese Human-AI Collaborative Text Detection Benchmark (C-HAT-Bench), a unified benchmark that links 5,000 human-written source texts from five domains to more than 240,000 variants produced using six generative models under Prefix-Conditioned Continuation as a reference setting and three collaborative production modes. We evaluate 21 detectors through four protocols spanning zero-shot and pretrained supervised document-level detection, boundary localization, and cross-condition generalization. Relative to Prefix-Conditioned Continuation, mean AUROC across document-level detectors is 12.0% lower on the collaborative production modes, with the largest detector-specific relative decrease reaching 44.4%. Transfer across collaborative production modes is also asymmetric, indicating that performance in a given production setting is not a reliable predictor of performance in other production settings.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 41 of its 54 references that are in the map. First posted on arXiv 26 Sep 2026.

Builds on

41 of 54 references.

References · 41

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2020Longformer: The Long-Document Transformercited by 3,413
  3. 2023A Survey of Large Language Modelscited by 2,576
  4. 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 1,040
  5. 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 726
  6. 2023A Watermark for Large Language Modelscited by 725
  7. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 668
  8. 2019Release Strategies and the Social Impacts of Language Modelscited by 513
  9. 2019GLTR: Statistical Detection and Visualization of Generated Textcited by 496
  10. 2023How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detectioncited by 481
  11. 2023Fast-DetectGPT: Efficient Zero-Shot Detection of Machine-Generated Text via Conditional Probability Curvaturecited by 287
  12. 2024Spotting LLMs With Binoculars: Zero-Shot Detection of Machine-Generated Textcited by 263
29 more
  1. 2022CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilitiescited by 249
  2. 2023DetectLLM: Leveraging Log Rank Information for Zero-Shot Detection of Machine-Generated Textcited by 210
  3. 2023RADAR: Robust AI-Text Detection via Adversarial Learningcited by 190
  4. 2024RAID: A Shared Benchmark for Robust Evaluation of Machine-Generated Text Detectorscited by 163
  5. 2023MAGE: Machine-generated Text Detection in the Wildcited by 132
  6. 2023M4: Multi-generator, Multi-domain, and Multi-lingual Black-Box Machine-Generated Text Detectioncited by 121
  7. 2021TURINGBENCH: A Benchmark Environment for Turing Test in the Age of Neural Text Generationcited by 120
  8. 2023A Survey on LLM-Generated Text Detection: Necessity, Methods, and Future Directionscited by 105
  9. 2023MGTBench: Benchmarking Machine-Generated Text Detectioncited by 93
  10. 2023Ghostbuster: Detecting Text Ghostwritten by Large Language Modelscited by 91
  11. 2023Multiscale Positive-Unlabeled Detection of AI-Generated Textscited by 61
  12. 2023SeqXGPT: Sentence-Level AI-Generated Text Detectioncited by 56
  13. 2024LLM-as-a-Coauthor: Can Mixed Human-Written and Machine-Generated Text Be Detected?cited by 49
  14. 2024M4GT-Bench: Evaluation Benchmark for Black-Box Machine-Generated Text Detectioncited by 43
  15. 2023LeCaRDv2: A Large-Scale Chinese Legal Case Retrieval Datasetcited by 38
  16. 2024DetectRL: Benchmarking LLM-Generated Text Detection in Real-World Scenarioscited by 38
  17. 2023ConDA: Contrastive Domain Adaptation for AI-generated Text Detectioncited by 37
  18. 2024Training-free LLM-generated Text Detection by Mining Token Probability Sequencescited by 35
  19. 2024Imitate Before Detect: Aligning Machine Stylistic Preference for Machine-Revised Text Detectioncited by 23
  20. 2024Detecting AI-Generated Sentences in Human-AI Collaborative Hybrid Texts: Challenges, Strategies, and Insightscited by 21
  21. 2024Robust AI-Generated Text Detection by Restricted Embeddingscited by 18
  22. 2024Learning to Rewrite: Generalized LLM-Generated Text Detectioncited by 13
  23. 2024ReMoDetect: Reward Models Recognize Aligned LLM's Generationscited by 11
  24. 2025SpecDetect: Simple, Fast, and Training-Free Detection of LLM-Generated Text via Spectral Analysiscited by 6
  25. 2025DAMASHA: Detecting AI in Mixed Adversarial Texts via Segmentation with Human-interpretable Attributioncited by 5
  26. 2026Segmenting Human-LLM Co-authored Text via Change Point Detectioncited by 5
  27. 2024GigaCheck: Detecting LLM-generated Content via Object-Centric Span Localizationcited by 3
  28. 2026C-ReD: A Comprehensive Chinese Benchmark for AI-Generated Text Detection Derived from Real-World Promptscited by 2
  29. 2026TSM-Bench: Detecting LLM-Generated Text in Real-World Wikipedia Editing Practicescited by 2

Built on by

Not cited yet.