C-HAT-Bench: Benchmarking Chinese AI-Text Detection Beyond Fully Generated Text
Not on the map. Why?
Abstract (arXiv)
Large Language Models (LLMs) increasingly participate in writing by modifying or extending human drafts, causing machine involvement to vary in both form and extent. Yet most Machine-Generated Text (MGT) detectors are evaluated only on fully human-written versus fully AI-generated text. Because human--AI collaboration can weaken or redistribute cues associated with machine generation, strong performance under this binary setting may overstate detector reliability. This mismatch remains underexplored in Chinese: detection cues are shaped by tokenization and language-specific text distributions, yet controlled resources spanning production settings, domains, and generators remain limited. To fill this gap, we present a Chinese Human-AI Collaborative Text Detection Benchmark (C-HAT-Bench), a unified benchmark that links 5,000 human-written source texts from five domains to more than 240,000 variants produced using six generative models under Prefix-Conditioned Continuation as a reference setting and three collaborative production modes. We evaluate 21 detectors through four protocols spanning zero-shot and pretrained supervised document-level detection, boundary localization, and cross-condition generalization. Relative to Prefix-Conditioned Continuation, mean AUROC across document-level detectors is 12.0% lower on the collaborative production modes, with the largest detector-specific relative decrease reaching 44.4%. Transfer across collaborative production modes is also asymmetric, indicating that performance in a given production setting is not a reliable predictor of performance in other production settings.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 41 of its 54 references that are in the map. First posted on arXiv 26 Sep 2026.
Builds on
41 of 54 references.
References · 41
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020Longformer: The Long-Document Transformercited by 3,413
- 2023A Survey of Large Language Modelscited by 2,576
- 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 1,040
- 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 726
- 2023A Watermark for Large Language Modelscited by 725
- 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 668
- 2019Release Strategies and the Social Impacts of Language Modelscited by 513
- 2019GLTR: Statistical Detection and Visualization of Generated Textcited by 496
- 2023How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detectioncited by 481
- 2023Fast-DetectGPT: Efficient Zero-Shot Detection of Machine-Generated Text via Conditional Probability Curvaturecited by 287
- 2024Spotting LLMs With Binoculars: Zero-Shot Detection of Machine-Generated Textcited by 263
29 more
- 2022CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilitiescited by 249
- 2023DetectLLM: Leveraging Log Rank Information for Zero-Shot Detection of Machine-Generated Textcited by 210
- 2023RADAR: Robust AI-Text Detection via Adversarial Learningcited by 190
- 2024RAID: A Shared Benchmark for Robust Evaluation of Machine-Generated Text Detectorscited by 163
- 2023MAGE: Machine-generated Text Detection in the Wildcited by 132
- 2023M4: Multi-generator, Multi-domain, and Multi-lingual Black-Box Machine-Generated Text Detectioncited by 121
- 2021TURINGBENCH: A Benchmark Environment for Turing Test in the Age of Neural Text Generationcited by 120
- 2023A Survey on LLM-Generated Text Detection: Necessity, Methods, and Future Directionscited by 105
- 2023MGTBench: Benchmarking Machine-Generated Text Detectioncited by 93
- 2023Ghostbuster: Detecting Text Ghostwritten by Large Language Modelscited by 91
- 2023Multiscale Positive-Unlabeled Detection of AI-Generated Textscited by 61
- 2023SeqXGPT: Sentence-Level AI-Generated Text Detectioncited by 56
- 2024LLM-as-a-Coauthor: Can Mixed Human-Written and Machine-Generated Text Be Detected?cited by 49
- 2024M4GT-Bench: Evaluation Benchmark for Black-Box Machine-Generated Text Detectioncited by 43
- 2023LeCaRDv2: A Large-Scale Chinese Legal Case Retrieval Datasetcited by 38
- 2024DetectRL: Benchmarking LLM-Generated Text Detection in Real-World Scenarioscited by 38
- 2023ConDA: Contrastive Domain Adaptation for AI-generated Text Detectioncited by 37
- 2024Training-free LLM-generated Text Detection by Mining Token Probability Sequencescited by 35
- 2024Imitate Before Detect: Aligning Machine Stylistic Preference for Machine-Revised Text Detectioncited by 23
- 2024Detecting AI-Generated Sentences in Human-AI Collaborative Hybrid Texts: Challenges, Strategies, and Insightscited by 21
- 2024Robust AI-Generated Text Detection by Restricted Embeddingscited by 18
- 2024Learning to Rewrite: Generalized LLM-Generated Text Detectioncited by 13
- 2024ReMoDetect: Reward Models Recognize Aligned LLM's Generationscited by 11
- 2025SpecDetect: Simple, Fast, and Training-Free Detection of LLM-Generated Text via Spectral Analysiscited by 6
- 2025DAMASHA: Detecting AI in Mixed Adversarial Texts via Segmentation with Human-interpretable Attributioncited by 5
- 2026Segmenting Human-LLM Co-authored Text via Change Point Detectioncited by 5
- 2024GigaCheck: Detecting LLM-generated Content via Object-Centric Span Localizationcited by 3
- 2026C-ReD: A Comprehensive Chinese Benchmark for AI-Generated Text Detection Derived from Real-World Promptscited by 2
- 2026TSM-Bench: Detecting LLM-Generated Text in Real-World Wikipedia Editing Practicescited by 2
Built on by
Not cited yet.