LLMTrace: A Corpus for Classification and Fine-Grained Localization of AI-Written Text
Not on the map. Why?
Abstract (arXiv)
The widespread use of human-like text from Large Language Models (LLMs) necessitates the development of robust detection systems. However, progress is limited by a critical lack of suitable training data; existing datasets are often generated with outdated models, are predominantly in English, and fail to address the increasingly common scenario of mixed human-AI authorship. Crucially, while some datasets address mixed authorship, none provide the character-level annotations required for the precise localization of AI-generated segments within a text. To address these gaps, we introduce LLMTrace, a new large-scale, bilingual (English and Russian) corpus for AI-generated text detection. Constructed using a diverse range of modern proprietary and open-source LLMs, our dataset is designed to support two key tasks: traditional full-text binary classification (human vs. AI) and AI-generated interval detection, facilitated by character-level annotations. We believe LLMTrace will serve as a vital resource for training and evaluating the next generation of more nuanced and practical AI detection models. The project page is available at https://sweetdream779.github.io/LLMTrace-info/.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 46 of its 55 references that are in the map. First posted on arXiv 25 Sep 2025.
Builds on
46 of 55 references.
References · 46
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2025Qwen3 Technical Reportcited by 8,820
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2024GPT-4o System Cardcited by 4,588
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2020Longformer: The Long-Document Transformercited by 3,413
- 2023Mistral 7Bcited by 3,164
- 2015Character-level Convolutional Networks for Text Classificationcited by 2,330
- 2018Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarizationcited by 1,317
- 2018Hierarchical Neural Story Generationcited by 1,193
- 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 726
- 2022DN-DETR: Accelerate DETR Training by Introducing Query DeNoisingcited by 488
34 more
- 2023How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detectioncited by 481
- 2021MAUVE: Measuring the Gap Between Neural Text and Human Text using Divergence Frontierscited by 470
- 2016A Corpus and Evaluation Framework for Deeper Understanding of Commonsense Storiescited by 417
- 2023Fast-DetectGPT: Efficient Zero-Shot Detection of Machine-Generated Text via Conditional Probability Curvaturecited by 287
- 2024Spotting LLMs With Binoculars: Zero-Shot Detection of Machine-Generated Textcited by 263
- 2022CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilitiescited by 249
- 2024RAID: A Shared Benchmark for Robust Evaluation of Machine-Generated Text Detectorscited by 163
- 2023MAGE: Machine-generated Text Detection in the Wildcited by 132
- 2023Intrinsic Dimension Estimation for Robust Detection of AI-Generated Textscited by 112
- 2016Winning Arguments: Interaction Dynamics and Persuasion Strategies in Good-faith Online Discussionscited by 110
- 2022Human heuristics for AI-generated language are flawedcited by 105
- 2023MGTBench: Benchmarking Machine-Generated Text Detectioncited by 93
- 2023Ghostbuster: Detecting Text Ghostwritten by Large Language Modelscited by 91
- 2022Real or Fake Text?: Investigating Human Ability to Detect Boundaries Between Human-Written and Machine-Generated Textcited by 63
- 2024LLM-as-a-Coauthor: Can Mixed Human-Written and Machine-Generated Text Be Detected?cited by 49
- 2025mmBERT: A Modern Multilingual Encoder with Annealed Language Learningcited by 45
- 2024M4GT-Bench: Evaluation Benchmark for Black-Box Machine-Generated Text Detectioncited by 43
- 2024DetectRL: Benchmarking LLM-Generated Text Detection in Real-World Scenarioscited by 38
- 2024SemEval-2024 Task 8: Multidomain, Multimodel and Multilingual Machine-Generated Text Detectioncited by 30
- 2022Findings of the The RuATD Shared Task 2022 on Artificial Text Detection in Russiancited by 29
- 2023A Family of Pretrained Transformer Language Models for Russiancited by 27
- 2024Beemo: Benchmark of Expert-edited Machine-generated Outputscited by 27
- 2021SciXGen: A Scientific Paper Dataset for Context-Aware Text Generationcited by 22
- 2025Is Your Paper Being Reviewed by an LLM? Benchmarking AI Text Detection in Peer Reviewcited by 21
- 2023AI-generated text boundary detection with RoFTcited by 20
- 2023Towards Automatic Boundary Detection for Human-AI Collaborative Hybrid Essay in Educationcited by 17
- 2024MultiSocial: Multilingual Benchmark of Machine-Generated Text Detection of Social-Media Textscited by 14
- 2024Are AI Detectors Good Enough? A Survey on Quality of Datasets With Machine-Generated Textscited by 10
- 2025GigaChat Family: Efficient Russian Language Modeling Through Mixture of Experts Architecturecited by 8
- 2024ESPERANTO: Evaluating Synthesized Phrases to Enhance Robustness in AI Detection for Text Originationcited by 6
- 2025WETBench: A Benchmark for Detecting Task-Specific Machine-Generated Text on Wikipediacited by 6
- 2025Limits of LLM Text Detectors in Educationcited by 5
- 2025Beyond Easy Wins: A Text Hardness-Aware Benchmark for LLM-generated Text Detectioncited by 4
- 2024GigaCheck: Detecting LLM-generated Content via Object-Centric Span Localizationcited by 3
Built on by
Citing papers per year: 2026: 2.
2 papers.