mlsanityData to 14 Oct 2026

LLMTrace: A Corpus for Classification and Fine-Grained Localization of AI-Written Text

arXiv 2509.21269 ↗First posted 25 Sep 2025cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

The widespread use of human-like text from Large Language Models (LLMs) necessitates the development of robust detection systems. However, progress is limited by a critical lack of suitable training data; existing datasets are often generated with outdated models, are predominantly in English, and fail to address the increasingly common scenario of mixed human-AI authorship. Crucially, while some datasets address mixed authorship, none provide the character-level annotations required for the precise localization of AI-generated segments within a text. To address these gaps, we introduce LLMTrace, a new large-scale, bilingual (English and Russian) corpus for AI-generated text detection. Constructed using a diverse range of modern proprietary and open-source LLMs, our dataset is designed to support two key tasks: traditional full-text binary classification (human vs. AI) and AI-generated interval detection, facilitated by character-level annotations. We believe LLMTrace will serve as a vital resource for training and evaluating the next generation of more nuanced and practical AI detection models. The project page is available at https://sweetdream779.github.io/LLMTrace-info/.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 46 of its 55 references that are in the map. First posted on arXiv 25 Sep 2025.

Builds on

46 of 55 references.

References · 46

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  4. 2024GPT-4o System Cardcited by 4,588
  5. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  6. 2020Longformer: The Long-Document Transformercited by 3,413
  7. 2023Mistral 7Bcited by 3,164
  8. 2015Character-level Convolutional Networks for Text Classificationcited by 2,330
  9. 2018Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarizationcited by 1,317
  10. 2018Hierarchical Neural Story Generationcited by 1,193
  11. 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 726
  12. 2022DN-DETR: Accelerate DETR Training by Introducing Query DeNoisingcited by 488
34 more
  1. 2023How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detectioncited by 481
  2. 2021MAUVE: Measuring the Gap Between Neural Text and Human Text using Divergence Frontierscited by 470
  3. 2016A Corpus and Evaluation Framework for Deeper Understanding of Commonsense Storiescited by 417
  4. 2023Fast-DetectGPT: Efficient Zero-Shot Detection of Machine-Generated Text via Conditional Probability Curvaturecited by 287
  5. 2024Spotting LLMs With Binoculars: Zero-Shot Detection of Machine-Generated Textcited by 263
  6. 2022CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilitiescited by 249
  7. 2024RAID: A Shared Benchmark for Robust Evaluation of Machine-Generated Text Detectorscited by 163
  8. 2023MAGE: Machine-generated Text Detection in the Wildcited by 132
  9. 2023Intrinsic Dimension Estimation for Robust Detection of AI-Generated Textscited by 112
  10. 2016Winning Arguments: Interaction Dynamics and Persuasion Strategies in Good-faith Online Discussionscited by 110
  11. 2022Human heuristics for AI-generated language are flawedcited by 105
  12. 2023MGTBench: Benchmarking Machine-Generated Text Detectioncited by 93
  13. 2023Ghostbuster: Detecting Text Ghostwritten by Large Language Modelscited by 91
  14. 2022Real or Fake Text?: Investigating Human Ability to Detect Boundaries Between Human-Written and Machine-Generated Textcited by 63
  15. 2024LLM-as-a-Coauthor: Can Mixed Human-Written and Machine-Generated Text Be Detected?cited by 49
  16. 2025mmBERT: A Modern Multilingual Encoder with Annealed Language Learningcited by 45
  17. 2024M4GT-Bench: Evaluation Benchmark for Black-Box Machine-Generated Text Detectioncited by 43
  18. 2024DetectRL: Benchmarking LLM-Generated Text Detection in Real-World Scenarioscited by 38
  19. 2024SemEval-2024 Task 8: Multidomain, Multimodel and Multilingual Machine-Generated Text Detectioncited by 30
  20. 2022Findings of the The RuATD Shared Task 2022 on Artificial Text Detection in Russiancited by 29
  21. 2023A Family of Pretrained Transformer Language Models for Russiancited by 27
  22. 2024Beemo: Benchmark of Expert-edited Machine-generated Outputscited by 27
  23. 2021SciXGen: A Scientific Paper Dataset for Context-Aware Text Generationcited by 22
  24. 2025Is Your Paper Being Reviewed by an LLM? Benchmarking AI Text Detection in Peer Reviewcited by 21
  25. 2023AI-generated text boundary detection with RoFTcited by 20
  26. 2023Towards Automatic Boundary Detection for Human-AI Collaborative Hybrid Essay in Educationcited by 17
  27. 2024MultiSocial: Multilingual Benchmark of Machine-Generated Text Detection of Social-Media Textscited by 14
  28. 2024Are AI Detectors Good Enough? A Survey on Quality of Datasets With Machine-Generated Textscited by 10
  29. 2025GigaChat Family: Efficient Russian Language Modeling Through Mixture of Experts Architecturecited by 8
  30. 2024ESPERANTO: Evaluating Synthesized Phrases to Enhance Robustness in AI Detection for Text Originationcited by 6
  31. 2025WETBench: A Benchmark for Detecting Task-Specific Machine-Generated Text on Wikipediacited by 6
  32. 2025Limits of LLM Text Detectors in Educationcited by 5
  33. 2025Beyond Easy Wins: A Text Hardness-Aware Benchmark for LLM-generated Text Detectioncited by 4
  34. 2024GigaCheck: Detecting LLM-generated Content via Object-Centric Span Localizationcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.