mlsanityData to 7 Oct 2026

Classification of Human- and AI-Generated Texts for English, French, German, and Spanish

arXiv 2312.04882 ↗First posted 8 Dec 2023cs.CL cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

In this paper we analyze features to classify human- and AI-generated text for English, French, German and Spanish and compare them across languages. We investigate two scenarios: (1) The detection of text generated by AI from scratch, and (2) the detection of text rephrased by AI. For training and testing the classifiers in this multilingual setting, we created a new text corpus covering 10 topics for each language. For the detection of AI-generated text, the combination of all proposed features performs best, indicating that our features are portable to other related languages: The F1-scores are close with 99% for Spanish, 98% for English, 97% for German and 95% for French. For the detection of AI-rephrased text, the systems with all features outperform systems with other features in many cases, but using only document features performs best for German (72%) and Spanish (86%) and only text vector features leads to best results for English (78%).

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 17 of its 32 references that are in the map. First posted on arXiv 8 Dec 2023.

Builds on

17 of 32 references.

References · 17

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  5. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  6. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  7. 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 705
  8. 2019Release Strategies and the Social Impacts of Language Modelscited by 505
  9. 2019GLTR: Statistical Detection and Visualization of Generated Textcited by 490
  10. 2023How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detectioncited by 472
  11. 2020Towards a Human-like Open-Domain Chatbotcited by 467
  12. 2022ChatGPT Makes Medicine Easy to Swallow: An Exploratory Case Study on Simplified Radiology Reportscited by 100
5 more
  1. 2023ChatGPT or Human? Detect and Explain. Explaining Decisions of Machine Learning Model for Detecting Short ChatGPT-generated Textcited by 84
  2. 2023Stylometric Detection of AI-Generated Text in Twitter Timelinescited by 57
  3. 2023Classification of Human- and AI-Generated Texts: Investigating Features for ChatGPTcited by 18
  4. 2023Distinguishing ChatGPT(-3.5, -4)-generated and human-written papers through Japanese stylometric analysiscited by 16
  5. 2023Comparing Abstractive Summaries Generated by ChatGPT to Real Summaries Through Blinded Reviewers and Text Classification Algorithmscited by 15

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 2; 2026: 1.

4 papers.

  1. 2024A Survey of AI-generated Text Forensic Systems: Detection, Attribution, and Characterizationcited by 18
  2. 2025CEAID: Benchmark of Multilingual Machine-Generated Text Detection Methods for Central European Languagescited by 1
  3. 2025A Cross-Cultural Assessment of Human Ability to Detect LLM-Generated Fake News about South Africacited by 0
  4. 2026Interpretable Predictability-Based AI Text Detection: A Replication Studycited by 0