mlsanityData to 7 Oct 2026

SemEval-2024 Task 8: Multidomain, Multimodel and Multilingual Machine-Generated Text Detection

arXiv 2404.14183 ↗First posted 22 Apr 2024cs.CLcited by 30

Not on the map. Why?

Abstract (arXiv)

We present the results and the main findings of SemEval-2024 Task 8: Multigenerator, Multidomain, and Multilingual Machine-Generated Text Detection. The task featured three subtasks. Subtask A is a binary classification task determining whether a text is written by a human or generated by a machine. This subtask has two tracks: a monolingual track focused solely on English texts and a multilingual track. Subtask B is to detect the exact source of a text, discerning whether it is written by a human or generated by a specific LLM. Subtask C aims to identify the changing point within a text, at which the authorship transitions from human to machine. The task attracted a large number of participants: subtask A monolingual (126), subtask A multilingual (59), subtask B (70), and subtask C (30). In this paper, we present the task, analyze the results, and discuss the system submissions and the methods they used. For all subtasks, the best systems used LLMs.

Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). Builds on 41 of its 86 references that are in the map. First posted on arXiv 22 Apr 2024.

Builds on

41 of 86 references.

References · 41

  1. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  2. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  3. 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 705
  4. 2019Defending Against Neural Fake Newscited by 553
  5. 2019Release Strategies and the Social Impacts of Language Modelscited by 505
  6. 2019GLTR: Statistical Detection and Visualization of Generated Textcited by 490
  7. 2023How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detectioncited by 472
  8. 2023Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defensecited by 401
  9. 2019Automatic Detection of Generated Text is Easiest when Humans are Fooledcited by 260
  10. 2024Spotting LLMs With Binoculars: Zero-Shot Detection of Machine-Generated Textcited by 255
  11. 2021Adversarial GLUE: A Multi-Task Benchmark for Robustness Evaluation of Language Modelscited by 227
  12. 2023DetectLLM: Leveraging Log Rank Information for Zero-Shot Detection of Machine-Generated Textcited by 207
29 more
  1. 2020Automatic Detection of Machine Generated Text: A Critical Surveycited by 160
  2. 2021TURINGBENCH: A Benchmark Environment for Turing Test in the Age of Neural Text Generationcited by 118
  3. 2023M4: Multi-generator, Multi-domain, and Multi-lingual Black-Box Machine-Generated Text Detectioncited by 118
  4. 2021Sparks: Inspiration for Science Writing using Language Modelscited by 80
  5. 2023OUTFOX: LLM-Generated Essay Detection Through In-Context Learning with Adversarially Generated Examplescited by 80
  6. 2023RewriteLM: An Instruction-Tuned Large Language Model for Text Rewritingcited by 67
  7. 2022Real or Fake Text?: Investigating Human Ability to Detect Boundaries Between Human-Written and Machine-Generated Textcited by 63
  8. 2023The Next Chapter: A Study of Large Language Models in Storytellingcited by 58
  9. 2023Stylometric Detection of AI-Generated Text in Twitter Timelinescited by 57
  10. 2024M4GT-Bench: Evaluation Benchmark for Black-Box Machine-Generated Text Detectioncited by 43
  11. 2020Neural Deepfake Detection with Factual Structure of Textcited by 40
  12. 2022Attribution and Obfuscation of Neural Text Authorship: A Data Mining Perspectivecited by 40
  13. 2024Few-Shot Detection of Machine-Generated Text using Style Representationscited by 40
  14. 2023GPT-who: An Information Density-based Machine-Generated Text Detectorcited by 38
  15. 2022CoCo: Coherence-Enhanced Machine-Generated Text Detection Under Data Limitation With Contrastive Learningcited by 32
  16. 2022Adversarial Robustness of Neural-Statistical Features in Detection of Generative Transformerscited by 25
  17. 2024Authorship Obfuscation in Multilingual Machine-Generated Text Detectioncited by 19
  18. 2024Team QUST at SemEval-2024 Task 8: A Comprehensive Study of Monolingual and Multilingual Approaches for Detecting AI-generated Textcited by 5
  19. 2024KInIT at SemEval-2024 Task 8: Fine-tuned LLMs for Multilingual Machine-Generated Text Detectioncited by 4
  20. 2024PetKaz at SemEval-2024 Task 8: Can Linguistics Capture the Specifics of LLM-generated Text?cited by 4
  21. 2024Fine-tuning Large Language Models for Multigenerator, Multidomain, and Multilingual Machine-Generated Text Detectioncited by 3
  22. 2024TrustAI at SemEval-2024 Task 8: A Comprehensive Analysis of Multi-domain Machine Generated Text Detection Techniquescited by 3
  23. 2024TM-TREK at SemEval-2024 Task 8: Towards LLM-Based Automatic Boundary Detection for Human-Machine Mixed Textcited by 3
  24. 2024AISPACE at SemEval-2024 task 8: A Class-balanced Soft-voting System for Detecting Multi-generator Machine-generated Textcited by 3
  25. 2024HU at SemEval-2024 Task 8A: Can Contrastive Learning Learn Embeddings to Detect Machine-Generated Text?cited by 2
  26. 2024RFBES at SemEval-2024 Task 8: Investigating Syntactic and Semantic Features for Distinguishing AI-Generated and Human-Written Textscited by 2
  27. 2024AIpom at SemEval-2024 Task 8: Detecting AI-produced Outputs in M4cited by 2
  28. 2024SemEval-2024 Task 8: Weighted Layer Averaging RoBERTa for Black-Box Machine-Generated Text Detectioncited by 1
  29. 2024MasonTigers at SemEval-2024 Task 8: Performance Analysis of Transformer-based Models on Machine-Generated Text Detectioncited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 9; 2025: 15; 2026: 6.

30 papers.

Sort:

By area:

  1. 2024DeTeCtive: Detecting AI-generated Text via Multi-Level Contrastive Learningcited by 52
  2. 2024Beemo: Benchmark of Expert-edited Machine-generated Outputscited by 26
  3. 2024LLM-DetectAIve: a Tool for Fine-Grained Machine-Generated Text Detectioncited by 25
  4. 2024Robust AI-Generated Text Detection by Restricted Embeddingscited by 18
  5. 2025Machine-generated text detection prevents language model collapsecited by 14
  6. 2025GenAI Content Detection Task 1: English and Multilingual Machine-Generated Text Detection: AI vs. Humancited by 11
  7. 2025Characterizing LLM-driven Social Network: The Chirper.ai Casecited by 9
  8. 2025Stress-testing Machine Generated Text Detection: Shifting Language Models Writing Style to Fool Detectorscited by 9
  9. 2025Increasing the Robustness of the Fine-tuned Multilingual Machine-Generated Text Detectorscited by 8
  10. 2025Human Texts Are Outliers: Detecting LLM-generated Texts via Out-of-distribution Detectioncited by 8
  11. 2024Detection of Human and Machine-Authored Fake News in Urducited by 7
  12. 2025GenAI Content Detection Task 3: Cross-Domain Machine-Generated Text Detection Challengecited by 7
18 more
  1. 2024GenAI Content Detection Task 2: AI vs. Human -- Academic Essay Authenticity Challengecited by 6
  2. 2025Robust and Fine-Grained Detection of AI Generated Textscited by 3
  3. 2024Transformer and Hybrid Deep Learning Based Models for Machine-Generated Text Detectioncited by 2
  4. 2024Sharif-MGTD at SemEval-2024 Task 8: A Transformer-Based Approach to Detect Machine Generated Textcited by 2
  5. 2024RKadiyala at SemEval-2024 Task 8: Black-Box Word-Level Text Boundary Detection in Partially Machine Generated Textscited by 2
  6. 2025LuxVeri at GenAI Detection Task 1: Inverse Perplexity Weighted Ensemble for Robust Detection of AI-Generated Text across English and Multilingual Contextscited by 2
  7. 2025LLMTrace: A Corpus for Classification and Fine-Grained Localization of AI-Written Textcited by 2
  8. 2026Why AI-Generated Text Detection Fails: Evidence from Explainable AI Beyond Benchmark Accuracycited by 2
  9. 2025LuxVeri at GenAI Detection Task 3: Cross-Domain Detection of AI-Generated Text Using Inverse Perplexity-Weighted Ensemble of Fine-Tuned Transformer Modelscited by 1
  10. 2025Beyond speculation: Measuring the growing presence of LLM-generated texts in multilingual disinformationcited by 1
  11. 2025Domain Gating Ensemble Networks for AI-Generated Text Detectioncited by 0
  12. 2025AINL-Eval 2025 Shared Task: Detection of AI-Generated Scientific Abstracts in Russiancited by 0
  13. 2025Automatic Machine Translation Detection Using a Surrogate Multilingual Translation Modelcited by 0
  14. 2026LLM Output Detectability and Task Performance Can be Jointly Optimizedcited by 0
  15. 2026AEyeDE: An Attention-Based Attribution Framework for AI-Generated Text Detectioncited by 0
  16. 2026Detecting LLM-Generated Tokens in Human--LLM Coauthored Textcited by 0
  17. 2026Build it, Break it, Repeat: Benchmarking and improving LLM-manipulated disinformation detection in social media postscited by 0
  18. 2026Policy-Conditioned AI-Use Detection: An Evidentiary Framework for Academic Publishingcited by 0