GenAI Content Detection Task 1: English and Multilingual Machine-Generated Text Detection: AI vs. Human
Not on the map. Why?
Abstract (arXiv)
We present the GenAI Content Detection Task~1 -- a shared task on binary machine generated text detection, conducted as a part of the GenAI workshop at COLING 2025. The task consists of two subtasks: Monolingual (English) and Multilingual. The shared task attracted many participants: 36 teams made official submissions to the Monolingual subtask during the test phase and 26 teams -- to the Multilingual. We provide a comprehensive overview of the data, a summary of the results -- including system rankings and performance scores -- detailed descriptions of the participating systems, and an in-depth analysis of submissions. https://github.com/mbzuai-nlp/COLING-2025-Workshop-on-MGT-Detection-Task1
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 28 of its 50 references that are in the map. First posted on arXiv 19 Jan 2025.
Builds on
28 of 50 references.
References · 28
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2024Qwen2 Technical Reportcited by 2,076
- 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,928
- 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 705
- 2019Release Strategies and the Social Impacts of Language Modelscited by 505
- 2019GLTR: Statistical Detection and Visualization of Generated Textcited by 490
- 2023How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detectioncited by 472
- 2024Spotting LLMs With Binoculars: Zero-Shot Detection of Machine-Generated Textcited by 255
- 2023DetectLLM: Leveraging Log Rank Information for Zero-Shot Detection of Machine-Generated Textcited by 207
- 2023RADAR: Robust AI-Text Detection via Adversarial Learningcited by 187
- 2024RAID: A Shared Benchmark for Robust Evaluation of Machine-Generated Text Detectorscited by 157
- 2023MAGE: Machine-generated Text Detection in the Wildcited by 130
16 more
- 2023M4: Multi-generator, Multi-domain, and Multi-lingual Black-Box Machine-Generated Text Detectioncited by 118
- 2023Intrinsic Dimension Estimation for Robust Detection of AI-Generated Textscited by 111
- 2023MGTBench: Benchmarking Machine-Generated Text Detectioncited by 90
- 2023Multiscale Positive-Unlabeled Detection of AI-Generated Textscited by 59
- 2024LLM-as-a-Coauthor: Can Mixed Human-Written and Machine-Generated Text Be Detected?cited by 47
- 2024M4GT-Bench: Evaluation Benchmark for Black-Box Machine-Generated Text Detectioncited by 43
- 2023ArguGPT: evaluating, understanding and identifying argumentative essays generated by GPT modelscited by 41
- 2023Overview of AuTexTification at IberLEF 2023: Detection and Attribution of Machine-Generated Text in Multiple Domainscited by 31
- 2023HowkGPT: Investigating the Detection of ChatGPT-generated University Student Homework through Context-Aware Perplexity Analysiscited by 30
- 2024SemEval-2024 Task 8: Multidomain, Multimodel and Multilingual Machine-Generated Text Detectioncited by 30
- 2022Findings of the The RuATD Shared Task 2022 on Artificial Text Detection in Russiancited by 29
- 2024LLM-DetectAIve: a Tool for Fine-Grained Machine-Generated Text Detectioncited by 25
- 2023G3Detector: General GPT-Generated Text Detectorcited by 17
- 2024Detection of Human and Machine-Authored Fake News in Urducited by 7
- 2024MAiDE-up: Multilingual Deception Detection of GPT-generated Hotel Reviewscited by 5
- 2024Advacheck at GenAI Detection Task 1: AI Detection Powered by Domain-Aware Multi-Taskingcited by 2
Built on by
Citing papers per year: 2025: 9; 2026: 2.
11 papers.
- 2025Human-LLM Coevolution: Evidence from Academic Writingcited by 15
- 2025Feature-Level Insights into Artificial Text Detection with Sparse Autoencoderscited by 14
- 2025Stress-testing Machine Generated Text Detection: Shifting Language Models Writing Style to Fool Detectorscited by 9
- 2025FAID: Fine-Grained AI-Generated Text Detection Using Multi-Task Auxiliary and Multi-Level Contrastive Learningcited by 5
- 2025Wikipedia in the Era of LLMs: Evolution and Riskscited by 4
- 2025Is Human-Like Text Liked by Humans? Multilingual Human Detection and Preference Against AIcited by 3
- 2025On the Detectability of LLM-Generated Text: What Exactly Is LLM-Generated Text?cited by 3
- 2026Why AI-Generated Text Detection Fails: Evidence from Explainable AI Beyond Benchmark Accuracycited by 2
- 2025Beyond speculation: Measuring the growing presence of LLM-generated texts in multilingual disinformationcited by 1
- 2025AINL-Eval 2025 Shared Task: Detection of AI-Generated Scientific Abstracts in Russiancited by 0
- 2026Paraphrasing Attack Resilience of Various AI-Generated Text Detection Methodscited by 0
- 2026Paraphrasing Attack Resilience of Various AI-Generated Text Detection Methods14 May 2026
- 2026Why AI-Generated Text Detection Fails: Evidence from Explainable AI Beyond Benchmark Accuracy24 Mar 2026
- 2025On the Detectability of LLM-Generated Text: What Exactly Is LLM-Generated Text?23 Oct 2025
- 2025AINL-Eval 2025 Shared Task: Detection of AI-Generated Scientific Abstracts in Russian13 Aug 2025
- 2025Stress-testing Machine Generated Text Detection: Shifting Language Models Writing Style to Fool Detectors30 May 2025
- 2025FAID: Fine-Grained AI-Generated Text Detection Using Multi-Task Auxiliary and Multi-Level Contrastive Learning20 May 2025
- 2025Beyond speculation: Measuring the growing presence of LLM-generated texts in multilingual disinformation29 Mar 2025
- 2025Feature-Level Insights into Artificial Text Detection with Sparse Autoencoders5 Mar 2025
- 2025Wikipedia in the Era of LLMs: Evolution and Risks4 Mar 2025
- 2025Is Human-Like Text Liked by Humans? Multilingual Human Detection and Preference Against AI17 Feb 2025
- 2025Human-LLM Coevolution: Evidence from Academic Writing13 Feb 2025