Overview of AuTexTification at IberLEF 2023: Detection and Attribution of Machine-Generated Text in Multiple Domains
Not on the map. Why?
Abstract (arXiv)
This paper presents the overview of the AuTexTification shared task as part of the IberLEF 2023 Workshop in Iberian Languages Evaluation Forum, within the framework of the SEPLN 2023 conference. AuTexTification consists of two subtasks: for Subtask 1, participants had to determine whether a text is human-authored or has been generated by a large language model. For Subtask 2, participants had to attribute a machine-generated text to one of six different text generation models. Our AuTexTification 2023 dataset contains more than 160.000 texts across two languages (English and Spanish) and five domains (tweets, reviews, news, legal, and how-to articles). A total of 114 teams signed up to participate, of which 36 sent 175 runs, and 20 of them sent their working notes. In this overview, we present the AuTexTification dataset and task, the submitted participating systems, and the results.
Key facts. Cited by 31 papers in the map (data through 14 Oct 2026). Builds on 30 of its 64 references that are in the map. First posted on arXiv 20 Sep 2023.
Builds on
30 of 64 references.
References · 30
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2019The Curious Case of Neural Text Degenerationcited by 2,916
- 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,984
- 2018Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarizationcited by 1,317
- 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,254
- 2016Bag of Tricks for Efficient Text Classificationcited by 876
18 more
- 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 726
- 2019Defending Against Neural Fake Newscited by 559
- 2021XL-Sum: Large-Scale Multilingual Abstractive Summarization for 44 Languagescited by 347
- 2019Automatic Detection of Generated Text is Easiest when Humans are Fooledcited by 261
- 2023GPTs are GPTs: An Early Look at the Labor Market Impact Potential of Large Language Modelscited by 176
- 2020MLSUM: The Multilingual Summarization Corpuscited by 121
- 2021XLM-T: Multilingual Language Models in Twitter for Sentiment Analysis and Beyondcited by 114
- 2020Rethinking embedding coupling in pre-trained language modelscited by 103
- 2019Real or Fake? Learning to Discriminate Machine from Human Generated Textcited by 99
- 2021MultiEURLEX -- A multi-lingual and multi-label legal document classification dataset for zero-shot cross-lingual transfercited by 90
- 2023AI model GPT-3 (dis)informs us better than humanscited by 78
- 2020Behavioral Use Licensing for Responsible AIcited by 46
- 2022Findings of the The RuATD Shared Task 2022 on Artificial Text Detection in Russiancited by 29
- 2023Democratising AI: Multiple Meanings, Goals, and Methodscited by 29
- 2023Generative AI Text Classification using Ensemble LLM Approachescited by 29
- 2019Towards Standardization of Data Licenses: The Montreal Data Licensecited by 19
- 2022Few-Shot Learning with Siamese Networks and Label Tuningcited by 15
- 2017A Low Dimensionality Representation for Language Variety Identificationcited by 2
Built on by
Citing papers per year: 2023: 2; 2024: 9; 2025: 16; 2026: 4.
31 papers.
Sort:
By area:
- 2024RAID: A Shared Benchmark for Robust Evaluation of Machine-Generated Text Detectorscited by 163
- 2023Data Contamination Quiz: A Tool to Detect and Estimate Contamination in Large Language Modelscited by 47
- 2023From Text to Source: Results in Detecting Large Language Model-Generated Contentcited by 26
- 2024Detecting AI-Generated Text: Factors Influencing Detectability with Current Methodscited by 23
- 2024A Survey of AI-generated Text Forensic Systems: Detection, Attribution, and Characterizationcited by 19
- 2024StyloAI: Distinguishing AI-Generated Content with Stylometric Analysiscited by 17
- 2024MultiSocial: Multilingual Benchmark of Machine-Generated Text Detection of Social-Media Textscited by 14
- 2025GenAI Content Detection Task 1: English and Multilingual Machine-Generated Text Detection: AI vs. Humancited by 13
- 2024Are AI Detectors Good Enough? A Survey on Quality of Datasets With Machine-Generated Textscited by 10
- 2025Increasing the Robustness of the Fine-tuned Multilingual Machine-Generated Text Detectorscited by 8
- 2025GenAI Content Detection Task 3: Cross-Domain Machine-Generated Text Detection Challengecited by 7
- 2025Linguistic and Embedding-Based Profiling of Texts generated by Humans and Large Language Modelscited by 6
19 more
- 2025A Lightweight Approach to Detection of AI-Generated Texts Using Stylometric Featurescited by 5
- 2025When Detection Fails: The Power of Fine-Tuned Models to Generate Human-Like Social Media Textcited by 4
- 2025Who Writes What: Unveiling the Impact of Author Roles on AI-generated Text Detectioncited by 3
- 2025Distinguishing AI-Generated and Human-Written Text Through Psycholinguistic Analysiscited by 3
- 2025Explainability-Based Token Replacement on LLM-Generated Textcited by 3
- 2025DACTYL: Diverse Adversarial Corpus of Texts Yielded from Large Language Modelscited by 3
- 2024Is the Digital Forensics and Incident Response Pipeline Ready for Text-Based Threats in LLM Era?cited by 1
- 2025AI-generated Text Detection with a GLTR-based Approachcited by 1
- 2025Could AI Trace and Explain the Origins of AI-Generated Images and Text?cited by 1
- 2025AI Text Detectors and the Misclassification of Slightly Polished Arabic Textcited by 1
- 2026MAGA-Bench: Machine-Augment-Generated Text via Alignment Detection Benchmarkcited by 1
- 2026When New Generators Arrive: Lifelong Machine-Generated Text Attribution via Ridge Feature Transfercited by 1
- 2024TextMachina: Seamless Generation of Machine-Generated Text Datasetscited by 0
- 2024Automated Text Identification Using CNN and Training Dynamicscited by 0
- 2025Stylometry recognizes human and LLM-generated texts in short samplescited by 0
- 2025StylOch at PAN: Gradient-Boosted Trees with Frequency-Based Stylometric Featurescited by 0
- 2025PUCP-Metrix: An Open-source and Comprehensive Toolkit for Linguistic Analysis of Spanish Textscited by 0
- 2026The Alchemy of Thought: Understanding In-Context Learning Through Supervised Classificationcited by 0
- 2026IndicDetect: Evaluating Cross-Lingual LLM-Generated Text Detection for Hindi, Telugu, and Tamilcited by 0
- 2026IndicDetect: Evaluating Cross-Lingual LLM-Generated Text Detection for Hindi, Telugu, and Tamil30 Aug 2026
- 2026When New Generators Arrive: Lifelong Machine-Generated Text Attribution via Ridge Feature Transfer4 Jun 2026
- 2026MAGA-Bench: Machine-Augment-Generated Text via Alignment Detection Benchmark8 Jan 2026
- 2026The Alchemy of Thought: Understanding In-Context Learning Through Supervised Classification3 Jan 2026
- 2025A Lightweight Approach to Detection of AI-Generated Texts Using Stylometric Features22 Nov 2025
- 2025PUCP-Metrix: An Open-source and Comprehensive Toolkit for Linguistic Analysis of Spanish Texts21 Nov 2025
- 2025AI Text Detectors and the Misclassification of Slightly Polished Arabic Text16 Nov 2025
- 2025DACTYL: Diverse Adversarial Corpus of Texts Yielded from Large Language Models1 Aug 2025
- 2025Linguistic and Embedding-Based Profiling of Texts generated by Humans and Large Language Models18 Jul 2025
- 2025StylOch at PAN: Gradient-Boosted Trees with Frequency-Based Stylometric Features16 Jul 2025
- 2025Stylometry recognizes human and LLM-generated texts in short samples1 Jul 2025
- 2025When Detection Fails: The Power of Fine-Tuned Models to Generate Human-Like Social Media Text11 Jun 2025
19 more
- 2025Explainability-Based Token Replacement on LLM-Generated Text4 Jun 2025
- 2025Distinguishing AI-Generated and Human-Written Text Through Psycholinguistic Analysis3 May 2025
- 2025Could AI Trace and Explain the Origins of AI-Generated Images and Text?5 Apr 2025
- 2025Increasing the Robustness of the Fine-tuned Multilingual Machine-Generated Text Detectors19 Mar 2025
- 2025Who Writes What: Unveiling the Impact of Author Roles on AI-generated Text Detection18 Feb 2025
- 2025AI-generated Text Detection with a GLTR-based Approach17 Feb 2025
- 2025GenAI Content Detection Task 1: English and Multilingual Machine-Generated Text Detection: AI vs. Human19 Jan 2025
- 2025GenAI Content Detection Task 3: Cross-Domain Machine-Generated Text Detection Challenge15 Jan 2025
- 2024Are AI Detectors Good Enough? A Survey on Quality of Datasets With Machine-Generated Texts18 Oct 2024
- 2024Is the Digital Forensics and Incident Response Pipeline Ready for Text-Based Threats in LLM Era?25 Jul 2024
- 2024Detecting AI-Generated Text: Factors Influencing Detectability with Current Methods21 Jun 2024
- 2024MultiSocial: Multilingual Benchmark of Machine-Generated Text Detection of Social-Media Texts18 Jun 2024
- 2024Automated Text Identification Using CNN and Training Dynamics18 May 2024
- 2024StyloAI: Distinguishing AI-Generated Content with Stylometric Analysis16 May 2024
- 2024RAID: A Shared Benchmark for Robust Evaluation of Machine-Generated Text Detectors13 May 2024
- 2024A Survey of AI-generated Text Forensic Systems: Detection, Attribution, and Characterization2 Mar 2024
- 2024TextMachina: Seamless Generation of Machine-Generated Text Datasets8 Jan 2024
- 2023Data Contamination Quiz: A Tool to Detect and Estimate Contamination in Large Language Models10 Nov 2023
- 2023From Text to Source: Results in Detecting Large Language Model-Generated Content23 Sep 2023
- 2024RAID: A Shared Benchmark for Robust Evaluation of Machine-Generated Text Detectorscited by 163
- 2023Data Contamination Quiz: A Tool to Detect and Estimate Contamination in Large Language Modelscited by 47
- 2024Detecting AI-Generated Text: Factors Influencing Detectability with Current Methodscited by 23
- 2024A Survey of AI-generated Text Forensic Systems: Detection, Attribution, and Characterizationcited by 19
- 2024StyloAI: Distinguishing AI-Generated Content with Stylometric Analysiscited by 17
- 2024MultiSocial: Multilingual Benchmark of Machine-Generated Text Detection of Social-Media Textscited by 14
- 2025GenAI Content Detection Task 1: English and Multilingual Machine-Generated Text Detection: AI vs. Humancited by 13
- 2024Are AI Detectors Good Enough? A Survey on Quality of Datasets With Machine-Generated Textscited by 10
- 2025GenAI Content Detection Task 3: Cross-Domain Machine-Generated Text Detection Challengecited by 7
- 2025Linguistic and Embedding-Based Profiling of Texts generated by Humans and Large Language Modelscited by 6
- 2025A Lightweight Approach to Detection of AI-Generated Texts Using Stylometric Featurescited by 5
- 2025When Detection Fails: The Power of Fine-Tuned Models to Generate Human-Like Social Media Textcited by 4
12 most cited of 28 All 28 (JSON)
- 2026IndicDetect: Evaluating Cross-Lingual LLM-Generated Text Detection for Hindi, Telugu, and Tamil30 Aug 2026
- 2026When New Generators Arrive: Lifelong Machine-Generated Text Attribution via Ridge Feature Transfer4 Jun 2026
- 2026MAGA-Bench: Machine-Augment-Generated Text via Alignment Detection Benchmark8 Jan 2026
- 2025A Lightweight Approach to Detection of AI-Generated Texts Using Stylometric Features22 Nov 2025
- 2025PUCP-Metrix: An Open-source and Comprehensive Toolkit for Linguistic Analysis of Spanish Texts21 Nov 2025
- 2025AI Text Detectors and the Misclassification of Slightly Polished Arabic Text16 Nov 2025
- 2025DACTYL: Diverse Adversarial Corpus of Texts Yielded from Large Language Models1 Aug 2025
- 2025Linguistic and Embedding-Based Profiling of Texts generated by Humans and Large Language Models18 Jul 2025
- 2025StylOch at PAN: Gradient-Boosted Trees with Frequency-Based Stylometric Features16 Jul 2025
- 2025Stylometry recognizes human and LLM-generated texts in short samples1 Jul 2025
- 2025When Detection Fails: The Power of Fine-Tuned Models to Generate Human-Like Social Media Text11 Jun 2025
- 2025Explainability-Based Token Replacement on LLM-Generated Text4 Jun 2025
12 newest of 28 All 28 (JSON)