PetKaz at SemEval-2024 Task 8: Can Linguistics Capture the Specifics of LLM-generated Text?
Not on the map. Why?
Abstract (arXiv)
In this paper, we present our submission to the SemEval-2024 Task 8 "Multigenerator, Multidomain, and Multilingual Black-Box Machine-Generated Text Detection", focusing on the detection of machine-generated texts (MGTs) in English. Specifically, our approach relies on combining embeddings from the RoBERTa-base with diversity features and uses a resampled training set. We score 12th from 124 in the ranking for Subtask A (monolingual track), and our results show that our approach is generalizable across unseen models and domains, achieving an accuracy of 0.91.
Key facts. Cited by 4 papers in the map (data through 13 Oct 2026). Builds on 8 of its 21 references that are in the map. First posted on arXiv 8 Apr 2024.
Builds on
8 of 21 references.
References · 8
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,223
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,322
- 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 717
- 2023DetectLLM: Leveraging Log Rank Information for Zero-Shot Detection of Machine-Generated Textcited by 207
- 2023M4: Multi-generator, Multi-domain, and Multi-lingual Black-Box Machine-Generated Text Detectioncited by 120
- 2023A Survey on Detection of LLMs-Generated Contentcited by 71
- 2022CoCo: Coherence-Enhanced Machine-Generated Text Detection Under Data Limitation With Contrastive Learningcited by 32
- 2019A Unified Linear-Time Framework for Sentence-Level Discourse Parsingcited by 15
Built on by
Citing papers per year: 2024: 1; 2025: 2; 2026: 1.
4 papers.
- 2024SemEval-2024 Task 8: Multidomain, Multimodel and Multilingual Machine-Generated Text Detectioncited by 30
- 2025Linguistic Characteristics of AI-Generated Text: A Surveycited by 7
- 2025PUCP-Metrix: An Open-source and Comprehensive Toolkit for Linguistic Analysis of Spanish Textscited by 0
- 2026Interpretable Predictability-Based AI Text Detection: A Replication Studycited by 0
- 2026Interpretable Predictability-Based AI Text Detection: A Replication Study16 Mar 2026
- 2025PUCP-Metrix: An Open-source and Comprehensive Toolkit for Linguistic Analysis of Spanish Texts21 Nov 2025
- 2025Linguistic Characteristics of AI-Generated Text: A Survey1 Oct 2025
- 2024SemEval-2024 Task 8: Multidomain, Multimodel and Multilingual Machine-Generated Text Detection22 Apr 2024