LuxVeri at GenAI Detection Task 1: Inverse Perplexity Weighted Ensemble for Robust Detection of AI-Generated Text across English and Multilingual Contexts
Not on the map. Why?
Abstract (arXiv)
This paper presents a system developed for Task 1 of the COLING 2025 Workshop on Detecting AI-Generated Content, focusing on the binary classification of machine-generated versus human-written text. Our approach utilizes an ensemble of models, with weights assigned according to each model's inverse perplexity, to enhance classification accuracy. For the English text detection task, we combined RoBERTa-base, RoBERTa-base with the OpenAI detector, and BERT-base-cased, achieving a Macro F1-score of 0.7458, which ranked us 12th out of 35 teams. We ensembled RemBERT, XLM-RoBERTa-base, and BERT-base-multilingual-case for the multilingual text detection task, employing the same inverse perplexity weighting technique. This resulted in a Macro F1-score of 0.7513, positioning us 4th out of 25 teams. Our results demonstrate the effectiveness of inverse perplexity weighting in improving the robustness of machine-generated text detection across both monolingual and multilingual settings, highlighting the potential of ensemble methods for this challenging task.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 8 of its 14 references that are in the map. First posted on arXiv 21 Jan 2025.
Builds on
8 of 14 references.
References · 8
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2020Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inferencecited by 938
- 2019Release Strategies and the Social Impacts of Language Modelscited by 513
- 2020Rethinking embedding coupling in pre-trained language modelscited by 103
- 2024SemEval-2024 Task 8: Multidomain, Multimodel and Multilingual Machine-Generated Text Detectioncited by 30
- 2023SemEval-2023 Task 2: Fine-grained Multilingual Named Entity Recognition (MultiCoNER 2)cited by 17
Built on by
Citing papers per year: 2026: 2.
2 papers.