Fine-tuning Large Language Models for Multigenerator, Multidomain, and Multilingual Machine-Generated Text Detection
Not on the map. Why?
Abstract (arXiv)
SemEval-2024 Task 8 introduces the challenge of identifying machine-generated texts from diverse Large Language Models (LLMs) in various languages and domains. The task comprises three subtasks: binary classification in monolingual and multilingual (Subtask A), multi-class classification (Subtask B), and mixed text detection (Subtask C). This paper focuses on Subtask A & B. Each subtask is supported by three datasets for training, development, and testing. To tackle this task, two methods: 1) using traditional machine learning (ML) with natural language preprocessing (NLP) for feature extraction, and 2) fine-tuning LLMs for text classification. The results show that transformer models, particularly LoRA-RoBERTa, exceed traditional ML methods in effectiveness, with majority voting being particularly effective in multilingual contexts for identifying machine-generated texts.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 15 of its 22 references that are in the map. First posted on arXiv 22 Jan 2024.
Builds on
15 of 22 references.
References · 15
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 726
- 2019Defending Against Neural Fake Newscited by 559
- 2019GLTR: Statistical Detection and Visualization of Generated Textcited by 496
- 2023How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detectioncited by 481
- 2023The Science of Detecting LLM-Generated Textscited by 128
- 2023M4: Multi-generator, Multi-domain, and Multi-lingual Black-Box Machine-Generated Text Detectioncited by 121
- 2023Intrinsic Dimension Estimation for Robust Detection of AI-Generated Textscited by 112
3 more
- 2020RoFT: A Tool for Evaluating Human Detection of Machine-Generated Textcited by 36
- 2023Distinguishing ChatGPT(-3.5, -4)-generated and human-written papers through Japanese stylometric analysiscited by 16
- 2020Semi-supervised URL Segmentation with Recurrent Neural Networks Pre-trained on Knowledge Graph Entitiescited by 11
Built on by
Citing papers per year: 2024: 2; 2025: 1.
3 papers.