Sharif-MGTD at SemEval-2024 Task 8: A Transformer-Based Approach to Detect Machine Generated Text
Not on the map. Why?
Abstract (arXiv)
Detecting Machine-Generated Text (MGT) has emerged as a significant area of study within Natural Language Processing. While language models generate text, they often leave discernible traces, which can be scrutinized using either traditional feature-based methods or more advanced neural language models. In this research, we explore the effectiveness of fine-tuning a RoBERTa-base transformer, a powerful neural architecture, to address MGT detection as a binary classification task. Focusing specifically on Subtask A (Monolingual-English) within the SemEval-2024 competition framework, our proposed system achieves an accuracy of 78.9% on the test dataset, positioning us at 57th among participants. Our study addresses this challenge while considering the limited hardware resources, resulting in a system that excels at identifying human-written texts but encounters challenges in accurately discerning MGTs.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 14 of its 22 references that are in the map. First posted on arXiv 16 Jul 2024.
Builds on
14 of 22 references.
References · 14
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019The Curious Case of Neural Text Degenerationcited by 2,881
- 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 705
- 2019Defending Against Neural Fake Newscited by 553
- 2019Release Strategies and the Social Impacts of Language Modelscited by 505
- 2023Can AI-Generated Text be Reliably Detected?cited by 372
- 2020Automatic Detection of Machine Generated Text: A Critical Surveycited by 160
- 2020Evaluation of Neural Architectures Trained with Square Loss vs Cross-Entropy in Classification Taskscited by 137
- 2019Real or Fake? Learning to Discriminate Machine from Human Generated Textcited by 98
- 2022RankGen: Improving Text Generation with Large Ranking Modelscited by 72
- 2019Generating Sentiment-Preserving Fake Online Reviews Using Neural Language Models and Their Human- and Machine-based Detectioncited by 50
- 2024M4GT-Bench: Evaluation Benchmark for Black-Box Machine-Generated Text Detectioncited by 43
Built on by
Citing papers per year: 2025: 2.
2 papers.