mlsanityData to 7 Oct 2026

Sharif-MGTD at SemEval-2024 Task 8: A Transformer-Based Approach to Detect Machine Generated Text

arXiv 2407.11774 ↗First posted 16 Jul 2024cs.CL cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

Detecting Machine-Generated Text (MGT) has emerged as a significant area of study within Natural Language Processing. While language models generate text, they often leave discernible traces, which can be scrutinized using either traditional feature-based methods or more advanced neural language models. In this research, we explore the effectiveness of fine-tuning a RoBERTa-base transformer, a powerful neural architecture, to address MGT detection as a binary classification task. Focusing specifically on Subtask A (Monolingual-English) within the SemEval-2024 competition framework, our proposed system achieves an accuracy of 78.9% on the test dataset, positioning us at 57th among participants. Our study addresses this challenge while considering the limited hardware resources, resulting in a system that excels at identifying human-written texts but encounters challenges in accurately discerning MGTs.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 14 of its 22 references that are in the map. First posted on arXiv 16 Jul 2024.

Builds on

14 of 22 references.

References · 14

  1. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  2. 2019The Curious Case of Neural Text Degenerationcited by 2,881
  3. 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 705
  4. 2019Defending Against Neural Fake Newscited by 553
  5. 2019Release Strategies and the Social Impacts of Language Modelscited by 505
  6. 2023Can AI-Generated Text be Reliably Detected?cited by 372
  7. 2020Automatic Detection of Machine Generated Text: A Critical Surveycited by 160
  8. 2020Evaluation of Neural Architectures Trained with Square Loss vs Cross-Entropy in Classification Taskscited by 137
  9. 2019Real or Fake? Learning to Discriminate Machine from Human Generated Textcited by 98
  10. 2022RankGen: Improving Text Generation with Large Ranking Modelscited by 72
  11. 2019Generating Sentiment-Preserving Fake Online Reviews Using Neural Language Models and Their Human- and Machine-based Detectioncited by 50
  12. 2024M4GT-Bench: Evaluation Benchmark for Black-Box Machine-Generated Text Detectioncited by 43
2 more
  1. 2024SemEval-2024 Task 8: Multidomain, Multimodel and Multilingual Machine-Generated Text Detectioncited by 30
  2. 2020Solomon at SemEval-2020 Task 11: Ensemble Architecture for Fine-Tuned Propaganda Detection in News Articlescited by 4

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.