mlsanityData to 13 Oct 2026

Unified Game Moderation: Soft-Prompting and LLM-Assisted Label Transfer for Resource-Efficient Toxicity Detection

arXiv 2506.06347 ↗First posted 1 Jun 2025cs.CL cs.AIcited by 5

Not on the map. Why?

Abstract (arXiv)

Toxicity detection in gaming communities faces significant scaling challenges when expanding across multiple games and languages, particularly in real-time environments where computational efficiency is crucial. We present two key findings to address these challenges while building upon our previous work on ToxBuster, a BERT-based real-time toxicity detection system. First, we introduce a soft-prompting approach that enables a single model to effectively handle multiple games by incorporating game-context tokens, matching the performance of more complex methods like curriculum learning while offering superior scalability. Second, we develop an LLM-assisted label transfer framework using GPT-4o-mini to extend support to seven additional languages. Evaluations on real game chat data across French, German, Portuguese, and Russian achieve macro F1-scores ranging from 32.96% to 58.88%, with particularly strong performance in German, surpassing the English benchmark of 45.39%. In production, this unified approach significantly reduces computational resources and maintenance overhead compared to maintaining separate models for each game and language combination. At Ubisoft, this model successfully identifies an average of 50 players, per game, per day engaging in sanctionable behavior.

Key facts. Cited by 5 papers in the map (data through 13 Oct 2026). Builds on 23 of its 60 references that are in the map. First posted on arXiv 1 Jun 2025.

Builds on

23 of 60 references.

References · 23

  1. 2020Language Models are Few-Shot Learnerscited by 32,320
  2. 2020Scaling Laws for Neural Language Modelscited by 6,494
  3. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,657
  4. 2021On the Opportunities and Risks of Foundation Modelscited by 3,999
  5. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,898
  6. 2019SemEval-2019 Task 6: Identifying and Categorizing Offensive Language in Social Media (OffensEval)cited by 207
  7. 2022On Second Thought, Let's Not Think Step by Step! Bias and Toxicity in Zero-Shot Reasoningcited by 193
  8. 2022A New Generation of Perspective API: Efficient Multilingual Character-level Transformerscited by 185
  9. 2020Directions in Abusive Language Training Data: Garbage In, Garbage Outcited by 140
  10. 2022COLD: A Benchmark for Chinese Offensive Language Detectioncited by 75
  11. 2018Challenges for Toxic Comment Classification: An In-Depth Error Analysiscited by 56
  12. 2020Toxic Language Detection in Social Media for Brazilian Portuguese: New Dataset and Multilingual Analysiscited by 45
11 more
  1. 2023Facilitating Fine-grained Detection of Chinese Toxic Language: Hierarchical Taxonomy, Resources, and Benchmarkscited by 45
  2. 2021SWSR: A Chinese Dataset and Lexicon for Online Sexism Detectioncited by 42
  3. 2023Open, Closed, or Small Language Models for Text Classification?cited by 34
  4. 2017Anyone Can Become a Troll: Causes of Trolling Behavior in Online Discussionscited by 30
  5. 2024Can LLMs Recognize Toxicity? A Structured Investigation Framework and Toxicity Metriccited by 23
  6. 2023Efficient Toxic Content Detection by Bootstrapping and Distilling Large Language Modelscited by 21
  7. 2024Improving Adversarial Data Collection by Supporting Annotators: Lessons from GAHD, a German Hate Speech Datasetcited by 13
  8. 2023Toxicity Detection is NOT all you Need: Measuring the Gaps to Supporting Volunteer Content Moderatorscited by 10
  9. 2022Learning a Better Initialization for Soft Prompts via Meta-Learningcited by 9
  10. 2024Multi3Hate: Multimodal, Multilingual, and Multicultural Hate Speech Detection with Vision-Language Modelscited by 7
  11. 2023Towards Detecting Contextual Real-Time Toxicity for In-Game Chatcited by 4

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2025: 1; 2026: 4.

5 papers.