Unified Game Moderation: Soft-Prompting and LLM-Assisted Label Transfer for Resource-Efficient Toxicity Detection
Not on the map. Why?
Abstract (arXiv)
Toxicity detection in gaming communities faces significant scaling challenges when expanding across multiple games and languages, particularly in real-time environments where computational efficiency is crucial. We present two key findings to address these challenges while building upon our previous work on ToxBuster, a BERT-based real-time toxicity detection system. First, we introduce a soft-prompting approach that enables a single model to effectively handle multiple games by incorporating game-context tokens, matching the performance of more complex methods like curriculum learning while offering superior scalability. Second, we develop an LLM-assisted label transfer framework using GPT-4o-mini to extend support to seven additional languages. Evaluations on real game chat data across French, German, Portuguese, and Russian achieve macro F1-scores ranging from 32.96% to 58.88%, with particularly strong performance in German, surpassing the English benchmark of 45.39%. In production, this unified approach significantly reduces computational resources and maintenance overhead compared to maintaining separate models for each game and language combination. At Ubisoft, this model successfully identifies an average of 50 players, per game, per day engaging in sanctionable behavior.
Key facts. Cited by 5 papers in the map (data through 13 Oct 2026). Builds on 23 of its 60 references that are in the map. First posted on arXiv 1 Jun 2025.
Builds on
23 of 60 references.
References · 23
- 2020Language Models are Few-Shot Learnerscited by 32,320
- 2020Scaling Laws for Neural Language Modelscited by 6,494
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,657
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,999
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,898
- 2019SemEval-2019 Task 6: Identifying and Categorizing Offensive Language in Social Media (OffensEval)cited by 207
- 2022On Second Thought, Let's Not Think Step by Step! Bias and Toxicity in Zero-Shot Reasoningcited by 193
- 2022A New Generation of Perspective API: Efficient Multilingual Character-level Transformerscited by 185
- 2020Directions in Abusive Language Training Data: Garbage In, Garbage Outcited by 140
- 2022COLD: A Benchmark for Chinese Offensive Language Detectioncited by 75
- 2018Challenges for Toxic Comment Classification: An In-Depth Error Analysiscited by 56
- 2020Toxic Language Detection in Social Media for Brazilian Portuguese: New Dataset and Multilingual Analysiscited by 45
11 more
- 2023Facilitating Fine-grained Detection of Chinese Toxic Language: Hierarchical Taxonomy, Resources, and Benchmarkscited by 45
- 2021SWSR: A Chinese Dataset and Lexicon for Online Sexism Detectioncited by 42
- 2023Open, Closed, or Small Language Models for Text Classification?cited by 34
- 2017Anyone Can Become a Troll: Causes of Trolling Behavior in Online Discussionscited by 30
- 2024Can LLMs Recognize Toxicity? A Structured Investigation Framework and Toxicity Metriccited by 23
- 2023Efficient Toxic Content Detection by Bootstrapping and Distilling Large Language Modelscited by 21
- 2024Improving Adversarial Data Collection by Supporting Annotators: Lessons from GAHD, a German Hate Speech Datasetcited by 13
- 2023Toxicity Detection is NOT all you Need: Measuring the Gaps to Supporting Volunteer Content Moderatorscited by 10
- 2022Learning a Better Initialization for Soft Prompts via Meta-Learningcited by 9
- 2024Multi3Hate: Multimodal, Multilingual, and Multicultural Hate Speech Detection with Vision-Language Modelscited by 7
- 2023Towards Detecting Contextual Real-Time Toxicity for In-Game Chatcited by 4
Built on by
Citing papers per year: 2025: 1; 2026: 4.
5 papers.
- 2026When to Invoke: Refining LLM Fairness with Toxicity Assessmentcited by 2
- 2025Prosocial Behavior Detection in Player Game Chat: From Aligning Human-AI Definitions to Efficient Annotation at Scalecited by 1
- 2026Analyzing Bias in False Refusal Behavior of Large Language Models for Hate Speech Detoxificationcited by 1
- 2026Toxicity in Twitch Chats: An LLM-Based Analysis Across Gaming Communitiescited by 0
- 2026Language-Specific Gaps in AI Safety Training Datasetscited by 0
- 2026Language-Specific Gaps in AI Safety Training Datasets13 Aug 2026
- 2026Toxicity in Twitch Chats: An LLM-Based Analysis Across Gaming Communities18 May 2026
- 2026When to Invoke: Refining LLM Fairness with Toxicity Assessment14 Jan 2026
- 2026Analyzing Bias in False Refusal Behavior of Large Language Models for Hate Speech Detoxification13 Jan 2026
- 2025Prosocial Behavior Detection in Player Game Chat: From Aligning Human-AI Definitions to Efficient Annotation at Scale8 Aug 2025