mlsanityData to 7 Oct 2026

Towards Detecting Contextual Real-Time Toxicity for In-Game Chat

arXiv 2310.18330 ↗First posted 20 Oct 2023cs.CL cs.AI cs.LGcited by 4

Not on the map. Why?

Abstract (arXiv)

Real-time toxicity detection in online environments poses a significant challenge, due to the increasing prevalence of social media and gaming platforms. We introduce ToxBuster, a simple and scalable model that reliably detects toxic content in real-time for a line of chat by including chat history and metadata. ToxBuster consistently outperforms conventional toxicity models across popular multiplayer games, including Rainbow Six Siege, For Honor, and DOTA 2. We conduct an ablation study to assess the importance of each model component and explore ToxBuster's transferability across the datasets. Furthermore, we showcase ToxBuster's efficacy in post-game moderation, successfully flagging 82.1% of chat-reported players at a precision level of 90.0%. Additionally, we show how an additional 6% of unreported toxic players can be proactively moderated.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 13 of its 40 references that are in the map. First posted on arXiv 20 Oct 2023.

Builds on

13 of 40 references.

References · 13

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language (Technology) is Power: A Critical Survey of "Bias" in NLPcited by 951
  3. 2019On Measuring Social Biases in Sentence Encoderscited by 397
  4. 2018Examining Gender and Race Bias in Two Hundred Sentiment Analysis Systemscited by 234
  5. 2022A New Generation of Perspective API: Efficient Multilingual Character-level Transformerscited by 181
  6. 2020Toxicity Detection: Does Context Really Matter?cited by 93
  7. 2017Detecting Online Hate Speech Using Context Aware Modelscited by 72
  8. 2018Challenges for Toxic Comment Classification: An In-Depth Error Analysiscited by 55
  9. 2017One-step and Two-step Classification for Abusive Language Detection on Twittercited by 46
  10. 2022Hate Speech and Counter Speech Detection: Conversational Context Does Mattercited by 32
  11. 2018Convolutional Neural Networks for Toxic Comment Classificationcited by 21
  12. 2021CONDA: a CONtextual Dual-Annotated dataset for in-game toxicity understanding and detectioncited by 14
1 more
  1. 2020Measuring and Characterizing Hate Speech on News Websitescited by 12

Built on by

Cited by year

Citing papers per year: 2025: 4.

4 papers.

  1. 2025Unified Game Moderation: Soft-Prompting and LLM-Assisted Label Transfer for Resource-Efficient Toxicity Detectioncited by 5
  2. 2025Context-Aware Toxicity Detection in Multiplayer Games: Integrating Domain-Adaptive Pretraining and Match Metadatacited by 0
  3. 2025On the Sensitivity of Instruction-tuned LLMs to Harmful Sentences in Long Inputscited by 0
  4. 2025HatePrototypes: Interpretable and Transferable Representations for Implicit and Explicit Hate Speech Detectioncited by 0