Self-Anchored Attention Model for Sample-Efficient Classification of Prosocial Text Chat
Not on the map. Why?
Abstract (arXiv)
Millions of players engage daily in competitive online games, communicating through in-game chat. Prior research has focused on detecting relatively small volumes of toxic content using various Natural Language Processing (NLP) techniques for the purpose of moderation. However, recent studies emphasize the importance of detecting prosocial communication, which can be as crucial as identifying toxic interactions. Recognizing prosocial behavior allows for its analysis, rewarding, and promotion. Unlike toxicity, there are limited datasets, models, and resources for identifying prosocial behaviors in game-chat text. In this work, we employed unsupervised discovery combined with game domain expert collaboration to identify and categorize prosocial player behaviors from game chat. We further propose a novel Self-Anchored Attention Model (SAAM) which gives 7.9% improvement compared to the best existing technique. The approach utilizes the entire training set as "anchors" to help improve model performance under the scarcity of training data. This approach led to the development of the first automated system for classifying prosocial behaviors in in-game chats, particularly given the low-resource settings where large-scale labeled data is not available. Our methodology was applied to one of the most popular online gaming titles - Call of Duty(R): Modern Warfare(R)II, showcasing its effectiveness. This research is novel in applying NLP techniques to discover and classify prosocial behaviors in player in-game chat communication. It can help shift the focus of moderation from solely penalizing toxicity to actively encouraging positive interactions on online platforms.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 17 of its 71 references that are in the map. First posted on arXiv 10 Jun 2025.
Builds on
17 of 71 references.
References · 17
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,173
- 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,254
- 2020Recall and Learn: Fine-tuning Deep Pretrained Language Models with Less Forgettingcited by 170
- 2020CERT: Contrastive Self-supervised Learning for Language Understandingcited by 169
- 2022Efficient Few-Shot Learning Without Promptscited by 137
- 2023Self-Detoxifying Language Models via Toxification Reversalcited by 46
- 2021Few-shot Instruction Prompts for Pretrained Language Models to Detect Social Biasescited by 21
- 2024ChatGPT Based Data Augmentation for Improved Parameter-Efficient Debiasing of LLMscited by 18
- 2023BiasTestGPT: Using ChatGPT for Social Bias Testing of Language Modelscited by 8
- 2022Can You Label Less by Using Out-of-Domain Data? Active & Transfer Learning with Few-shot Instructionscited by 7
5 more
- 2020Anchor-based Bilingual Word Embeddings for Low-Resource Languagescited by 6
- 2024LLM Confidence Evaluation Measures in Zero-Shot CSS Classificationcited by 6
- 2019Augmenting and Tuning Knowledge Graph Embeddingscited by 4
- 2023One For All & All For One: Bypassing Hyperparameter Tuning with Model Averaging For Cross-Lingual Transfercited by 2
- 2021QUEST: Queue Simulation for Content Moderation at Scalecited by 1
Built on by
Citing papers per year: 2025: 1.
1 paper.