How to Solve Few-Shot Abusive Content Detection Using the Data We Actually Have
Not on the map. Why?
Abstract (arXiv)
Due to the broad range of social media platforms, the requirements of abusive language detection systems are varied and ever-changing. Already a large set of annotated corpora with different properties and label sets were created, such as hate or misogyny detection, but the form and targets of abusive speech are constantly evolving. Since, the annotation of new corpora is expensive, in this work we leverage datasets we already have, covering a wide range of tasks related to abusive language detection. Our goal is to build models cheaply for a new target label set and/or language, using only a few training examples of the target domain. We propose a two-step approach: first we train our model in a multitask fashion. We then carry out few-shot adaptation to the target requirements. Our experiments show that using already existing datasets and only a few-shots of the target task the performance of models improve both monolingually and across languages. Our analysis also shows that our models acquire a general understanding of abusive language, since they improve the prediction of labels which are present only in the target dataset and can benefit from knowledge about labels which are not directly used for the target task.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 42 references that are in the map. First posted on arXiv 23 May 2023.
Builds on
21 of 42 references.
References · 21
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,565
- 2020Meta-Learning in Neural Networks: A Surveycited by 950
- 2020Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inferencecited by 938
- 2020AdapterFusion: Non-Destructive Task Composition for Transfer Learningcited by 788
- 2019Predicting the Type and Target of Offensive Posts in Social Mediacited by 271
- 2018Large Scale Crowdsourcing and Characterization of Twitter Abusive Behaviorcited by 270
- 2020HateCheck: Functional Tests for Hate Speech Detection Modelscited by 216
- 2018Hate Speech Dataset from a White Supremacy Forumcited by 198
- 2021OpenPrompt: An Open-source Framework for Prompt-learningcited by 148
9 more
- 2020Directions in Abusive Language Training Data: Garbage In, Garbage Outcited by 140
- 2019Multilingual and Multi-Aspect Hate Speech Analysiscited by 133
- 2020Multilingual Offensive Language Identification with Cross-lingual Embeddingscited by 71
- 2021Bridging Multi-Task Learning and Meta-Learning: Towards Efficient Training and Effective Adaptationcited by 50
- 2021Discrete and Soft Prompting for Multilingual Modelscited by 49
- 2020Toxic Language Detection in Social Media for Brazilian Portuguese: New Dataset and Multilingual Analysiscited by 45
- 2020A Closer Look at Few-Shot Crosslingual Transfer: The Choice of Shots Matterscited by 45
- 2021FewNLU: Benchmarking State-of-the-Art Methods for Few-Shot Natural Language Understandingcited by 17
- 2022Learning Label Modular Prompts for Text Classification in the Wildcited by 3
Built on by
Not cited yet.