mlsanityData to 7 Oct 2026

FBERT: A Neural Transformer for Identifying Offensive Content

arXiv 2109.05074 ↗First posted 10 Sep 2021cs.CL cs.AI cs.LGcited by 30

Not on the map. Why?

Abstract (arXiv)

Transformer-based models such as BERT, XLNET, and XLM-R have achieved state-of-the-art performance across various NLP tasks including the identification of offensive language and hate speech, an important problem in social media. In this paper, we present fBERT, a BERT model retrained on SOLID, the largest English offensive language identification corpus available with over 1.4 million offensive instances. We evaluate fBERT's performance on identifying offensive content on multiple English datasets and we test several thresholds for selecting instances from SOLID. The fBERT model will be made freely available to the community.

Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). Builds on 19 of its 29 references that are in the map. First posted on arXiv 10 Sep 2021.

Builds on

19 of 29 references.

References · 19

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  3. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  4. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
  5. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
  6. 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,471
  7. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
  8. 2015Aligning Books and Movies: Towards Story-like Visual Explanations by Watching Movies and Reading Bookscited by 1,041
  9. 2017Automated Hate Speech Detection and the Problem of Offensive Languagecited by 724
  10. 2019FinBERT: Financial Sentiment Analysis with Pre-trained Language Modelscited by 378
  11. 2020BERTweet: A pre-trained language model for English Tweetscited by 346
  12. 2019Predicting the Type and Target of Offensive Posts in Social Mediacited by 268
7 more
  1. 2019SemEval-2019 Task 6: Identifying and Categorizing Offensive Language in Social Media (OffensEval)cited by 206
  2. 2020HateBERT: Retraining BERT for Abusive Language Detection in Englishcited by 206
  3. 2020SemEval-2020 Task 12: Multilingual Offensive Language Identification in Social Media (OffensEval 2020)cited by 138
  4. 2020Multilingual Offensive Language Identification with Cross-lingual Embeddingscited by 71
  5. 2020SOLID: A Large-Scale Semi-Supervised Dataset for Offensive Language Identificationcited by 53
  6. 2017Detecting Hate Speech in Social Mediacited by 42
  7. 2021MUDES: Multilingual Detection of Offensive Spanscited by 30

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 1; 2022: 6; 2023: 7; 2024: 11; 2025: 1; 2026: 4.

30 papers.

Sort:

By area:

  1. 2023HARE: Explainable Hate Speech Detection with Step-by-Step Reasoningcited by 30
  2. 2023ToViLaG: Your Visual-Language Generative Model is Also An Evildoercited by 27
  3. 2023Offensive Language Identification in Transliterated and Code-Mixed Banglacited by 12
  4. 2024NaijaHate: Evaluating Hate Speech Detection on Nigerian Twitter Using Representative Datacited by 9
  5. 2021Character-level HyperNetworks for Hate Speech Detectioncited by 7
  6. 2024"Define Your Terms" : Enhancing Efficient Offensive Speech Classification with Definitioncited by 7
  7. 2024DefVerify: Do Hate Speech Models Reflect Their Dataset's Definition?cited by 6
  8. 2022BERT(s) to Detect Multiword Expressionscited by 5
  9. 2022Overview of the HASOC Subtrack at FIRE 2022: Offensive Language Identification in Marathicited by 5
  10. 2022Predicting the Type and Target of Offensive Social Media Posts in Marathicited by 5
  11. 2023OffMix-3L: A Novel Code-Mixed Dataset in Bangla-English-Hindi for Offensive Language Identificationcited by 5
  12. 2022Spread Love Not Hate: Undermining the Importance of Hateful Pre-training for Hate Speech Detectioncited by 4
18 more
  1. 2023Mixed-Distil-BERT: Code-mixed Language Modeling for Bangla, English, and Hindicited by 4
  2. 2024HateCOT: An Explanation-Enhanced Dataset for Generalizable Offensive Speech Detection via Large Language Modelscited by 4
  3. 2024A Federated Learning Approach to Privacy Preserving Offensive Language Identificationcited by 4
  4. 2024Label-aware Hard Negative Sampling Strategies with Momentum Contrastive Learning for Implicit Hate Speech Detectioncited by 4
  5. 2022A Twitter BERT Approach for Offensive Language Detection in Marathicited by 3
  6. 2023A Text-to-Text Model for Multilingual Offensive Language Identificationcited by 3
  7. 2024MasonPerplexity at ClimateActivism 2024: Integrating Advanced Ensemble Techniques and Data Augmentation for Climate Activism Stance and Hate Event Identificationcited by 3
  8. 2024ViHateT5: Enhancing Hate Speech Detection in Vietnamese With A Unified Text-to-Text Transformer Modelcited by 3
  9. 2022SOLD: Sinhala Offensive Language Datasetcited by 2
  10. 2024Trustworthy Hate Speech Detection Through Visual Augmentationcited by 2
  11. 2024A Federated Approach to Few-Shot Hate Speech Detection for Marginalized Communitiescited by 2
  12. 2023Improving Cross-Domain Hate Speech Generalizability with Emotion Knowledgecited by 1
  13. 2024Towards Generalized Offensive Language Identificationcited by 1
  14. 2026MatchLM2Lite: A Scalable MLLM-to-Lite Framework for Reproduced Content Identificationcited by 1
  15. 2025SMARTER: A Data-efficient Framework to Improve Toxicity Detection with Explanation via Self-augmenting Large Language Modelscited by 0
  16. 2026Exploring the Performance of Large Language Models on Subjective Span Identification Taskscited by 0
  17. 2026ToxiTrace: Gradient-Aligned Training for Explainable Chinese Toxicity Detectioncited by 0
  18. 2026Old Tricks, New Models: How Simple Image Transformations Break Modern AI-based Content Moderationcited by 0