mlsanityData to 14 Oct 2026

Lifelong Learning of Hate Speech Classification on Social Media

arXiv 2106.02821 ↗First posted 5 Jun 2021cs.CL cs.LGcited by 14

Not on the map. Why?

Abstract (arXiv)

Existing work on automated hate speech classification assumes that the dataset is fixed and the classes are pre-defined. However, the amount of data in social media increases every day, and the hot topics changes rapidly, requiring the classifiers to be able to continuously adapt to new data without forgetting the previously learned knowledge. This ability, referred to as lifelong learning, is crucial for the real-word application of hate speech classifiers in social media. In this work, we propose lifelong learning of hate speech classification on social media. To alleviate catastrophic forgetting, we propose to use Variational Representation Learning (VRL) along with a memory module based on LB-SOINN (Load-Balancing Self-Organizing Incremental Neural Network). Experimentally, we show that combining variational representation learning and the LB-SOINN memory module achieves better performance than the commonly-used lifelong learning techniques.

Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Builds on 18 of its 39 references that are in the map. First posted on arXiv 5 Jun 2021.

Builds on

18 of 39 references.

References · 18

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
  3. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
  4. 2017Gradient Episodic Memory for Continual Learningcited by 1,898
  5. 2016Progressive Neural Networkscited by 1,361
  6. 2018Efficient Lifelong Learning with A-GEMcited by 1,058
  7. 2017Automated Hate Speech Detection and the Problem of Offensive Languagecited by 736
  8. 2017PathNet: Evolution Channels Gradient Descent in Super Neural Networkscited by 364
  9. 2018Online Structured Laplace Approximations For Overcoming Catastrophic Forgettingcited by 201
  10. 2019Episodic Memory in Lifelong Language Learningcited by 188
  11. 2017Deep Learning for Hate Speech Detection in Tweetscited by 180
  12. 2019LAMOL: LAnguage MOdeling for Lifelong Language Learningcited by 160
6 more
  1. 2018Rotate your Networks: Better Weight Consolidation and Less Catastrophic Forgettingcited by 127
  2. 2019Sentence Embedding Alignment for Lifelong Relation Extractioncited by 70
  3. 2018Leveraging Intra-User and Inter-User Representation Learning for Automated Hate Speech Detectioncited by 25
  4. 2016Learning Natural Language Inference using Bidirectional LSTM model and Inner-Attentioncited by 23
  5. 2017Recognizing Explicit and Implicit Hate Speech Using a Weakly Supervised Two-path Bootstrapping Approachcited by 17
  6. 2018Hierarchical CVAE for Fine-Grained Hate Speech Classificationcited by 6

Built on by

Cited by year

Citing papers per year: 2021: 1; 2022: 5; 2023: 5; 2024: 1; 2025: 2.

14 papers.

Sort:

By area:

  1. 2021Latent Hatred: A Benchmark for Understanding Implicit Hate Speechcited by 217
  2. 2024Towards Lifelong Learning of Large Language Models: A Surveycited by 64
  3. 2022Handling Bias in Toxic Speech Detection: A Surveycited by 61
  4. 2023Goodtriever: Adaptive Toxicity Mitigation with Retrieval-augmented Modelscited by 23
  5. 2022KOLD: Korean Offensive Language Datasetcited by 14
  6. 2023Revisiting Hate Speech Benchmarks: From Data Curation to System Deploymentcited by 7
  7. 2022The State of Profanity Obfuscation in Natural Language Processingcited by 4
  8. 2023Hatemongers ride on echo chambers to escalate hate speech diffusioncited by 4
  9. 2022Anti-Asian Hate Speech Detection via Data Augmented Semantic Relation Inferencecited by 2
  10. 2023Towards a Unified Framework for Adaptable Problematic Content Detection via Continual Learningcited by 2
  11. 2022Going Extreme: Comparative Analysis of Hate Speech in Parler and Gabcited by 1
  12. 2023DoDo Learning: DOmain-DemOgraphic Transfer in Language Models for Detecting Abuse Targeted at Public Figurescited by 0
2 more
  1. 2025Hatevolution: What Static Benchmarks Don't Tell Uscited by 0
  2. 2025Knowledge-guided Continual Learning for Behavioral Analytics Systemscited by 0