mlsanityData to 7 Oct 2026

Detecting Harmful Content On Online Platforms: What Platforms Need Vs. Where Research Efforts Go

arXiv 2103.00153 ↗First posted 27 Feb 2021cs.CL cs.SIcited by 32

Not on the map. Why?

Abstract (arXiv)

The proliferation of harmful content on online platforms is a major societal problem, which comes in many different forms including hate speech, offensive language, bullying and harassment, misinformation, spam, violence, graphic content, sexual abuse, self harm, and many other. Online platforms seek to moderate such content to limit societal harm, to comply with legislation, and to create a more inclusive environment for their users. Researchers have developed different methods for automatically detecting harmful content, often focusing on specific sub-problems or on narrow communities, as what is considered harmful often depends on the platform and on the context. We argue that there is currently a dichotomy between what types of harmful content online platforms seek to curb, and what research efforts there are to automatically detect such content. We thus survey existing methods as well as content moderation policies by online platforms in this light and we suggest directions for future work.

Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). Builds on 44 of its 113 references that are in the map. First posted on arXiv 27 Feb 2021.

Builds on

44 of 113 references.

References · 44

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
  5. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  6. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
  7. 2018Deep contextualized word representationscited by 2,285
  8. 2019LXMERT: Learning Cross-Modality Encoder Representations from Transformerscited by 1,548
  9. 2019VisualBERT: A Simple and Performant Baseline for Vision and Languagecited by 1,291
  10. 2020Oscar: Object-Semantics Aligned Pre-training for Vision-Language Taskscited by 1,213
  11. 2019VL-BERT: Pre-training of Generic Visual-Linguistic Representationscited by 954
  12. 2017Automated Hate Speech Detection and the Problem of Offensive Languagecited by 724
32 more
  1. 2019Unified Vision-Language Pre-Training for Image Captioning and VQAcited by 494
  2. 2020The Hateful Memes Challenge: Detecting Hate Speech in Multimodal Memescited by 485
  3. 2020Large-Scale Adversarial Training for Vision-and-Language Representation Learningcited by 327
  4. 2019Predicting the Type and Target of Offensive Posts in Social Mediacited by 268
  5. 2018Large Scale Crowdsourcing and Characterization of Twitter Abusive Behaviorcited by 265
  6. 2020ERNIE-ViL: Knowledge Enhanced Vision-Language Representations Through Scene Graphcited by 211
  7. 2016Ex Machina: Personal Attacks Seen at Scalecited by 208
  8. 2019SemEval-2019 Task 6: Identifying and Categorizing Offensive Language in Social Media (OffensEval)cited by 206
  9. 2020Directions in Abusive Language Training Data: Garbage In, Garbage Outcited by 139
  10. 2020SemEval-2020 Task 12: Multilingual Offensive Language Identification in Social Media (OffensEval 2020)cited by 138
  11. 2019Multilingual and Multi-Aspect Hate Speech Analysiscited by 133
  12. 2017Understanding Abuse: A Typology of Abusive Language Detection Subtaskscited by 115
  13. 2019CONAN -- COunter NArratives through Nichesourcing: a Multilingual Dataset of Responses to Fight Online Hate Speechcited by 109
  14. 2020Fighting the COVID-19 Infodemic: Modeling the Perspective of Journalists, Fact-Checkers, Social Media Platforms, Policy Makers, and the Societycited by 72
  15. 2020Multilingual Offensive Language Identification with Cross-lingual Embeddingscited by 71
  16. 2020SOLID: A Large-Scale Semi-Supervised Dataset for Offensive Language Identificationcited by 53
  17. 2020Vilio: State-of-the-art Visio-Linguistic Models applied to Hateful Memescited by 50
  18. 2020Offensive Language Identification in Greekcited by 49
  19. 2019Offensive Language and Hate Speech Detection for Danishcited by 48
  20. 2020A Multimodal Framework for the Detection of Hateful Memescited by 48
  21. 2020Enhance Multimodal Transformer With External Label And In-Domain Pretrain: Hateful Meme Challenge Winning Solutioncited by 41
  22. 2018A Unified Deep Learning Architecture for Abuse Detectioncited by 37
  23. 2015Fame for sale: efficient detection of fake Twitter followerscited by 33
  24. 2019Hate Speech in Pixels: Detection of Offensive Memes towards Automatic Moderationcited by 29
  25. 2020Arabic Offensive Language on Twitter: Analysis and Experimentscited by 28
  26. 2018Convolutional Neural Networks for Toxic Comment Classificationcited by 21
  27. 2020A little goes a long way: Improving toxic language classification despite data scarcitycited by 12
  28. 2019"And We Will Fight For Our Race!" A Measurement Study of Genetic Testing Conversations on Reddit and 4chancited by 10
  29. 2019Predicting the Role of Political Trolls in Social Mediacited by 9
  30. 2019Hunting for Troll Comments in News Community Forumscited by 8
  31. 2020Hateful Memes Detection via Complementary Visual and Linguistic Networkscited by 7
  32. 2013Friend or Foe? Fake Profile Identification in Online Social Networkscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 4; 2024: 11; 2025: 11; 2026: 6.

32 papers.

Sort:

By area:

  1. 2023Can LLM-Generated Misinformation Be Detected?cited by 173
  2. 2023Use of LLMs for Illicit Purposes: Threats, Prevention Measures, and Vulnerabilitiescited by 76
  3. 2024MOSSBench: Is Your Multimodal Language Model Oversensitive to Safe Queries?cited by 28
  4. 2024Toxic Memes: A Survey of Computational Perspectives on the Detection and Explanation of Meme Toxicitiescited by 13
  5. 2025AfriHate: A Multilingual Collection of Hate Speech and Abusive Language Datasets for African Languagescited by 10
  6. 2024Target Span Detection for Implicit Harmful Contentcited by 8
  7. 2024Harmful YouTube Video Detection: A Taxonomy of Online Harm and MLLMs as Alternative Annotatorscited by 7
  8. 2024Harm Mitigation in Recommender Systems under User Preference Dynamicscited by 5
  9. 2024On the Risk of Evidence Pollution for Malicious Social Text Detection in the Era of LLMscited by 5
  10. 2025VSCBench: Bridging the Gap in Vision-Language Model Safety Calibrationcited by 5
  11. 2024Sensitive Content Classification in Social Media: A Holistic Resource and Evaluationcited by 4
  12. 2023Toxic language detection: a systematic review of Arabic datasetscited by 3
20 more
  1. 2024Leveraging Machine Learning to Identify Gendered Stereotypes and Body Image Concerns on Diet and Fitness Online Forumscited by 3
  2. 2025MemeSense: An Adaptive In-Context Framework for Social Commonsense Driven Meme Moderationcited by 3
  3. 2025Toxicity in Online Platforms and AI Systems: A Survey of Needs, Challenges, Mitigations, and Future Directionscited by 3
  4. 2023Why Should This Article Be Deleted? Transparent Stance Detection in Multilingual Wikipedia Editor Discussionscited by 2
  5. 2025Revealing Hidden Mechanisms of Cross-Country Content Moderation with Natural Language Processingcited by 2
  6. 2025Bridging Thoughts and Words: Graph-Based Intent-Semantic Joint Learning for Fake News Detectioncited by 2
  7. 2026With a Little Help From My Friends: Collective Manipulation in Risk-Controlling Recommender Systemscited by 2
  8. 2025Breaking the Cloak! Unveiling Chinese Cloaked Toxicity with Homophone Graph and Toxic Lexiconcited by 1
  9. 2025HatePRISM: Policies, Platforms, and Research Integration. Advancing NLP for Hate Speech Proactive Mitigationcited by 1
  10. 2026Multilingual Hate Speech Detection and Counterspeech Generation: A Comprehensive Survey and Practical Guidecited by 1
  11. 2024Towards Better Understanding of Cybercrime: The Role of Fine-Tuned LLMs in Translationcited by 0
  12. 2024The Unappreciated Role of Intent in Algorithmic Moderation of Social Media Contentcited by 0
  13. 2024Demarked: A Strategy for Enhanced Abusive Speech Moderation through Counterspeech, Detoxification, and Message Managementcited by 0
  14. 2025Silencing Empowerment, Allowing Bigotry: Auditing the Moderation of Hate Speech on Twitchcited by 0
  15. 2025Modeling Human Responses to Multimodal AI Contentcited by 0
  16. 2025System Report for CCL25-Eval Task 10: Prompt-Driven Large Language Model Merge for Fine-Grained Chinese Hate Speech Detectioncited by 0
  17. 2026Text Detoxification in isiXhosa and Yor`ub'a: A Cross-Lingual Machine Learning Approach for Low-Resource African Languagescited by 0
  18. 2026Detection of Illicit Content on Online Marketplaces using Large Language Modelscited by 0
  19. 2026Analyzing Toxic Behavior and Its Impact on the Mastodon Communitycited by 0
  20. 2026From Specialization to Generalization: Instruction-tuned LLMs for Robust Harmful Content Mitigationcited by 0