Predicting the Type and Target of Offensive Posts in Social Media
Not on the map. Why?
Cited by 24 in LLM safety and security, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
As offensive content has become pervasive in social media, there has been much research in identifying potentially offensive messages. However, previous work on this topic did not consider the problem as a whole, but rather focused on detecting very specific types of offensive content, e.g., hate speech, cyberbulling, or cyber-aggression. In contrast, here we target several different kinds of offensive content. In particular, we model the task hierarchically, identifying the type and the target of offensive messages in social media. For this purpose, we complied the Offensive Language Identification Dataset (OLID), a new dataset with tweets annotated for offensive content using a fine-grained three-layer annotation scheme, which we make publicly available. We discuss the main similarities and differences between OLID and pre-existing datasets for hate speech identification, aggression detection, and similar tasks. We further experiment with and we compare the performance of different machine learning models on OLID.
Key facts. Cited by 268 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 Feb 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 60; 2022: 51; 2023: 61; 2024: 50; 2025: 29; 2026: 17.
268 papers.
Sort:
By area:
- 2022ToxiGen: A Large-Scale Machine-Generated Dataset for Adversarial and Implicit Hate Speech Detectioncited by 419
- 2022A Holistic Approach to Undesired Content Detection in the Real Worldcited by 337
- 2021Annotators with Attitudes: How Annotator Beliefs And Identities Bias Toxic Language Detectioncited by 258
- 2023Large Language Model Alignment: A Surveycited by 241
- 2021Latent Hatred: A Benchmark for Understanding Implicit Hate Speechcited by 216
- 2021Hidden Killer: Invisible Textual Backdoor Attacks with Syntactic Triggercited by 203
- 2022BackdoorBench: A Comprehensive Benchmark of Backdoor Learningcited by 124
- 2022Fusing finetuned models for better pretrainingcited by 110
- 2023Revisiting Out-of-distribution Robustness in NLP: Benchmark, Analysis, and LLMs Evaluationscited by 96
- 2023Prompt as Triggers for Backdoor Attack: Examining the Vulnerability in Language Modelscited by 87
- 2021Turn the Combination Lock: Learnable Textual Backdoor Attacks via Word Substitutioncited by 85
- 2022COLD: A Benchmark for Chinese Offensive Language Detectioncited by 74
38 more
- 2021On the Safety of Conversational Models: Taxonomy, Dataset, and Benchmarkcited by 73
- 2024Safeguarding Large Language Models: A Surveycited by 73
- 2021Towards Unbiased and Accurate Deferral to Multiple Expertscited by 71
- 2021Agreeing to Disagree: Annotating Offensive Language Datasets with Annotators' Disagreementcited by 71
- 2023Large Language Models Can be Lazy Learners: Analyze Shortcuts in In-Context Learningcited by 69
- 2023Jais and Jais-chat: Arabic-Centric Foundation and Instruction-Tuned Open Generative Large Language Modelscited by 68
- 2021Towards generalisable hate speech detection: a review on obstacles and solutionscited by 66
- 2023Do LLMs Understand Social Knowledge? Evaluating the Sociability of Large Language Models with SocKET Benchmarkcited by 62
- 2021Triggerless Backdoor Attack for NLP Tasks with Clean Labelscited by 61
- 2022Detecting and Understanding Harmful Memes: A Surveycited by 58
- 2023Knowledge is a Region in Weight Space for Fine-tuned Language Modelscited by 58
- 2021Just Say No: Analyzing the Stance of Neural Dialogue Generation in Offensive Contextscited by 56
- 2022ColD Fusion: Collaborative Descent for Distributed Multitask Finetuningcited by 52
- 2022Multilingual HateCheck: Functional Tests for Multilingual Hate Speech Detection Modelscited by 51
- 2024Universal Vulnerabilities in Large Language Models: Backdoor Attacks for In-context Learningcited by 47
- 2021ConvAbuse: Data, Analysis, and Benchmarks for Nuanced Abuse Detection in Conversational AIcited by 46
- 2021Red Alarm for Pre-trained Models: Universal Vulnerability to Neuron-Level Backdoor Attackscited by 44
- 2023Exploring Cross-Cultural Differences in English Hate Speech Annotations: From Dataset Construction to Analysiscited by 44
- 2021Overview of the HASOC track at FIRE 2020: Hate Speech and Offensive Content Identification in Indo-European Languagescited by 38
- 2024A Survey of Recent Backdoor Attacks and Defenses in Large Language Modelscited by 36
- 2022Toxicity Detection with Generative Prompt-based Inferencecited by 35
- 2023COBRA Frames: Contextual Reasoning about Effects and Harms of Offensive Statementscited by 34
- 2021Detecting Harmful Content On Online Platforms: What Platforms Need Vs. Where Research Efforts Gocited by 32
- 2024Whispering Experts: Neural Interventions for Toxicity Mitigation in Language Modelscited by 31
- 2024AI Safety in Generative AI Large Language Models: A Surveycited by 31
- 2021MUDES: Multilingual Detection of Offensive Spanscited by 30
- 2021FBERT: A Neural Transformer for Identifying Offensive Contentcited by 30
- 2021Cross-lingual Offensive Language Identification for Low Resource Languages: The Case of Marathicited by 28
- 2023Robust Hate Speech Detection in Social Media: A Cross-Dataset Empirical Evaluationcited by 28
- 2021A systematic review of Hate Speech automatic detection using Natural Language Processingcited by 26
- 2022Evaluating Psychological Safety of Large Language Modelscited by 26
- 2023TrojText: Test-time Invisible Textual Trojan Insertioncited by 26
- 2023From Shortcuts to Triggers: Backdoor Defense with Denoised PoEcited by 26
- 2021A Large-scale Dataset for Hate Speech Detection on Vietnamese Social Media Textscited by 25
- 2023Defending against Insertion-based Textual Backdoor Attacks via Attributioncited by 24
- 2022APPDIA: A Discourse-aware Transformer-based Style Transfer Model for Offensive Social Media Conversationscited by 23
- 2022Where to start? Analyzing the potential value of intermediate modelscited by 23
- 2021Multilingual Offensive Language Identification for Low-resource Languagescited by 22
50 most cited of 268 All 268 (JSON)
- 2026From Specialization to Generalization: Instruction-tuned LLMs for Robust Harmful Content Mitigation26 Aug 2026
- 2026'Ghaib in Translation' aka Unseen Harm: Measuring Cross-Script Safety Inconsistency with 'Missed-in-Urdu' Scores in LLM Hate Speech Detection25 Aug 2026
- 2026The Cross-Domain Generalization Cost of Offensive Language Detection26 Jul 2026
- 2026From a Word-Level Dictionary to Sentence-Level Semantics: Multilingual Grievance Labelling with Contextual Models23 Jul 2026
- 2026Cascading versus Joint Modeling for Hierarchical Offensive Language Detection18 Jul 2026
- 2026Influence of Prompt Engineering on Small Language Models for Guarded Query Routing6 Jul 2026
- 2026Multilingual Polarization Detection Using Transformer-Based Models with Class Weighting and Threshold Tuning29 Jun 2026
- 2026Cross-National Information Attacks: A Two-Decade Analysis of Troll Behavior in Korea22 Jun 2026
- 2026ThreatCore: A Benchmark for Explicit and Implicit Threat Detection11 May 2026
- 2026Delayed Backdoor Attacks: Exploring the Temporal Dimension as a New Attack Surface in Pre-Trained Models12 Mar 2026
- 2026Multilingual Hate Speech Detection and Counterspeech Generation: A Comprehensive Survey and Practical Guide1 Mar 2026
- 2026NLP Privacy Risk Identification in Social Media (NLP-PRISM): A Survey26 Jan 2026
38 more
- 2026Beyond a Single Perspective: Text Anomaly Detection with Multi-View Language Representations25 Jan 2026
- 2026HateXScore: A Metric Suite for Evaluating Reasoning Quality in Hate Speech Explanations20 Jan 2026
- 2026Self-Explaining Hate Speech Detection with Moral Rationales7 Jan 2026
- 2026FC-CONAN: An Exhaustively Paired Dataset for Robust Evaluation of Retrieval Systems4 Jan 2026
- 2026Exploring the Performance of Large Language Models on Subjective Span Identification Tasks2 Jan 2026
- 2025Jailbreaking Attacks vs. Content Safety Filters: How Far Are We in the LLM Safety Arms Race?30 Dec 2025
- 2025A Multi-Perspective Benchmark and Moderation Model for Evaluating Safety and Adversarial Robustness22 Dec 2025
- 2025SteganoBackdoor: Evading Data-Poisoning Defenses via Steganographic Backdoors18 Nov 2025
- 2025HatePrototypes: Interpretable and Transferable Representations for Implicit and Explicit Hate Speech Detection9 Nov 2025
- 2025DeHate: A Stable Diffusion-based Multimodal Approach to Mitigate Hate Speech in Images26 Sep 2025
- 2025From Ground Trust to Truth: Disparities in Offensive Language Judgments on Contemporary Korean Political Discourse18 Sep 2025
- 2025Backdoor Samples Detection Based on Perturbation Discrepancy Consistency in Pre-trained Language Models30 Aug 2025
- 2025Towards Safer AI Moderation: Evaluating LLM Moderators Through a Unified Benchmark Dataset and Advocating a Human-First Approach9 Aug 2025
- 2025Offensive Language Detection on Social Media Using XLNet26 Jun 2025
- 2025MFTCXplain: A Multilingual Benchmark Dataset for Evaluating the Moral Reasoning of LLMs through Multi-hop Hate Speech Explanation23 Jun 2025
- 2025Towards Generalizable Generic Harmful Speech Datasets for Implicit Hate Speech Detection19 Jun 2025
- 2025Web(er) of Hate: A Survey on How Hate Speech Is Typed19 Jun 2025
- 2025K/DA: Automated Data Generation Pipeline for Detoxifying Implicitly Offensive Language in Korean16 Jun 2025
- 2025Rethinking Hate Speech Detection on Social Media: Can LLMs Replace Traditional Models?15 Jun 2025
- 2025Something Just Like TRuST : Toxicity Recognition of Span and Target2 Jun 2025
- 2025The Hidden Language of Harm: Examining the Role of Emojis in Harmful Online Communication and Content Moderation31 May 2025
- 2025Moderating Harm: Benchmarking Large Language Models for Cyberbullying Detection in YouTube Comments25 May 2025
- 2025Understanding and Analyzing Inappropriately Targeting Language in Online Discourse: A Comparative Annotation Study22 May 2025
- 2025Guarded Query Routing for Large Language Models20 May 2025
- 2025Towards a comprehensive taxonomy of online abusive language informed by machine leaning24 Apr 2025
- 2025Creating and Evaluating Code-Mixed Nepali-English and Telugu-English Datasets for Abusive Language Detection Using Traditional and Deep Learning Models23 Apr 2025
- 2025Combating Toxic Language: A Review of LLM-Based Strategies for Software Engineering21 Apr 2025
- 2025A Survey of Machine Learning Models and Datasets for the Multi-label Classification of Textual Hate Speech in English11 Apr 2025
- 2025SafeSpeech: A Comprehensive and Interactive Tool for Analysing Sexist and Abusive Language in Conversations9 Mar 2025
- 2025Cross-Modal Transfer from Memes to Videos: Addressing Data Scarcity in Hateful Video Detection26 Jan 2025
- 2025Open or Closed LLM for Lesser-Resourced Languages? Lessons from Greek22 Jan 2025
- 2025TAD-Bench: A Comprehensive Benchmark for Embedding-Based Text Anomaly Detection21 Jan 2025
- 2025AfriHate: A Multilingual Collection of Hate Speech and Abusive Language Datasets for African Languages14 Jan 2025
- 2025U-GIFT: Uncertainty-Guided Firewall for Toxic Speech in Few-Shot Scenario1 Jan 2025
- 2024Cut the Deadwood Out: Backdoor Purification via Guided Module Substitution29 Dec 2024
- 2024Invisible Textual Backdoor Attacks based on Dual-Trigger23 Dec 2024
- 2024Towards Efficient and Explainable Hate Speech Detection via Model Distillation18 Dec 2024
- 2024Exploring the Influence of Label Aggregation on Minority Voices: Implications for Dataset Bias and Model Training5 Dec 2024
50 newest of 268 All 268 (JSON)
- 2021Hidden Killer: Invisible Textual Backdoor Attacks with Syntactic Triggercited by 203
- 2023Prompt as Triggers for Backdoor Attack: Examining the Vulnerability in Language Modelscited by 87
- 2021Turn the Combination Lock: Learnable Textual Backdoor Attacks via Word Substitutioncited by 85
- 2024Safeguarding Large Language Models: A Surveycited by 73
- 2021Triggerless Backdoor Attack for NLP Tasks with Clean Labelscited by 61
- 2024Universal Vulnerabilities in Large Language Models: Backdoor Attacks for In-context Learningcited by 47
- 2024A Survey of Recent Backdoor Attacks and Defenses in Large Language Modelscited by 36
- 2023Defending against Insertion-based Textual Backdoor Attacks via Attributioncited by 24
- 2022Kallima: A Clean-label Framework for Textual Backdoor Attackscited by 22
- 2023Setting the Trap: Capturing and Defeating Backdoors in Pretrained Language Models through Honeypotscited by 16
- 2023IMBERT: Making BERT Immune to Insertion-based Backdoor Attackscited by 12
- 2023THOS: A Benchmark Dataset for Targeted Hate and Offensive Speechcited by 4
12 most cited of 23 All 23 (JSON)
- 2026From Specialization to Generalization: Instruction-tuned LLMs for Robust Harmful Content Mitigation26 Aug 2026
- 2026'Ghaib in Translation' aka Unseen Harm: Measuring Cross-Script Safety Inconsistency with 'Missed-in-Urdu' Scores in LLM Hate Speech Detection25 Aug 2026
- 2026Beyond a Single Perspective: Text Anomaly Detection with Multi-View Language Representations25 Jan 2026
- 2025Jailbreaking Attacks vs. Content Safety Filters: How Far Are We in the LLM Safety Arms Race?30 Dec 2025
- 2025A Multi-Perspective Benchmark and Moderation Model for Evaluating Safety and Adversarial Robustness22 Dec 2025
- 2025Backdoor Samples Detection Based on Perturbation Discrepancy Consistency in Pre-trained Language Models30 Aug 2025
- 2025Guarded Query Routing for Large Language Models20 May 2025
- 2024Invisible Textual Backdoor Attacks based on Dual-Trigger23 Dec 2024
- 2024A Survey of Recent Backdoor Attacks and Defenses in Large Language Models10 Jun 2024
- 2024Safeguarding Large Language Models: A Survey3 Jun 2024
- 2024Shortcuts Arising from Contrast: Effective and Covert Clean-Label Attacks in Prompt-Based Learning30 Mar 2024
- 2024Universal Vulnerabilities in Large Language Models: Backdoor Attacks for In-context Learning11 Jan 2024
12 newest of 23 All 23 (JSON)
- 2022ToKen: Task Decomposition and Knowledge Infusion for Few-Shot Hate Speech Detectioncited by 15
- 2025MFTCXplain: A Multilingual Benchmark Dataset for Evaluating the Moral Reasoning of LLMs through Multi-hop Hate Speech Explanationcited by 7
- 2025Rethinking Hate Speech Detection on Social Media: Can LLMs Replace Traditional Models?cited by 2
- 2022Rethinking Offensive Text Detection as a Multi-Hop Reasoning Problemcited by 1
- 2025MFTCXplain: A Multilingual Benchmark Dataset for Evaluating the Moral Reasoning of LLMs through Multi-hop Hate Speech Explanation23 Jun 2025
- 2025Rethinking Hate Speech Detection on Social Media: Can LLMs Replace Traditional Models?15 Jun 2025
- 2022ToKen: Task Decomposition and Knowledge Infusion for Few-Shot Hate Speech Detection25 May 2022
- 2022Rethinking Offensive Text Detection as a Multi-Hop Reasoning Problem22 Apr 2022
- 2022ToxiGen: A Large-Scale Machine-Generated Dataset for Adversarial and Implicit Hate Speech Detectioncited by 419
- 2022A Holistic Approach to Undesired Content Detection in the Real Worldcited by 337
- 2021Annotators with Attitudes: How Annotator Beliefs And Identities Bias Toxic Language Detectioncited by 258
- 2021Latent Hatred: A Benchmark for Understanding Implicit Hate Speechcited by 216
- 2022BackdoorBench: A Comprehensive Benchmark of Backdoor Learningcited by 124
- 2022Fusing finetuned models for better pretrainingcited by 110
- 2023Revisiting Out-of-distribution Robustness in NLP: Benchmark, Analysis, and LLMs Evaluationscited by 96
- 2022COLD: A Benchmark for Chinese Offensive Language Detectioncited by 74
- 2021On the Safety of Conversational Models: Taxonomy, Dataset, and Benchmarkcited by 73
- 2021Towards Unbiased and Accurate Deferral to Multiple Expertscited by 71
- 2021Agreeing to Disagree: Annotating Offensive Language Datasets with Annotators' Disagreementcited by 71
- 2023Large Language Models Can be Lazy Learners: Analyze Shortcuts in In-Context Learningcited by 69
12 most cited of 235 All 235 (JSON)
- 2026The Cross-Domain Generalization Cost of Offensive Language Detection26 Jul 2026
- 2026From a Word-Level Dictionary to Sentence-Level Semantics: Multilingual Grievance Labelling with Contextual Models23 Jul 2026
- 2026Cascading versus Joint Modeling for Hierarchical Offensive Language Detection18 Jul 2026
- 2026Influence of Prompt Engineering on Small Language Models for Guarded Query Routing6 Jul 2026
- 2026Multilingual Polarization Detection Using Transformer-Based Models with Class Weighting and Threshold Tuning29 Jun 2026
- 2026Cross-National Information Attacks: A Two-Decade Analysis of Troll Behavior in Korea22 Jun 2026
- 2026ThreatCore: A Benchmark for Explicit and Implicit Threat Detection11 May 2026
- 2026Delayed Backdoor Attacks: Exploring the Temporal Dimension as a New Attack Surface in Pre-Trained Models12 Mar 2026
- 2026Multilingual Hate Speech Detection and Counterspeech Generation: A Comprehensive Survey and Practical Guide1 Mar 2026
- 2026NLP Privacy Risk Identification in Social Media (NLP-PRISM): A Survey26 Jan 2026
- 2026HateXScore: A Metric Suite for Evaluating Reasoning Quality in Hate Speech Explanations20 Jan 2026
- 2026Self-Explaining Hate Speech Detection with Moral Rationales7 Jan 2026
12 newest of 235 All 235 (JSON)