Deep Learning Models for Multilingual Hate Speech Detection
Not on the map. Why?
Abstract (arXiv)
Hate speech detection is a challenging problem with most of the datasets available in only one language: English. In this paper, we conduct a large scale analysis of multilingual hate speech in 9 languages from 16 different sources. We observe that in low resource setting, simple models such as LASER embedding with logistic regression performs the best, while in high resource setting BERT based models perform better. In case of zero-shot classification, languages such as Italian and Portuguese achieve good results. Our proposed framework could be used as an efficient solution for low-resource languages. These models could also act as good baselines for future multilingual hate speech detection tasks. We have made our code and experimental settings public for other researchers at https://github.com/punyajoy/DE-LIMIT.
Key facts. Cited by 49 papers in the map (data through 7 Oct 2026). First posted on arXiv 14 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 12; 2022: 11; 2023: 5; 2024: 13; 2025: 6; 2026: 2.
49 papers.
Sort:
By area:
- 2022A Holistic Approach to Undesired Content Detection in the Real Worldcited by 337
- 2021What's in the Box? A Preliminary Analysis of Undesirable Content in the Common Crawl Corpuscited by 79
- 2022Is Your Toxicity My Toxicity? Exploring the Impact of Rater Identity on Toxicity Annotationcited by 67
- 2021Language-Driven Image Style Transfercited by 36
- 2022Tell Me What Happened: Unifying Text-guided Video Completion via Multimodal Masked Video Generationcited by 32
- 2021A systematic review of Hate Speech automatic detection using Natural Language Processingcited by 26
- 2021Hate and Offensive Speech Detection in Hindi and Marathicited by 17
- 2024ToxiCraft: A Novel Framework for Synthetic Generation of Harmful Informationcited by 17
- 2021"Short is the Road that Leads from Fear to Hate": Fear Speech in Indian WhatsApp Groupscited by 13
- 2024MultiParaDetox: Extending Text Detoxification with Parallel Data to New Languagescited by 13
- 2024HateDay: Insights from a Global Hate Speech Dataset Representative of a Day on Twittercited by 12
- 2021Lex Rosetta: Transfer of Predictive Models Across Languages, Jurisdictions, and Legal Domainscited by 11
37 more
- 2024BanTH: A Multi-label Hate Speech Detection Dataset for Transliterated Banglacited by 10
- 2021Bangla Natural Language Processing: A Comprehensive Analysis of Classical, Machine Learning, and Deep Learning Based Methodscited by 8
- 2021IIITT@LT-EDI-EACL2021-Hope Speech Detection: There is always Hope in Transformerscited by 6
- 2021One to rule them all: Towards Joint Indic Language Hate Speech Detectioncited by 6
- 2021Abusive and Threatening Language Detection in Urdu using Boosting based and BERT based models: A Comparative Approachcited by 6
- 2022BLUE at Memotion 2.0 2022: You have my Image, my Text and my Transformercited by 5
- 2024Guardians of Discourse: Evaluating LLMs on Multilingual Offensive Language Detectioncited by 5
- 2024ToxiLab: How Well Do Open-Source LLMs Generate Synthetic Toxicity Data?cited by 5
- 2021Cross-lingual hate speech detection based on multilingual domain-specific word embeddingscited by 4
- 2022Which one is more toxic? Findings from Jigsaw Rate Severity of Toxic Commentscited by 4
- 2022Manifestations of Xenophobia in AI Systemscited by 4
- 2023Muted: Multilingual Targeted Offensive Speech Identification and Visualizationcited by 4
- 2024Exploring the Adversarial Capabilities of Large Language Modelscited by 4
- 2025MOLE: Metadata Extraction and Validation in Scientific Papers Using LLMscited by 4
- 2022Highly Generalizable Models for Multilingual Hate Speech Detectioncited by 3
- 2022A Review of Challenges in Machine Learning based Automated Hate Speech Detectioncited by 3
- 2022Human-in-the-Loop Hate Speech Classification in a Multilingual Contextcited by 3
- 2023Hate Speech and Offensive Content Detection in Indo-Aryan Languages: A Battle of LSTM and Transformerscited by 3
- 2023Toxic language detection: a systematic review of Arabic datasetscited by 3
- 2024Cross-lingual Offensive Language Detection: A Systematic Review of Datasets, Transfer Approaches and Challengescited by 2
- 2024DIVERSE: A Dataset of YouTube Video Comment Stances with a Data Programming Modelcited by 2
- 2025A Survey of Machine Learning Models and Datasets for the Multi-label Classification of Textual Hate Speech in Englishcited by 2
- 2025Data-Efficient Hate Speech Detection via Cross-Lingual Nearest Neighbor Retrieval with Limited Labeled Datacited by 2
- 2025Toxicity Red-Teaming: Benchmarking LLM Safety in Singapore's Low-Resource Languagescited by 2
- 2021MIPT-NSU-UTMN at SemEval-2021 Task 5: Ensembling Learning with Pre-trained Language Models for Toxic Spans Detectioncited by 1
- 2022Going Extreme: Comparative Analysis of Hate Speech in Parler and Gabcited by 1
- 2024English offensive text detection using CNN based Bi-GRU modelcited by 1
- 2025Multilingual Hate Speech Detection in Social Media Using Translation-Based Approaches with Large Language Modelscited by 1
- 2026Multilingual Hate Speech Detection and Counterspeech Generation: A Comprehensive Survey and Practical Guidecited by 1
- 2022Large Language Models for Multi-label Propaganda Detectioncited by 0
- 2023Cordyceps@LT-EDI: Patching Language-Specific Homophobia/Transphobia Classifiers with a Multilingual Understandingcited by 0
- 2023Anti-Sexism Alert System: Identification of Sexist Comments on Social Media Using AI Techniquescited by 0
- 2024Efficient Models for the Detection of Hate, Abuse and Profanitycited by 0
- 2024AggregHate: An Efficient Aggregative Approach for the Detection of Hatemongers on Social Platformscited by 0
- 2024HateGPT: Unleashing GPT-3.5 Turbo to Combat Hate Speech on Xcited by 0
- 2025Social Hatred: Efficient Multimodal Detection of Hatemongerscited by 0
- 2026LLMs-Integrated Automatic Hate Speech Recognition Using Controllable Text Generation Modelscited by 0
- 2026Multilingual Hate Speech Detection and Counterspeech Generation: A Comprehensive Survey and Practical Guide1 Mar 2026
- 2026LLMs-Integrated Automatic Hate Speech Recognition Using Controllable Text Generation Models8 Jan 2026
- 2025Toxicity Red-Teaming: Benchmarking LLM Safety in Singapore's Low-Resource Languages18 Sep 2025
- 2025Social Hatred: Efficient Multimodal Detection of Hatemongers24 Jun 2025
- 2025Multilingual Hate Speech Detection in Social Media Using Translation-Based Approaches with Large Language Models9 Jun 2025
- 2025MOLE: Metadata Extraction and Validation in Scientific Papers Using LLMs26 May 2025
- 2025Data-Efficient Hate Speech Detection via Cross-Lingual Nearest Neighbor Retrieval with Limited Labeled Data20 May 2025
- 2025A Survey of Machine Learning Models and Datasets for the Multi-label Classification of Textual Hate Speech in English11 Apr 2025
- 2024HateDay: Insights from a Global Hate Speech Dataset Representative of a Day on Twitter23 Nov 2024
- 2024ToxiLab: How Well Do Open-Source LLMs Generate Synthetic Toxicity Data?18 Nov 2024
- 2024HateGPT: Unleashing GPT-3.5 Turbo to Combat Hate Speech on X14 Nov 2024
- 2024Guardians of Discourse: Evaluating LLMs on Multilingual Offensive Language Detection21 Oct 2024
37 more
- 2024BanTH: A Multi-label Hate Speech Detection Dataset for Transliterated Bangla17 Oct 2024
- 2024English offensive text detection using CNN based Bi-GRU model24 Sep 2024
- 2024ToxiCraft: A Novel Framework for Synthetic Generation of Harmful Information23 Sep 2024
- 2024AggregHate: An Efficient Aggregative Approach for the Detection of Hatemongers on Social Platforms22 Sep 2024
- 2024MultiParaDetox: Extending Text Detoxification with Parallel Data to New Languages2 Apr 2024
- 2024DIVERSE: A Dataset of YouTube Video Comment Stances with a Data Programming Model5 Mar 2024
- 2024Exploring the Adversarial Capabilities of Large Language Models14 Feb 2024
- 2024Efficient Models for the Detection of Hate, Abuse and Profanity8 Feb 2024
- 2024Cross-lingual Offensive Language Detection: A Systematic Review of Datasets, Transfer Approaches and Challenges17 Jan 2024
- 2023Muted: Multilingual Targeted Offensive Speech Identification and Visualization18 Dec 2023
- 2023Toxic language detection: a systematic review of Arabic datasets12 Dec 2023
- 2023Hate Speech and Offensive Content Detection in Indo-Aryan Languages: A Battle of LSTM and Transformers9 Dec 2023
- 2023Anti-Sexism Alert System: Identification of Sexist Comments on Social Media Using AI Techniques28 Nov 2023
- 2023Cordyceps@LT-EDI: Patching Language-Specific Homophobia/Transphobia Classifiers with a Multilingual Understanding24 Sep 2023
- 2022Manifestations of Xenophobia in AI Systems15 Dec 2022
- 2022Human-in-the-Loop Hate Speech Classification in a Multilingual Context5 Dec 2022
- 2022Tell Me What Happened: Unifying Text-guided Video Completion via Multimodal Masked Video Generation23 Nov 2022
- 2022Large Language Models for Multi-label Propaganda Detection15 Oct 2022
- 2022A Review of Challenges in Machine Learning based Automated Hate Speech Detection12 Sep 2022
- 2022A Holistic Approach to Undesired Content Detection in the Real World5 Aug 2022
- 2022Which one is more toxic? Findings from Jigsaw Rate Severity of Toxic Comments27 Jun 2022
- 2022Is Your Toxicity My Toxicity? Exploring the Impact of Rater Identity on Toxicity Annotation1 May 2022
- 2022BLUE at Memotion 2.0 2022: You have my Image, my Text and my Transformer15 Feb 2022
- 2022Going Extreme: Comparative Analysis of Hate Speech in Parler and Gab27 Jan 2022
- 2022Highly Generalizable Models for Multilingual Hate Speech Detection27 Jan 2022
- 2021Lex Rosetta: Transfer of Predictive Models Across Languages, Jurisdictions, and Legal Domains15 Dec 2021
- 2021Abusive and Threatening Language Detection in Urdu using Boosting based and BERT based models: A Comparative Approach27 Nov 2021
- 2021Hate and Offensive Speech Detection in Hindi and Marathi23 Oct 2021
- 2021One to rule them all: Towards Joint Indic Language Hate Speech Detection28 Sep 2021
- 2021Language-Driven Image Style Transfer1 Jun 2021
- 2021Bangla Natural Language Processing: A Comprehensive Analysis of Classical, Machine Learning, and Deep Learning Based Methods31 May 2021
- 2021A systematic review of Hate Speech automatic detection using Natural Language Processing22 May 2021
- 2021What's in the Box? A Preliminary Analysis of Undesirable Content in the Common Crawl Corpus6 May 2021
- 2021Cross-lingual hate speech detection based on multilingual domain-specific word embeddings30 Apr 2021
- 2021IIITT@LT-EDI-EACL2021-Hope Speech Detection: There is always Hope in Transformers19 Apr 2021
- 2021MIPT-NSU-UTMN at SemEval-2021 Task 5: Ensembling Learning with Pre-trained Language Models for Toxic Spans Detection10 Apr 2021
- 2021"Short is the Road that Leads from Fear to Hate": Fear Speech in Indian WhatsApp Groups7 Feb 2021
- 2022A Holistic Approach to Undesired Content Detection in the Real Worldcited by 337
- 2021What's in the Box? A Preliminary Analysis of Undesirable Content in the Common Crawl Corpuscited by 79
- 2022Is Your Toxicity My Toxicity? Exploring the Impact of Rater Identity on Toxicity Annotationcited by 67
- 2021Language-Driven Image Style Transfercited by 36
- 2022Tell Me What Happened: Unifying Text-guided Video Completion via Multimodal Masked Video Generationcited by 32
- 2021A systematic review of Hate Speech automatic detection using Natural Language Processingcited by 26
- 2021Hate and Offensive Speech Detection in Hindi and Marathicited by 17
- 2021"Short is the Road that Leads from Fear to Hate": Fear Speech in Indian WhatsApp Groupscited by 13
- 2024MultiParaDetox: Extending Text Detoxification with Parallel Data to New Languagescited by 13
- 2024HateDay: Insights from a Global Hate Speech Dataset Representative of a Day on Twittercited by 12
- 2021Lex Rosetta: Transfer of Predictive Models Across Languages, Jurisdictions, and Legal Domainscited by 11
- 2024BanTH: A Multi-label Hate Speech Detection Dataset for Transliterated Banglacited by 10
12 most cited of 47 All 47 (JSON)
- 2026Multilingual Hate Speech Detection and Counterspeech Generation: A Comprehensive Survey and Practical Guide1 Mar 2026
- 2026LLMs-Integrated Automatic Hate Speech Recognition Using Controllable Text Generation Models8 Jan 2026
- 2025Social Hatred: Efficient Multimodal Detection of Hatemongers24 Jun 2025
- 2025Multilingual Hate Speech Detection in Social Media Using Translation-Based Approaches with Large Language Models9 Jun 2025
- 2025MOLE: Metadata Extraction and Validation in Scientific Papers Using LLMs26 May 2025
- 2025Data-Efficient Hate Speech Detection via Cross-Lingual Nearest Neighbor Retrieval with Limited Labeled Data20 May 2025
- 2025A Survey of Machine Learning Models and Datasets for the Multi-label Classification of Textual Hate Speech in English11 Apr 2025
- 2024HateDay: Insights from a Global Hate Speech Dataset Representative of a Day on Twitter23 Nov 2024
- 2024ToxiLab: How Well Do Open-Source LLMs Generate Synthetic Toxicity Data?18 Nov 2024
- 2024HateGPT: Unleashing GPT-3.5 Turbo to Combat Hate Speech on X14 Nov 2024
- 2024Guardians of Discourse: Evaluating LLMs on Multilingual Offensive Language Detection21 Oct 2024
- 2024BanTH: A Multi-label Hate Speech Detection Dataset for Transliterated Bangla17 Oct 2024
12 newest of 47 All 47 (JSON)