Which one is more toxic? Findings from Jigsaw Rate Severity of Toxic Comments
Not on the map. Why?
Abstract (arXiv)
The proliferation of online hate speech has necessitated the creation of algorithms which can detect toxicity. Most of the past research focuses on this detection as a classification task, but assigning an absolute toxicity label is often tricky. Hence, few of the past works transform the same task into a regression. This paper shows the comparative evaluation of different transformers and traditional machine learning models on a recently released toxicity severity measurement dataset by Jigsaw. We further demonstrate the issues with the model predictions using explainability analysis.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 21 of its 30 references that are in the map. First posted on arXiv 27 Jun 2022.
Builds on
21 of 30 references.
References · 21
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2020MPNet: Masked and Permuted Pre-training for Language Understandingcited by 981
- 2017Automated Hate Speech Detection and the Problem of Offensive Languagecited by 736
- 2014Distributed Representations of Sentences and Documentscited by 678
- 2020TweetEval: Unified Benchmark and Comparative Evaluation for Tweet Classificationcited by 417
- 2020HateXplain: A Benchmark Dataset for Explainable Hate Speech Detectioncited by 407
- 2018Large Scale Crowdsourcing and Characterization of Twitter Abusive Behaviorcited by 270
- 2020HateBERT: Retraining BERT for Abusive Language Detection in Englishcited by 207
- 2017Best-Worst Scaling More Reliable than Rating Scales: A Case Study on Sentiment Intensity Annotationcited by 79
9 more
- 2020Measuring a hate speech spectrum with faceted Rasch item response theory and perspective-aware, explainable-by-design deep learningcited by 68
- 2020Deep Learning Models for Multilingual Hate Speech Detectioncited by 49
- 2021Ruddit: Norms of Offensiveness for English Reddit Commentscited by 27
- 2022Data Bootstrapping Approaches to Improve Low Resource Abusive Language Detection for Indic Languagescited by 23
- 2021"Short is the Road that Leads from Fear to Hate": Fear Speech in Indian WhatsApp Groupscited by 13
- 2021You too Brutus! Trapping Hateful Users in Social Media: Challenges, Solutions & Insightscited by 11
- 2021Exploring Transformer Based Models to Identify Hate Speech and Offensive Content in English and Indo-Aryan Languagescited by 9
- 2021Abusive and Threatening Language Detection in Urdu using Boosting based and BERT based models: A Comparative Approachcited by 6
- 2022hate-alert@DravidianLangTech-ACL2022: Ensembling Multi-Modalities for Tamil TrollMeme Classificationcited by 2
Built on by
Citing papers per year: 2023: 2; 2024: 1; 2025: 1.
4 papers.
- 2023Levels of AGI for Operationalizing Progress on the Path to AGIcited by 96
- 2024Towards Building Specialized Generalist AI with System 1 and System 2 Fusioncited by 8
- 2023Toxic language detection: a systematic review of Arabic datasetscited by 3
- 2025AdaPRL: Adaptive Pairwise Regression Learning with Uncertainty Estimation for Universal Regression Taskscited by 0
- 2025AdaPRL: Adaptive Pairwise Regression Learning with Uncertainty Estimation for Universal Regression Tasks10 Jan 2025
- 2024Towards Building Specialized Generalist AI with System 1 and System 2 Fusion11 Jul 2024
- 2023Toxic language detection: a systematic review of Arabic datasets12 Dec 2023
- 2023Levels of AGI for Operationalizing Progress on the Path to AGI4 Nov 2023