UoT-UWF-PartAI at SemEval-2021 Task 5: Self Attention Based Bi-GRU with Multi-Embedding Representation for Toxicity Highlighter
Not on the map. Why?
Abstract (arXiv)
Toxic Spans Detection(TSD) task is defined as highlighting spans that make a text toxic. Many works have been done to classify a given comment or document as toxic or non-toxic. However, none of those proposed models work at the token level. In this paper, we propose a self-attention-based bidirectional gated recurrent unit(BiGRU) with a multi-embedding representation of the tokens. Our proposed model enriches the representation by a combination of GPT-2, GloVe, and RoBERTa embeddings, which led to promising results. Experimental results show that our proposed approach is very effective in detecting span tokens.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 15 references that are in the map. First posted on arXiv 27 Apr 2021.
Builds on
9 of 15 references.
References · 9
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
- 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,367
- 2016Enriching Word Vectors with Subword Informationcited by 1,583
- 2015Effective Approaches to Attention-based Neural Machine Translationcited by 1,026
- 2017Deep Learning for Hate Speech Detection in Tweetscited by 180
- 2019Fine-Grained Analysis of Propaganda in News Articlescited by 133
- 2018Challenges for Toxic Comment Classification: An In-Depth Error Analysiscited by 56
Built on by
Not cited yet.