mlsanityData to 14 Oct 2026

KUISAIL at SemEval-2020 Task 12: BERT-CNN for Offensive Speech Identification in Social Media

arXiv 2007.13184 ↗First posted 26 Jul 2020cs.CLcited by 84

Not on the map. Why?

Abstract (arXiv)

In this paper, we describe our approach to utilize pre-trained BERT models with Convolutional Neural Networks for sub-task A of the Multilingual Offensive Language Identification shared task (OffensEval 2020), which is a part of the SemEval 2020. We show that combining CNN with BERT is better than using BERT on its own, and we emphasize the importance of utilizing pre-trained language models for downstream tasks. Our system, ranked 4th with macro averaged F1-Score of 0.897 in Arabic, 4th with score of 0.843 in Greek, and 3rd with score of 0.814 in Turkish. Additionally, we present ArabicBERT, a set of pre-trained transformer language models for Arabic that we share with the community.

Key facts. Cited by 84 papers in the map (data through 14 Oct 2026). First posted on arXiv 26 Jul 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 24; 2022: 18; 2023: 19; 2024: 13; 2025: 8; 2026: 2.

84 papers.

Sort:

By area:

  1. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,984
  2. 2021Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Surveycited by 463
  3. 2023Language Model Tokenizers Introduce Unfairness Between Languagescited by 214
  4. 2021The Interplay of Variant, Size, and Task Type in Arabic Pre-trained Language Modelscited by 119
  5. 2023Jais and Jais-chat: Arabic-Centric Foundation and Instruction-Tuned Open Generative Large Language Modelscited by 69
  6. 2022ORCA: A Challenging Benchmark for Arabic Language Understandingcited by 47
  7. 2021Pre-Training BERT on Arabic Tweets: Practical Considerationscited by 39
  8. 2021SpanEmo: Casting Multi-label Emotion Classification as Span-predictioncited by 37
  9. 2021Czert -- Czech BERT-like Model for Language Representationcited by 22
  10. 2021ZEN 2.0: Continue Training and Adaption for N-gram Enhanced Text Encoderscited by 22
  11. 2023Advancements in Arabic Grammatical Error Detection and Correction: An Empirical Investigationcited by 22
  12. 2023ArAIEval Shared Task: Persuasion Techniques and Disinformation Detection in Arabic Textcited by 19
38 more
  1. 2023Large Language Models for Propaganda Span Annotationcited by 19
  2. 2021Adapting High-resource NMT Models to Translate Low-resource Related Languages without Parallel Datacited by 17
  3. 2024SemRel2024: A Collection of Semantic Textual Relatedness Datasets for 13 Languagescited by 16
  4. 2021Findings of the NLP4IF-2021 Shared Tasks on Fighting the COVID-19 Infodemic and Censorship Detectioncited by 14
  5. 2022Leveraging Label Correlations in a Multi-label Setting: A Case Study in Emotioncited by 14
  6. 2022Mapping the Multilingual Margins: Intersectional Biases of Sentiment Analysis Systems in English, Spanish, and Arabiccited by 13
  7. 2024A Survey of Large Language Models for Arabic Language and its Dialectscited by 13
  8. 2024ArAIEval Shared Task: Propagandistic Techniques Detection in Unimodal and Multimodal Arabic Contentcited by 11
  9. 2021LU-BZU at SemEval-2021 Task 2: Word2Vec and Lemma2Vec performance in Arabic Word-in-Context disambiguationcited by 9
  10. 2022Vietnamese Hate and Offensive Detection using PhoBERT-CNN and Social Media Streaming Datacited by 9
  11. 2022An Effective Deployment of Contrastive Learning in Multi-label Text Classificationcited by 9
  12. 2023A Transformer-based Approach for Arabic Offline Handwritten Text Recognitioncited by 9
  13. 2021AraStance: A Multi-Country and Multi-Domain Dataset of Arabic Stance Detection for Fact Checkingcited by 8
  14. 2024Corpus Considerations for Annotator Modeling and Scalingcited by 8
  15. 2021Are the Multilingual Models Better? Improving Czech Sentiment with Transformerscited by 7
  16. 2023AraMUS: Pushing the Limits of Data and Model Scale for Arabic Natural Language Processingcited by 7
  17. 2024SaudiBERT: A Large Language Model Pretrained on Saudi Dialect Corporacited by 7
  18. 2021Accenture at CheckThat! 2021: Interesting claim identification and ranking with contextually sensitive lexical training data augmentationcited by 6
  19. 2021Cross-Lingual BERT Contextual Embedding Space Mapping with Isotropic and Isometric Conditionscited by 6
  20. 2023Balanced and Explainable Social Media Analysis for Public Health with Large Language Modelscited by 6
  21. 2023On the Calibration of Multilingual Question Answering LLMscited by 6
  22. 2021Automatic Difficulty Classification of Arabic Sentencescited by 5
  23. 2023ArabIcros: AI-Powered Arabic Crossword Puzzle Generation for Educational Applicationscited by 5
  24. 2024Exploring Tokenization Strategies and Vocabulary Sizes for Enhanced Arabic Language Modelscited by 5
  25. 2024EgyBERT: A Large Language Model Pretrained on Egyptian Dialect Corporacited by 5
  26. 2023A Systematic Study of Performance Disparities in Multilingual Task-Oriented Dialogue Systemscited by 4
  27. 2023Leveraging Domain Adaptation and Data Augmentation to Improve Qur'anic IR in English and Arabiccited by 4
  28. 2021JABER and SABER: Junior and Senior Arabic BERtcited by 3
  29. 2022Towards Arabic Sentence Simplification via Classification and Generative Approachescited by 3
  30. 2023Bio+Clinical BERT, BERT Base, and CNN Performance Comparison for Predicting Drug-Review Satisfactioncited by 3
  31. 2021Transfer Learning Approach for Arabic Offensive Language Detection System -- BERT-Based Modelcited by 2
  32. 2021Cisco at SemEval-2021 Task 5: What's Toxic?: Leveraging Transformers for Multiple Toxic Span Extraction from Online Commentscited by 2
  33. 2021Enhanced Universal Dependency Parsing with Automated Concatenation of Embeddingscited by 2
  34. 2021Offensive Language Detection with BERT-based models, By Customizing Attention Probabilitiescited by 2
  35. 2021R-BERT-CNN: Drug-target interactions extraction from biomedical literaturecited by 2
  36. 2022Revisiting Pre-trained Language Models and their Evaluation for Arabic Natural Language Understandingcited by 2
  37. 2022Sort by Structure: Language Model Ranking as Dependency Probingcited by 2
  38. 2023Language-Agnostic Bias Detection in Language Models with Bias Probingcited by 2

50 most cited of 84 All 84 (JSON)