mlsanityData to 7 Oct 2026

DravidianCodeMix: Sentiment Analysis and Offensive Language Identification Dataset for Dravidian Languages in Code-Mixed Text

arXiv 2106.09460 ↗First posted 17 Jun 2021cs.CLcited by 18

Not on the map. Why?

Abstract (arXiv)

This paper describes the development of a multilingual, manually annotated dataset for three under-resourced Dravidian languages generated from social media comments. The dataset was annotated for sentiment analysis and offensive language identification for a total of more than 60,000 YouTube comments. The dataset consists of around 44,000 comments in Tamil-English, around 7,000 comments in Kannada-English, and around 20,000 comments in Malayalam-English. The data was manually annotated by volunteer annotators and has a high inter-annotator agreement in Krippendorff's alpha. The dataset contains all types of code-mixing phenomena since it comprises user-generated content from a multilingual country. We also present baseline experiments to establish benchmarks on the dataset using machine learning methods. The dataset is available on Github (https://github.com/bharathichezhiyan/DravidianCodeMix-Dataset) and Zenodo (https://zenodo.org/record/4750858#.YJtw0SYo0M).

Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 13 of its 91 references that are in the map. First posted on arXiv 17 Jun 2021.

Builds on

13 of 91 references.

References · 13

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  3. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  4. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  5. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
  6. 2019Cross-lingual Language Model Pretrainingcited by 1,088
  7. 2019Predicting the Type and Target of Offensive Posts in Social Mediacited by 268
  8. 2020SemEval-2020 Task 12: Multilingual Offensive Language Identification in Social Media (OffensEval 2020)cited by 138
  9. 2020CharacterBERT: Reconciling ELMo and BERT for Word-Level Open-Vocabulary Representations From Characterscited by 87
  10. 2020Corpus Creation for Sentiment Analysis in Code-Mixed Tamil-English Textcited by 67
  11. 2020SemEval-2020 Task 9: Overview of Sentiment Analysis of Code-Mixed Tweetscited by 62
  12. 2020A Sentiment Analysis Dataset for Code-Mixed Malayalam-Englishcited by 50
1 more
  1. 2018Duluth UROP at SemEval-2018 Task 2: Multilingual Emoji Prediction with Ensemble Learning and Oversamplingcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 3; 2022: 4; 2023: 1; 2024: 3; 2025: 6; 2026: 1.

18 papers.

Sort:

  1. 2021Offensive Language Identification in Low-resourced Code-mixed Dravidian languages using Pseudo-labelingcited by 6
  2. 2025LLM-Based Multi-Task Bangla Hate Speech Detection: Type, Severity, and Targetcited by 6
  3. 2024Code-mixed Sentiment and Hate-speech Predictioncited by 4
  4. 2025Beyond Monolingual Assumptions: A Survey of Code-Switched NLP in the Era of Large Language Models across Modalitiescited by 4
  5. 2023The Skipped Beat: A Study of Sociopragmatic Understanding in LLMs for 64 Languagescited by 3
  6. 2022Findings of the Shared Task on Offensive Span Identification from Code-Mixed Tamil-English Commentscited by 2
  7. 2024Cross-lingual Offensive Language Detection: A Systematic Review of Datasets, Transfer Approaches and Challengescited by 2
  8. 2021Pretrained Transformers for Offensive Language Identification in Tanglishcited by 1
  9. 2022Zero-shot Code-Mixed Offensive Span Identification through Rationale Extractioncited by 1
  10. 2022Progressive Sentiment Analysis for Code-Switched Text Datacited by 1
  11. 2025Statement-Tuning Enables Efficient Cross-lingual Generalization in Encoder-only Modelscited by 1
  12. 2021Hypers at ComMA@ICON: Modelling Aggressiveness, Gender Bias and Communal Bias Identificationcited by 0
6 more
  1. 2022TamilEmo: Finegrained Emotion Detection Dataset for Tamilcited by 0
  2. 2024YouTube Comments Decoded: Leveraging LLMs for Low Resource Language Classificationcited by 0
  3. 2025Creating and Evaluating Code-Mixed Nepali-English and Telugu-English Datasets for Abusive Language Detection Using Traditional and Deep Learning Modelscited by 0
  4. 2025Overcoming Low-Resource Barriers in Tulu: Neural Models and Corpus Creation for OffensiveLanguage Identificationcited by 0
  5. 2025NepEMO: A Multi-Label Emotion and Sentiment Analysis on Nepali Reddit with Linguistic Insights and Temporal Trendscited by 0
  6. 2026EnTaCs: Analyzing the Relationship Between Sentiment and Language Choice in English-Tamil Code-Switchingcited by 0