A Sentiment Analysis Dataset for Code-Mixed Malayalam-English
Not on the map. Why?
Abstract (arXiv)
There is an increasing demand for sentiment analysis of text from social media which are mostly code-mixed. Systems trained on monolingual data fail for code-mixed data due to the complexity of mixing at different levels of the text. However, very few resources are available for code-mixed data to create models specific for this data. Although much research in multilingual and cross-lingual sentiment analysis has used semi-supervised or unsupervised methods, supervised methods still performs better. Only a few datasets for popular languages such as English-Spanish, English-Hindi, and English-Chinese are available. There are no resources available for Malayalam-English code-mixed data. This paper presents a new gold standard corpus for sentiment analysis of code-mixed text in Malayalam-English annotated by voluntary annotators. This gold standard corpus obtained a Krippendorff's alpha above 0.8 for the dataset. We use this new corpus to provide the benchmark for sentiment analysis in Malayalam-English code-mixed texts.
Key facts. Cited by 50 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 May 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 21; 2022: 7; 2023: 4; 2024: 7; 2025: 7; 2026: 4.
50 papers.
Sort:
- 2023Multilingual Large Language Models Are Not (Yet) Code-Switcherscited by 65
- 2022The Decades Progress on Code-Switching Research in NLP: A Systematic Survey on Trends and Challengescited by 35
- 2021DravidianCodeMix: Sentiment Analysis and Offensive Language Identification Dataset for Dravidian Languages in Code-Mixed Textcited by 18
- 2023Memotion 3: Dataset on Sentiment and Emotion Analysis of Codemixed Hindi-English Memescited by 12
- 2021SJ_AJ@DravidianLangTech-EACL2021: Task-Adaptive Pre-Training of Multilingual BERT models for Offensive Language Identificationcited by 11
- 2021Comparing Approaches to Dravidian Language Identificationcited by 11
- 2024MINERS: Multilingual Language Models as Semantic Retrieverscited by 11
- 2024Social Intelligence Data Infrastructure: Structuring the Present and Navigating the Futurecited by 10
- 2021NLP-CUET@DravidianLangTech-EACL2021: Offensive Language Detection from Multilingual Code-Mixed Text using Transformerscited by 9
- 2024BnSentMix: A Diverse Bengali-English Code-Mixed Dataset for Sentiment Analysiscited by 9
- 2021Hate-Alert@DravidianLangTech-EACL2021: Ensembling strategies for Transformer-based Offensive language Detectioncited by 8
- 2025CodeMixBench: Evaluating Code-Mixing Capabilities of LLMs Across 18 Languagescited by 8
38 more
- 2021Unsupervised Self-Training for Sentiment Analysis of Code-Switched Datacited by 7
- 2021Hope Speech detection in under-resourced Kannada languagecited by 7
- 2024Zero-shot Sentiment Analysis in Low-Resource Languages Using a Multilingual Sentiment Lexiconcited by 7
- 2021Sentiment Analysis of Persian-English Code-mixed Textscited by 6
- 2021IIITT@LT-EDI-EACL2021-Hope Speech Detection: There is always Hope in Transformerscited by 6
- 2021Offensive Language Identification in Low-resourced Code-mixed Dravidian languages using Pseudo-labelingcited by 6
- 2021Offense Detection in Dravidian Languages using Code-Mixing Index based Focal Losscited by 6
- 2021Task-Specific Pre-Training and Cross Lingual Transfer for Code-Switched Datacited by 5
- 2021UVCE-IIITT@DravidianLangTech-EACL2021: Tamil Troll Meme Classification: You need to Pay more Attentioncited by 5
- 2022A Multilingual Dataset of COVID-19 Vaccination Attitudes on Twittercited by 5
- 2025Multilingual Prompt Engineering in Large Language Models: A Survey Across NLP Taskscited by 5
- 2021indicnlp@kgp at DravidianLangTech-EACL2021: Offensive Language Identification in Dravidian Languagescited by 4
- 2021Cross-Lingual Text Classification of Transliterated Hindi and Malayalamcited by 4
- 2024What talking you?: Translating Code-Mixed Messaging Texts to Englishcited by 4
- 2021CMSAOne@Dravidian-CodeMix-FIRE2020: A Meta Embedding and Transformer model for Code-Mixed Sentiment Analysis on Social Media Textcited by 3
- 2021KBCNMUJAL@HASOC-Dravidian-CodeMix-FIRE2020: Using Machine Learning for Detection of Hate Speech and Offensive Code-Mixed Social Media textcited by 3
- 2022Language Agnostic Code-Mixing Data Augmentation by Predicting Linguistic Patternscited by 3
- 2023Comparative Study of Pre-Trained BERT Models for Code-Mixed Hindi-English Datacited by 3
- 2024Leveraging Large Language Models for Code-Mixed Data Augmentation in Sentiment Analysiscited by 3
- 2025DIVERS-Bench: Evaluating Language Identification Across Domain Shifts and Code-Switchingcited by 3
- 2021IIITG-ADBU@HASOC-Dravidian-CodeMix-FIRE2020: Offensive Content Detection in Code-Mixed Dravidian Textcited by 2
- 2022CoLI-Machine Learning Approaches for Code-mixed Language Identification at the Word Level in Kannada-English Textscited by 2
- 2023Overview of Memotion 3: Sentiment and Emotion Analysis of Codemixed Hinglish Memescited by 2
- 2021Developing Successful Shared Tasks on Offensive Language Identification for Dravidian Languagescited by 1
- 2021IIITT@Dravidian-CodeMix-FIRE2021: Transliterate or translate? Sentiment analysis of code-mixed text in Dravidian languagescited by 1
- 2022IIITDWD-ShankarB@ Dravidian-CodeMixi-HASOC2021: mBERT based model for identification of offensive content in south Indian languagescited by 1
- 2024MaCmS: Magahi Code-mixed Dataset for Sentiment Analysiscited by 1
- 2025Statement-Tuning Enables Efficient Cross-lingual Generalization in Encoder-only Modelscited by 1
- 2025Adapting Multilingual Models to Code-Mixed Tasks via Model Mergingcited by 1
- 2026PingPong: A Natural Benchmark for Multi-Turn Code-Switching Dialoguescited by 1
- 2021Findings of the Sentiment Analysis of Dravidian Languages in Code-Mixed Textcited by 0
- 2022TamilEmo: Finegrained Emotion Detection Dataset for Tamilcited by 0
- 2022Sentiment Classification of Code-Switched Text using Pre-trained Multilingual Embeddings and Segmentationcited by 0
- 2025Human-Centered Supervision for Sentiment Analysis in Telugu: A Systematic Inquiry Beyond Accuracycited by 0
- 2025Comparative Study of Pre-Trained BERT and Large Language Models for Code-Mixed Named Entity Recognitioncited by 0
- 2026NLP Privacy Risk Identification in Social Media (NLP-PRISM): A Surveycited by 0
- 2026IndicTalk: A Large-Scale Persona-Based Multilingual Conversational Corpus for Indic Languagescited by 0
- 2026PERCEPT: A Corpus for POS Tagging and Analysis of Persian-English Code-Mixingcited by 0
- 2026PERCEPT: A Corpus for POS Tagging and Analysis of Persian-English Code-Mixing10 Aug 2026
- 2026IndicTalk: A Large-Scale Persona-Based Multilingual Conversational Corpus for Indic Languages25 Jul 2026
- 2026NLP Privacy Risk Identification in Social Media (NLP-PRISM): A Survey26 Jan 2026
- 2026PingPong: A Natural Benchmark for Multi-Turn Code-Switching Dialogues24 Jan 2026
- 2025Adapting Multilingual Models to Code-Mixed Tasks via Model Merging22 Oct 2025
- 2025DIVERS-Bench: Evaluating Language Identification Across Domain Shifts and Code-Switching22 Sep 2025
- 2025Comparative Study of Pre-Trained BERT and Large Language Models for Code-Mixed Named Entity Recognition2 Sep 2025
- 2025Human-Centered Supervision for Sentiment Analysis in Telugu: A Systematic Inquiry Beyond Accuracy2 Aug 2025
- 2025CodeMixBench: Evaluating Code-Mixing Capabilities of LLMs Across 18 Languages24 Jul 2025
- 2025Statement-Tuning Enables Efficient Cross-lingual Generalization in Encoder-only Models2 Jun 2025
- 2025Multilingual Prompt Engineering in Large Language Models: A Survey Across NLP Tasks16 May 2025
- 2024What talking you?: Translating Code-Mixed Messaging Texts to English8 Nov 2024
38 more
- 2024Leveraging Large Language Models for Code-Mixed Data Augmentation in Sentiment Analysis1 Nov 2024
- 2024BnSentMix: A Diverse Bengali-English Code-Mixed Dataset for Sentiment Analysis16 Aug 2024
- 2024MINERS: Multilingual Language Models as Semantic Retrievers11 Jun 2024
- 2024MaCmS: Magahi Code-mixed Dataset for Sentiment Analysis7 Mar 2024
- 2024Social Intelligence Data Infrastructure: Structuring the Present and Navigating the Future28 Feb 2024
- 2024Zero-shot Sentiment Analysis in Low-Resource Languages Using a Multilingual Sentiment Lexicon3 Feb 2024
- 2023Overview of Memotion 3: Sentiment and Emotion Analysis of Codemixed Hinglish Memes12 Sep 2023
- 2023Comparative Study of Pre-Trained BERT Models for Code-Mixed Hindi-English Data25 May 2023
- 2023Multilingual Large Language Models Are Not (Yet) Code-Switchers23 May 2023
- 2023Memotion 3: Dataset on Sentiment and Emotion Analysis of Codemixed Hindi-English Memes17 Mar 2023
- 2022The Decades Progress on Code-Switching Research in NLP: A Systematic Survey on Trends and Challenges19 Dec 2022
- 2022CoLI-Machine Learning Approaches for Code-mixed Language Identification at the Word Level in Kannada-English Texts17 Nov 2022
- 2022Language Agnostic Code-Mixing Data Augmentation by Predicting Linguistic Patterns14 Nov 2022
- 2022Sentiment Classification of Code-Switched Text using Pre-trained Multilingual Embeddings and Segmentation29 Oct 2022
- 2022A Multilingual Dataset of COVID-19 Vaccination Attitudes on Twitter27 Jun 2022
- 2022IIITDWD-ShankarB@ Dravidian-CodeMixi-HASOC2021: mBERT based model for identification of offensive content in south Indian languages13 Apr 2022
- 2022TamilEmo: Finegrained Emotion Detection Dataset for Tamil9 Feb 2022
- 2021Findings of the Sentiment Analysis of Dravidian Languages in Code-Mixed Text18 Nov 2021
- 2021IIITT@Dravidian-CodeMix-FIRE2021: Transliterate or translate? Sentiment analysis of code-mixed text in Dravidian languages15 Nov 2021
- 2021Offense Detection in Dravidian Languages using Code-Mixing Index based Focal Loss12 Nov 2021
- 2021Developing Successful Shared Tasks on Offensive Language Identification for Dravidian Languages5 Nov 2021
- 2021Cross-Lingual Text Classification of Transliterated Hindi and Malayalam31 Aug 2021
- 2021Offensive Language Identification in Low-resourced Code-mixed Dravidian languages using Pseudo-labeling27 Aug 2021
- 2021Hope Speech detection in under-resourced Kannada language10 Aug 2021
- 2021IIITG-ADBU@HASOC-Dravidian-CodeMix-FIRE2020: Offensive Content Detection in Code-Mixed Dravidian Text29 Jul 2021
- 2021DravidianCodeMix: Sentiment Analysis and Offensive Language Identification Dataset for Dravidian Languages in Code-Mixed Text17 Jun 2021
- 2021UVCE-IIITT@DravidianLangTech-EACL2021: Tamil Troll Meme Classification: You need to Pay more Attention19 Apr 2021
- 2021IIITT@LT-EDI-EACL2021-Hope Speech Detection: There is always Hope in Transformers19 Apr 2021
- 2021Unsupervised Self-Training for Sentiment Analysis of Code-Switched Data27 Mar 2021
- 2021Comparing Approaches to Dravidian Language Identification9 Mar 2021
- 2021NLP-CUET@DravidianLangTech-EACL2021: Offensive Language Detection from Multilingual Code-Mixed Text using Transformers28 Feb 2021
- 2021Sentiment Analysis of Persian-English Code-mixed Texts25 Feb 2021
- 2021Task-Specific Pre-Training and Cross Lingual Transfer for Code-Switched Data24 Feb 2021
- 2021Hate-Alert@DravidianLangTech-EACL2021: Ensembling strategies for Transformer-based Offensive language Detection19 Feb 2021
- 2021KBCNMUJAL@HASOC-Dravidian-CodeMix-FIRE2020: Using Machine Learning for Detection of Hate Speech and Offensive Code-Mixed Social Media text19 Feb 2021
- 2021indicnlp@kgp at DravidianLangTech-EACL2021: Offensive Language Identification in Dravidian Languages14 Feb 2021
- 2021SJ_AJ@DravidianLangTech-EACL2021: Task-Adaptive Pre-Training of Multilingual BERT models for Offensive Language Identification1 Feb 2021
- 2021CMSAOne@Dravidian-CodeMix-FIRE2020: A Meta Embedding and Transformer model for Code-Mixed Sentiment Analysis on Social Media Text22 Jan 2021
- 2023Multilingual Large Language Models Are Not (Yet) Code-Switcherscited by 65
- 2022The Decades Progress on Code-Switching Research in NLP: A Systematic Survey on Trends and Challengescited by 35
- 2021DravidianCodeMix: Sentiment Analysis and Offensive Language Identification Dataset for Dravidian Languages in Code-Mixed Textcited by 18
- 2023Memotion 3: Dataset on Sentiment and Emotion Analysis of Codemixed Hindi-English Memescited by 12
- 2021SJ_AJ@DravidianLangTech-EACL2021: Task-Adaptive Pre-Training of Multilingual BERT models for Offensive Language Identificationcited by 11
- 2021Comparing Approaches to Dravidian Language Identificationcited by 11
- 2024MINERS: Multilingual Language Models as Semantic Retrieverscited by 11
- 2024Social Intelligence Data Infrastructure: Structuring the Present and Navigating the Futurecited by 10
- 2021NLP-CUET@DravidianLangTech-EACL2021: Offensive Language Detection from Multilingual Code-Mixed Text using Transformerscited by 9
- 2024BnSentMix: A Diverse Bengali-English Code-Mixed Dataset for Sentiment Analysiscited by 9
- 2021Hate-Alert@DravidianLangTech-EACL2021: Ensembling strategies for Transformer-based Offensive language Detectioncited by 8
- 2025CodeMixBench: Evaluating Code-Mixing Capabilities of LLMs Across 18 Languagescited by 8
12 most cited of 50 All 50 (JSON)
- 2026PERCEPT: A Corpus for POS Tagging and Analysis of Persian-English Code-Mixing10 Aug 2026
- 2026IndicTalk: A Large-Scale Persona-Based Multilingual Conversational Corpus for Indic Languages25 Jul 2026
- 2026NLP Privacy Risk Identification in Social Media (NLP-PRISM): A Survey26 Jan 2026
- 2026PingPong: A Natural Benchmark for Multi-Turn Code-Switching Dialogues24 Jan 2026
- 2025Adapting Multilingual Models to Code-Mixed Tasks via Model Merging22 Oct 2025
- 2025DIVERS-Bench: Evaluating Language Identification Across Domain Shifts and Code-Switching22 Sep 2025
- 2025Comparative Study of Pre-Trained BERT and Large Language Models for Code-Mixed Named Entity Recognition2 Sep 2025
- 2025Human-Centered Supervision for Sentiment Analysis in Telugu: A Systematic Inquiry Beyond Accuracy2 Aug 2025
- 2025CodeMixBench: Evaluating Code-Mixing Capabilities of LLMs Across 18 Languages24 Jul 2025
- 2025Statement-Tuning Enables Efficient Cross-lingual Generalization in Encoder-only Models2 Jun 2025
- 2025Multilingual Prompt Engineering in Large Language Models: A Survey Across NLP Tasks16 May 2025
- 2024What talking you?: Translating Code-Mixed Messaging Texts to English8 Nov 2024
12 newest of 50 All 50 (JSON)