Corpus Creation for Sentiment Analysis in Code-Mixed Tamil-English Text
Not on the map. Why?
Abstract (arXiv)
Understanding the sentiment of a comment from a video or an image is an essential task in many applications. Sentiment analysis of a text can be useful for various decision-making processes. One such application is to analyse the popular sentiments of videos on social media based on viewer comments. However, comments from social media do not follow strict rules of grammar, and they contain mixing of more than one language, often written in non-native scripts. Non-availability of annotated code-mixed data for a low-resourced language like Tamil also adds difficulty to this problem. To overcome this, we created a gold standard Tamil-English code-switched, sentiment-annotated corpus containing 15,744 comment posts from YouTube. In this paper, we describe the process of creating the corpus and assigning polarities. We present inter-annotator agreement and show the results of sentiment analysis trained on this corpus as a benchmark.
Key facts. Cited by 67 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 May 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 28; 2022: 10; 2023: 13; 2024: 6; 2025: 9; 2026: 1.
67 papers.
Sort:
By area:
- 2023Multilingual Large Language Models Are Not (Yet) Code-Switcherscited by 65
- 2022The Decades Progress on Code-Switching Research in NLP: A Systematic Survey on Trends and Challengescited by 35
- 2024Code-Switching Red-Teaming: LLM Evaluation for Safety and Multilingual Understandingcited by 34
- 2021Dataset for Identification of Homophobia and Transophobia in Multilingual YouTube Commentscited by 20
- 2021DravidianCodeMix: Sentiment Analysis and Offensive Language Identification Dataset for Dravidian Languages in Code-Mixed Textcited by 18
- 2023Representativeness as a Forgotten Lesson for Multilingual and Code-switched Data Collection and Preparationcited by 16
- 2023Memotion 3: Dataset on Sentiment and Emotion Analysis of Codemixed Hindi-English Memescited by 12
- 2021SJ_AJ@DravidianLangTech-EACL2021: Task-Adaptive Pre-Training of Multilingual BERT models for Offensive Language Identificationcited by 11
- 2021Comparing Approaches to Dravidian Language Identificationcited by 11
- 2024Social Intelligence Data Infrastructure: Structuring the Present and Navigating the Futurecited by 10
- 2021NLP-CUET@DravidianLangTech-EACL2021: Offensive Language Detection from Multilingual Code-Mixed Text using Transformerscited by 9
- 2024BnSentMix: A Diverse Bengali-English Code-Mixed Dataset for Sentiment Analysiscited by 9
38 more
- 2021Hate-Alert@DravidianLangTech-EACL2021: Ensembling strategies for Transformer-based Offensive language Detectioncited by 8
- 2021CodemixedNLP: An Extensible and Open NLP Toolkit for Code-Mixingcited by 8
- 2022EntityCS: Improving Zero-Shot Cross-lingual Transfer with Entity-Centric Code Switchingcited by 8
- 2025CodeMixBench: Evaluating Code-Mixing Capabilities of LLMs Across 18 Languagescited by 8
- 2021Unsupervised Self-Training for Sentiment Analysis of Code-Switched Datacited by 7
- 2021Hope Speech detection in under-resourced Kannada languagecited by 7
- 2023Exploring Methods for Building Dialects-Mandarin Code-Mixing Corpora: A Case Study in Taiwanese Hokkiencited by 7
- 2024Zero-shot Sentiment Analysis in Low-Resource Languages Using a Multilingual Sentiment Lexiconcited by 7
- 2021Sentiment Analysis of Persian-English Code-mixed Textscited by 6
- 2021IIITT@LT-EDI-EACL2021-Hope Speech Detection: There is always Hope in Transformerscited by 6
- 2021Offensive Language Identification in Low-resourced Code-mixed Dravidian languages using Pseudo-labelingcited by 6
- 2021Offense Detection in Dravidian Languages using Code-Mixing Index based Focal Losscited by 6
- 2024User-Aware Multilingual Abusive Content Detection in Social Mediacited by 6
- 2021Task-Specific Pre-Training and Cross Lingual Transfer for Code-Switched Datacited by 5
- 2021UVCE-IIITT@DravidianLangTech-EACL2021: Tamil Troll Meme Classification: You need to Pay more Attentioncited by 5
- 2021HIT: A Hierarchically Fused Deep Attention Network for Robust Code-mixed Language Representationcited by 5
- 2025Multilingual Prompt Engineering in Large Language Models: A Survey Across NLP Taskscited by 5
- 2021indicnlp@kgp at DravidianLangTech-EACL2021: Offensive Language Identification in Dravidian Languagescited by 4
- 2021On the logistical difficulties and findings of Jopara Sentiment Analysiscited by 4
- 2021The Effectiveness of Intermediate-Task Training for Code-Switched Natural Language Understandingcited by 4
- 2021Towards Offensive Language Identification for Tamil Code-Mixed YouTube Comments and Postscited by 4
- 2021CMSAOne@Dravidian-CodeMix-FIRE2020: A Meta Embedding and Transformer model for Code-Mixed Sentiment Analysis on Social Media Textcited by 3
- 2021KBCNMUJAL@HASOC-Dravidian-CodeMix-FIRE2020: Using Machine Learning for Detection of Hate Speech and Offensive Code-Mixed Social Media textcited by 3
- 2023Comparative Study of Pre-Trained BERT Models for Code-Mixed Hindi-English Datacited by 3
- 2025DIVERS-Bench: Evaluating Language Identification Across Domain Shifts and Code-Switchingcited by 3
- 2021IIITG-ADBU@HASOC-Dravidian-CodeMix-FIRE2020: Offensive Content Detection in Code-Mixed Dravidian Textcited by 2
- 2022Prabhupadavani: A Code-mixed Speech Translation Data for 25 Languagescited by 2
- 2022A Comprehensive Understanding of Code-mixed Language Semantics using Hierarchical Transformercited by 2
- 2022Findings of the Shared Task on Offensive Span Identification from Code-Mixed Tamil-English Commentscited by 2
- 2022CoLI-Machine Learning Approaches for Code-mixed Language Identification at the Word Level in Kannada-English Textscited by 2
- 2023CONFLATOR: Incorporating Switching Point based Rotatory Positional Encodings for Code-Mixed Language Modelingcited by 2
- 2023Overview of Memotion 3: Sentiment and Emotion Analysis of Codemixed Hinglish Memescited by 2
- 2023The Uli Dataset: An Exercise in Experience Led Annotation of oGBVcited by 2
- 2021Developing Successful Shared Tasks on Offensive Language Identification for Dravidian Languagescited by 1
- 2021IIITT@Dravidian-CodeMix-FIRE2021: Transliterate or translate? Sentiment analysis of code-mixed text in Dravidian languagescited by 1
- 2022Go-tuning: Improving Zero-shot Learning Abilities of Smaller Language Modelscited by 1
- 2023Linguistically-Informed Neural Architectures for Lexical, Syntactic and Semantic Tasks in Sanskritcited by 1
- 2023IruMozhi: Automatically classifying diglossia in Tamilcited by 1
50 most cited of 67 All 67 (JSON)
- 2026PingPong: A Natural Benchmark for Multi-Turn Code-Switching Dialogues24 Jan 2026
- 2025Language-Independent Sentiment Labelling with Distant Supervision: A Case Study for English, Sepedi and Setswana25 Nov 2025
- 2025Adapting Multilingual Models to Code-Mixed Tasks via Model Merging22 Oct 2025
- 2025DIVERS-Bench: Evaluating Language Identification Across Domain Shifts and Code-Switching22 Sep 2025
- 2025Comparative Study of Pre-Trained BERT and Large Language Models for Code-Mixed Named Entity Recognition2 Sep 2025
- 2025Overcoming Low-Resource Barriers in Tulu: Neural Models and Corpus Creation for OffensiveLanguage Identification15 Aug 2025
- 2025Human-Centered Supervision for Sentiment Analysis in Telugu: A Systematic Inquiry Beyond Accuracy2 Aug 2025
- 2025CodeMixBench: Evaluating Code-Mixing Capabilities of LLMs Across 18 Languages24 Jul 2025
- 2025Statement-Tuning Enables Efficient Cross-lingual Generalization in Encoder-only Models2 Jun 2025
- 2025Multilingual Prompt Engineering in Large Language Models: A Survey Across NLP Tasks16 May 2025
- 2024User-Aware Multilingual Abusive Content Detection in Social Media26 Oct 2024
- 2024BnSentMix: A Diverse Bengali-English Code-Mixed Dataset for Sentiment Analysis16 Aug 2024
38 more
- 2024Code-Switching Red-Teaming: LLM Evaluation for Safety and Multilingual Understanding17 Jun 2024
- 2024MaCmS: Magahi Code-mixed Dataset for Sentiment Analysis7 Mar 2024
- 2024Social Intelligence Data Infrastructure: Structuring the Present and Navigating the Future28 Feb 2024
- 2024Zero-shot Sentiment Analysis in Low-Resource Languages Using a Multilingual Sentiment Lexicon3 Feb 2024
- 2023The Uli Dataset: An Exercise in Experience Led Annotation of oGBV15 Nov 2023
- 2023IruMozhi: Automatically classifying diglossia in Tamil13 Nov 2023
- 2023Representativeness as a Forgotten Lesson for Multilingual and Code-switched Data Collection and Preparation31 Oct 2023
- 2023Overview of Memotion 3: Sentiment and Emotion Analysis of Codemixed Hinglish Memes12 Sep 2023
- 2023CONFLATOR: Incorporating Switching Point based Rotatory Positional Encodings for Code-Mixed Language Modeling11 Sep 2023
- 2023Vulgar Remarks Detection in Chittagonian Dialect of Bangla29 Aug 2023
- 2023Linguistically-Informed Neural Architectures for Lexical, Syntactic and Semantic Tasks in Sanskrit17 Aug 2023
- 2023Comparative Study of Pre-Trained BERT Models for Code-Mixed Hindi-English Data25 May 2023
- 2023Multilingual Large Language Models Are Not (Yet) Code-Switchers23 May 2023
- 2023Detection of depression on social networks using transformers and ensembles9 May 2023
- 2023XAI in Computational Linguistics: Understanding Political Leanings in the Slovenian Parliament8 May 2023
- 2023Memotion 3: Dataset on Sentiment and Emotion Analysis of Codemixed Hindi-English Memes17 Mar 2023
- 2023Exploring Methods for Building Dialects-Mandarin Code-Mixing Corpora: A Case Study in Taiwanese Hokkien21 Jan 2023
- 2022Go-tuning: Improving Zero-shot Learning Abilities of Smaller Language Models20 Dec 2022
- 2022The Decades Progress on Code-Switching Research in NLP: A Systematic Survey on Trends and Challenges19 Dec 2022
- 2022CoLI-Machine Learning Approaches for Code-mixed Language Identification at the Word Level in Kannada-English Texts17 Nov 2022
- 2022Sentiment Classification of Code-Switched Text using Pre-trained Multilingual Embeddings and Segmentation29 Oct 2022
- 2022EntityCS: Improving Zero-Shot Cross-lingual Transfer with Entity-Centric Code Switching22 Oct 2022
- 2022Findings of the Shared Task on Offensive Span Identification from Code-Mixed Tamil-English Comments12 May 2022
- 2022A Comprehensive Understanding of Code-mixed Language Semantics using Hierarchical Transformer27 Apr 2022
- 2022Optimize_Prime@DravidianLangTech-ACL2022: Abusive Comment Detection in Tamil19 Apr 2022
- 2022TamilEmo: Finegrained Emotion Detection Dataset for Tamil9 Feb 2022
- 2022Prabhupadavani: A Code-mixed Speech Translation Data for 25 Languages27 Jan 2022
- 2021Multilingual Text Classification for Dravidian Languages3 Dec 2021
- 2021Pegasus@Dravidian-CodeMix-HASOC2021: Analyzing Social Media Content for Detection of Offensive Text18 Nov 2021
- 2021Findings of the Sentiment Analysis of Dravidian Languages in Code-Mixed Text18 Nov 2021
- 2021IIITT@Dravidian-CodeMix-FIRE2021: Transliterate or translate? Sentiment analysis of code-mixed text in Dravidian languages15 Nov 2021
- 2021Offense Detection in Dravidian Languages using Code-Mixing Index based Focal Loss12 Nov 2021
- 2021Developing Successful Shared Tasks on Offensive Language Identification for Dravidian Languages5 Nov 2021
- 2021Dataset for Identification of Homophobia and Transophobia in Multilingual YouTube Comments1 Sep 2021
- 2021Offensive Language Identification in Low-resourced Code-mixed Dravidian languages using Pseudo-labeling27 Aug 2021
- 2021Towards Offensive Language Identification for Tamil Code-Mixed YouTube Comments and Posts24 Aug 2021
- 2021Hope Speech detection in under-resourced Kannada language10 Aug 2021
- 2021IIITG-ADBU@HASOC-Dravidian-CodeMix-FIRE2020: Offensive Content Detection in Code-Mixed Dravidian Text29 Jul 2021
50 newest of 67 All 67 (JSON)
- 2023Multilingual Large Language Models Are Not (Yet) Code-Switcherscited by 65
- 2022The Decades Progress on Code-Switching Research in NLP: A Systematic Survey on Trends and Challengescited by 35
- 2021Dataset for Identification of Homophobia and Transophobia in Multilingual YouTube Commentscited by 20
- 2021DravidianCodeMix: Sentiment Analysis and Offensive Language Identification Dataset for Dravidian Languages in Code-Mixed Textcited by 18
- 2023Representativeness as a Forgotten Lesson for Multilingual and Code-switched Data Collection and Preparationcited by 16
- 2023Memotion 3: Dataset on Sentiment and Emotion Analysis of Codemixed Hindi-English Memescited by 12
- 2021SJ_AJ@DravidianLangTech-EACL2021: Task-Adaptive Pre-Training of Multilingual BERT models for Offensive Language Identificationcited by 11
- 2021Comparing Approaches to Dravidian Language Identificationcited by 11
- 2024Social Intelligence Data Infrastructure: Structuring the Present and Navigating the Futurecited by 10
- 2021NLP-CUET@DravidianLangTech-EACL2021: Offensive Language Detection from Multilingual Code-Mixed Text using Transformerscited by 9
- 2024BnSentMix: A Diverse Bengali-English Code-Mixed Dataset for Sentiment Analysiscited by 9
- 2021Hate-Alert@DravidianLangTech-EACL2021: Ensembling strategies for Transformer-based Offensive language Detectioncited by 8
12 most cited of 66 All 66 (JSON)
- 2026PingPong: A Natural Benchmark for Multi-Turn Code-Switching Dialogues24 Jan 2026
- 2025Language-Independent Sentiment Labelling with Distant Supervision: A Case Study for English, Sepedi and Setswana25 Nov 2025
- 2025Adapting Multilingual Models to Code-Mixed Tasks via Model Merging22 Oct 2025
- 2025DIVERS-Bench: Evaluating Language Identification Across Domain Shifts and Code-Switching22 Sep 2025
- 2025Comparative Study of Pre-Trained BERT and Large Language Models for Code-Mixed Named Entity Recognition2 Sep 2025
- 2025Overcoming Low-Resource Barriers in Tulu: Neural Models and Corpus Creation for OffensiveLanguage Identification15 Aug 2025
- 2025Human-Centered Supervision for Sentiment Analysis in Telugu: A Systematic Inquiry Beyond Accuracy2 Aug 2025
- 2025CodeMixBench: Evaluating Code-Mixing Capabilities of LLMs Across 18 Languages24 Jul 2025
- 2025Statement-Tuning Enables Efficient Cross-lingual Generalization in Encoder-only Models2 Jun 2025
- 2025Multilingual Prompt Engineering in Large Language Models: A Survey Across NLP Tasks16 May 2025
- 2024User-Aware Multilingual Abusive Content Detection in Social Media26 Oct 2024
- 2024BnSentMix: A Diverse Bengali-English Code-Mixed Dataset for Sentiment Analysis16 Aug 2024
12 newest of 66 All 66 (JSON)