# Towards Sub-Word Level Compositions for Sentiment Analysis of Hindi-English Code Mixed Text

arXiv: https://arxiv.org/abs/1611.00472 · HTML: https://mlsanity.com/paper/1611.00472/

## Key facts

- Cited by 31 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 2 Nov 2016.

## Built on by (most cited first, 30 of 31)

- [The Decades Progress on Code-Switching Research in NLP: A Systematic Survey on Trends and Challenges](https://mlsanity.com/paper/2212.09660/) (2022)
- [HinGE: A Dataset for Generation and Evaluation of Code-Mixed Hinglish Text](https://mlsanity.com/paper/2107.03760/) (2021)
- [Multilingual Code-Switching for Zero-Shot Cross-Lingual Intent Prediction and Slot Filling](https://mlsanity.com/paper/2103.07792/) (2021)
- [Experimental Evaluation of Deep Learning models for Marathi Text Classification](https://mlsanity.com/paper/2101.04899/) (2021)
- [Challenges and Limitations with the Metrics Measuring the Complexity of Code-Mixed Text](https://mlsanity.com/paper/2106.10123/) (2021)
- [Memotion 3: Dataset on Sentiment and Emotion Analysis of Codemixed Hindi-English Memes](https://mlsanity.com/paper/2303.09892/) (2023)
- [BnSentMix: A Diverse Bengali-English Code-Mixed Dataset for Sentiment Analysis](https://mlsanity.com/paper/2408.08964/) (2024)
- [Towards Emotion Recognition in Hindi-English Code-Mixed Data: A Transformer Based Approach](https://mlsanity.com/paper/2102.09943/) (2021)
- [MIPE: A Metric Independent Pipeline for Effective Code-Mixed NLG Evaluation](https://mlsanity.com/paper/2107.11534/) (2021)
- [SentMix-3L: A Bangla-English-Hindi Code-Mixed Dataset for Sentiment Analysis](https://mlsanity.com/paper/2310.18023/) (2023)
- [Sentiment Analysis of Persian-English Code-mixed Texts](https://mlsanity.com/paper/2102.12700/) (2021)
- [Constructing Code-mixed Universal Dependency Forest for Unbiased Cross-lingual Relation Extraction](https://mlsanity.com/paper/2305.12258/) (2023)
- [LlamaLens: Specialized Multilingual LLM for Analyzing News and Social Media Content](https://mlsanity.com/paper/2410.15308/) (2024)
- [HIT: A Hierarchically Fused Deep Attention Network for Robust Code-mixed Language Representation](https://mlsanity.com/paper/2105.14600/) (2021)
- [Beyond Monolingual Assumptions: A Survey of Code-Switched NLP in the Era of Large Language Models across Modalities](https://mlsanity.com/paper/2510.07037/) (2025)
- [Cross-Lingual Text Classification of Transliterated Hindi and Malayalam](https://mlsanity.com/paper/2108.13620/) (2021)
- [Code-mixed Sentiment and Hate-speech Prediction](https://mlsanity.com/paper/2405.12929/) (2024)
- [CMSAOne@Dravidian-CodeMix-FIRE2020: A Meta Embedding and Transformer model for Code-Mixed Sentiment Analysis on Social Media Text](https://mlsanity.com/paper/2101.09004/) (2021)
- [Ceasing hate withMoH: Hate Speech Detection in Hindi-English Code-Switched Language](https://mlsanity.com/paper/2110.09393/) (2021)
- [Comparative Study of Pre-Trained BERT Models for Code-Mixed Hindi-English Data](https://mlsanity.com/paper/2305.15722/) (2023)
- [A Comprehensive Understanding of Code-mixed Language Semantics using Hierarchical Transformer](https://mlsanity.com/paper/2204.12753/) (2022)
- [Automatic Identification of Motivation for Code-Switching in Speech Transcripts](https://mlsanity.com/paper/2212.08565/) (2022)
- [Elevating Code-mixed Text Handling through Auditory Information of Words](https://mlsanity.com/paper/2310.18155/) (2023)
- [Adapting Multilingual Models to Code-Mixed Tasks via Model Merging](https://mlsanity.com/paper/2510.19782/) (2025)
- [RAM-SD: Retrieval-Augmented Multi-agent framework for Sarcasm Detection](https://mlsanity.com/paper/2601.17002/) (2026)
- [Detection of Emotions in Hindi-English Code Mixed Text Data](https://mlsanity.com/paper/2105.09226/) (2021)
- [AtteSTNet -- An attention and subword tokenization based approach for code-switched text hate speech detection](https://mlsanity.com/paper/2112.11479/) (2021)
- [Detecting Anchors' Opinion in Hinghlish News Delivery](https://mlsanity.com/paper/2204.02155/) (2022)
- [Leveraging Language Identification to Enhance Code-Mixed Text Classification](https://mlsanity.com/paper/2306.04964/) (2023)
- [Cyberbullying Detection in Hinglish Text Using MURIL and Explainable AI](https://mlsanity.com/paper/2506.16066/) (2025)

## Abstract (arXiv)

Sentiment analysis (SA) using code-mixed data from social media has several applications in opinion mining ranging from customer satisfaction to social campaign analysis in multilingual societies. Advances in this area are impeded by the lack of a suitable annotated dataset. We introduce a Hindi-English (Hi-En) code-mixed dataset for sentiment analysis and perform empirical analysis comparing the suitability and performance of various state-of-the-art SA methods in social media. In this paper, we introduce learning sub-word level representations in LSTM (Subword-LSTM) architecture instead of character-level or word-level representations. This linguistic prior in our architecture enables us to learn the information about sentiment value of important morphemes. This also seems to work well in highly noisy text containing misspellings as shown in our experiments which is demonstrated in morpheme-level feature maps learned by our model. Also, we hypothesize that encoding this linguistic prior in the Subword-LSTM architecture leads to the superior performance. Our system attains accuracy 4-5% greater than traditional approaches on our dataset, and also outperforms the available system for sentiment analysis in Hi-En code-mixed text by 18%.
