PHINC: A Parallel Hinglish Social Media Code-Mixed Corpus for Machine Translation
Not on the map. Why?
Abstract (arXiv)
Code-mixing is the phenomenon of using more than one language in a sentence. It is a very frequently observed pattern of communication on social media platforms. Flexibility to use multiple languages in one text message might help to communicate efficiently with the target audience. But, it adds to the challenge of processing and understanding natural language to a much larger extent. This paper presents a parallel corpus of the 13,738 code-mixed English-Hindi sentences and their corresponding translation in English. The translations of sentences are done manually by the annotators. We are releasing the parallel corpus to facilitate future research opportunities in code-mixed machine translation. The annotated corpus is available at https://doi.org/10.5281/zenodo.3605597.
Key facts. Cited by 38 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 14; 2023: 4; 2024: 6; 2025: 4; 2026: 4.
38 papers.
Sort:
By area:
- 2022The Decades Progress on Code-Switching Research in NLP: A Systematic Survey on Trends and Challengescited by 35
- 2021HinGE: A Dataset for Generation and Evaluation of Code-Mixed Hinglish Textcited by 28
- 2021Challenges and Limitations with the Metrics Measuring the Complexity of Code-Mixed Textcited by 18
- 2021Exploring Text-to-Text Transformers for English to Hinglish Machine Translation with Synthetic Code-Mixingcited by 16
- 2023Representativeness as a Forgotten Lesson for Multilingual and Code-switched Data Collection and Preparationcited by 16
- 2022ArzEn-ST: A Three-way Speech Translation Corpus for Code-Switched Egyptian Arabic - Englishcited by 13
- 2024MINERS: Multilingual Language Models as Semantic Retrieverscited by 11
- 2022CALCS 2021 Shared Task: Machine Translation for Code-Switched Datacited by 9
- 2022EntityCS: Improving Zero-Shot Cross-lingual Transfer with Entity-Centric Code Switchingcited by 8
- 2025CodeMixBench: Evaluating Code-Mixing Capabilities of LLMs Across 18 Languagescited by 8
- 2021MIPE: A Metric Independent Pipeline for Effective Code-Mixed NLG Evaluationcited by 7
- 2021Quality Evaluation of the Low-Resource Synthetically Generated Code-Mixed Hinglish Textcited by 7
26 more
- 2022Exploring Segmentation Approaches for Neural Machine Translation of Code-Switched Egyptian Arabic-English Textcited by 7
- 2023Exploring Methods for Building Dialects-Mandarin Code-Mixing Corpora: A Case Study in Taiwanese Hokkiencited by 7
- 2024Code-Mixer Ya Nahi: Novel Approaches to Measuring Multilingual LLMs' Code-Mixing Capabilitiescited by 7
- 2024LlamaLens: Specialized Multilingual LLM for Analyzing News and Social Media Contentcited by 6
- 2025COMI-LINGUA: Expert Annotated Large-Scale Dataset for Multitask NLP in Hindi-English Code-Mixingcited by 6
- 2024Synthetic Data Generation and Joint Learning for Robust Code-Mixed Translationcited by 5
- 2024CHAI for LLMs: Improving Code-Mixed Translation in Large Language Models through Reinforcement Learning with AI Feedbackcited by 5
- 2021Challenges and Considerations with Code-Mixed NLP for Multilingual Societiescited by 4
- 2024Code-mixed Sentiment and Hate-speech Predictioncited by 4
- 2025Parallel Corpora for Machine Translation in Low-resource Indic Languages: A Comprehensive Reviewcited by 4
- 2022Am I No Good? Towards Detecting Perceived Burdensomeness and Thwarted Belongingness from Suicide Notescited by 3
- 2022Language Agnostic Code-Mixing Data Augmentation by Predicting Linguistic Patternscited by 3
- 2022A Comprehensive Understanding of Code-mixed Language Semantics using Hierarchical Transformercited by 2
- 2023MUTANT: A Multi-sentential Code-mixed Hinglish Datasetcited by 2
- 2023CONFLATOR: Incorporating Switching Point based Rotatory Positional Encodings for Code-Mixed Language Modelingcited by 2
- 2022SIT at MixMT 2022: Fluent Translation Built on Giant Pre-trained Modelscited by 1
- 2022Gui at MixMT 2022 : English-Hinglish: An MT approach for translation of code mixed datacited by 1
- 2026PingPong: A Natural Benchmark for Multi-Turn Code-Switching Dialoguescited by 1
- 2022JU_NLP at HinglishEval: Quality Evaluation of the Low-Resource Code-Mixed Hinglish Textcited by 0
- 2022Study of Encoder-Decoder Architectures for Code-Mix Search Query Translationcited by 0
- 2022The University of Edinburgh's Submission to the WMT22 Code-Mixing Shared Task (MixMT)cited by 0
- 2022Domain Curricula for Code-Switched MT at MixMT 2022cited by 0
- 2025Creating and Evaluating Code-Mixed Nepali-English and Telugu-English Datasets for Abusive Language Detection Using Traditional and Deep Learning Modelscited by 0
- 2026ChiEngMixBench: Evaluating Large Language Models on Expert-Style Chinese-English Terminology Mixingcited by 0
- 2026Neither Here Nor There: Cross-Lingual Representation Dynamics of Code-Mixed Text in Multilingual Encoderscited by 0
- 2026IndicTalk: A Large-Scale Persona-Based Multilingual Conversational Corpus for Indic Languagescited by 0
- 2026IndicTalk: A Large-Scale Persona-Based Multilingual Conversational Corpus for Indic Languages25 Jul 2026
- 2026Neither Here Nor There: Cross-Lingual Representation Dynamics of Code-Mixed Text in Multilingual Encoders20 Mar 2026
- 2026PingPong: A Natural Benchmark for Multi-Turn Code-Switching Dialogues24 Jan 2026
- 2026ChiEngMixBench: Evaluating Large Language Models on Expert-Style Chinese-English Terminology Mixing2 Jan 2026
- 2025CodeMixBench: Evaluating Code-Mixing Capabilities of LLMs Across 18 Languages24 Jul 2025
- 2025Creating and Evaluating Code-Mixed Nepali-English and Telugu-English Datasets for Abusive Language Detection Using Traditional and Deep Learning Models23 Apr 2025
- 2025COMI-LINGUA: Expert Annotated Large-Scale Dataset for Multitask NLP in Hindi-English Code-Mixing27 Mar 2025
- 2025Parallel Corpora for Machine Translation in Low-resource Indic Languages: A Comprehensive Review2 Mar 2025
- 2024CHAI for LLMs: Improving Code-Mixed Translation in Large Language Models through Reinforcement Learning with AI Feedback13 Nov 2024
- 2024LlamaLens: Specialized Multilingual LLM for Analyzing News and Social Media Content20 Oct 2024
- 2024Code-Mixer Ya Nahi: Novel Approaches to Measuring Multilingual LLMs' Code-Mixing Capabilities14 Oct 2024
- 2024MINERS: Multilingual Language Models as Semantic Retrievers11 Jun 2024
26 more
- 2024Code-mixed Sentiment and Hate-speech Prediction21 May 2024
- 2024Synthetic Data Generation and Joint Learning for Robust Code-Mixed Translation25 Mar 2024
- 2023Representativeness as a Forgotten Lesson for Multilingual and Code-switched Data Collection and Preparation31 Oct 2023
- 2023CONFLATOR: Incorporating Switching Point based Rotatory Positional Encodings for Code-Mixed Language Modeling11 Sep 2023
- 2023MUTANT: A Multi-sentential Code-mixed Hinglish Dataset23 Feb 2023
- 2023Exploring Methods for Building Dialects-Mandarin Code-Mixing Corpora: A Case Study in Taiwanese Hokkien21 Jan 2023
- 2022The Decades Progress on Code-Switching Research in NLP: A Systematic Survey on Trends and Challenges19 Dec 2022
- 2022ArzEn-ST: A Three-way Speech Translation Corpus for Code-Switched Egyptian Arabic - English22 Nov 2022
- 2022Language Agnostic Code-Mixing Data Augmentation by Predicting Linguistic Patterns14 Nov 2022
- 2022Domain Curricula for Code-Switched MT at MixMT 202231 Oct 2022
- 2022EntityCS: Improving Zero-Shot Cross-lingual Transfer with Entity-Centric Code Switching22 Oct 2022
- 2022Gui at MixMT 2022 : English-Hinglish: An MT approach for translation of code mixed data21 Oct 2022
- 2022SIT at MixMT 2022: Fluent Translation Built on Giant Pre-trained Models21 Oct 2022
- 2022The University of Edinburgh's Submission to the WMT22 Code-Mixing Shared Task (MixMT)20 Oct 2022
- 2022Exploring Segmentation Approaches for Neural Machine Translation of Code-Switched Egyptian Arabic-English Text11 Oct 2022
- 2022Study of Encoder-Decoder Architectures for Code-Mix Search Query Translation7 Aug 2022
- 2022JU_NLP at HinglishEval: Quality Evaluation of the Low-Resource Code-Mixed Hinglish Text16 Jun 2022
- 2022Am I No Good? Towards Detecting Perceived Burdensomeness and Thwarted Belongingness from Suicide Notes20 May 2022
- 2022A Comprehensive Understanding of Code-mixed Language Semantics using Hierarchical Transformer27 Apr 2022
- 2022CALCS 2021 Shared Task: Machine Translation for Code-Switched Data19 Feb 2022
- 2021Quality Evaluation of the Low-Resource Synthetically Generated Code-Mixed Hinglish Text4 Aug 2021
- 2021MIPE: A Metric Independent Pipeline for Effective Code-Mixed NLG Evaluation24 Jul 2021
- 2021HinGE: A Dataset for Generation and Evaluation of Code-Mixed Hinglish Text8 Jul 2021
- 2021Challenges and Limitations with the Metrics Measuring the Complexity of Code-Mixed Text18 Jun 2021
- 2021Challenges and Considerations with Code-Mixed NLP for Multilingual Societies15 Jun 2021
- 2021Exploring Text-to-Text Transformers for English to Hinglish Machine Translation with Synthetic Code-Mixing18 May 2021
- 2022The Decades Progress on Code-Switching Research in NLP: A Systematic Survey on Trends and Challengescited by 35
- 2021HinGE: A Dataset for Generation and Evaluation of Code-Mixed Hinglish Textcited by 28
- 2021Challenges and Limitations with the Metrics Measuring the Complexity of Code-Mixed Textcited by 18
- 2021Exploring Text-to-Text Transformers for English to Hinglish Machine Translation with Synthetic Code-Mixingcited by 16
- 2023Representativeness as a Forgotten Lesson for Multilingual and Code-switched Data Collection and Preparationcited by 16
- 2022ArzEn-ST: A Three-way Speech Translation Corpus for Code-Switched Egyptian Arabic - Englishcited by 13
- 2024MINERS: Multilingual Language Models as Semantic Retrieverscited by 11
- 2022CALCS 2021 Shared Task: Machine Translation for Code-Switched Datacited by 9
- 2022EntityCS: Improving Zero-Shot Cross-lingual Transfer with Entity-Centric Code Switchingcited by 8
- 2025CodeMixBench: Evaluating Code-Mixing Capabilities of LLMs Across 18 Languagescited by 8
- 2021MIPE: A Metric Independent Pipeline for Effective Code-Mixed NLG Evaluationcited by 7
- 2021Quality Evaluation of the Low-Resource Synthetically Generated Code-Mixed Hinglish Textcited by 7
12 most cited of 37 All 37 (JSON)
- 2026IndicTalk: A Large-Scale Persona-Based Multilingual Conversational Corpus for Indic Languages25 Jul 2026
- 2026Neither Here Nor There: Cross-Lingual Representation Dynamics of Code-Mixed Text in Multilingual Encoders20 Mar 2026
- 2026PingPong: A Natural Benchmark for Multi-Turn Code-Switching Dialogues24 Jan 2026
- 2026ChiEngMixBench: Evaluating Large Language Models on Expert-Style Chinese-English Terminology Mixing2 Jan 2026
- 2025CodeMixBench: Evaluating Code-Mixing Capabilities of LLMs Across 18 Languages24 Jul 2025
- 2025Creating and Evaluating Code-Mixed Nepali-English and Telugu-English Datasets for Abusive Language Detection Using Traditional and Deep Learning Models23 Apr 2025
- 2025COMI-LINGUA: Expert Annotated Large-Scale Dataset for Multitask NLP in Hindi-English Code-Mixing27 Mar 2025
- 2025Parallel Corpora for Machine Translation in Low-resource Indic Languages: A Comprehensive Review2 Mar 2025
- 2024LlamaLens: Specialized Multilingual LLM for Analyzing News and Social Media Content20 Oct 2024
- 2024Code-Mixer Ya Nahi: Novel Approaches to Measuring Multilingual LLMs' Code-Mixing Capabilities14 Oct 2024
- 2024MINERS: Multilingual Language Models as Semantic Retrievers11 Jun 2024
- 2024Code-mixed Sentiment and Hate-speech Prediction21 May 2024
12 newest of 37 All 37 (JSON)