mlsanityData to 7 Oct 2026

A New Dataset for Natural Language Inference from Code-mixed Conversations

arXiv 2004.05051 ↗First posted 10 Apr 2020cs.CLcited by 29

Not on the map. Why?

Abstract (arXiv)

Natural Language Inference (NLI) is the task of inferring the logical relationship, typically entailment or contradiction, between a premise and hypothesis. Code-mixing is the use of more than one language in the same conversation or utterance, and is prevalent in multilingual communities all over the world. In this paper, we present the first dataset for code-mixed NLI, in which both the premises and hypotheses are in code-mixed Hindi-English. We use data from Hindi movies (Bollywood) as premises, and crowd-source hypotheses from Hindi-English bilinguals. We conduct a pilot annotation study and describe the final annotation protocol based on observations from the pilot. Currently, the data collected consists of 400 premises in the form of code-mixed conversation snippets and 2240 code-mixed hypotheses. We conduct an extensive analysis to infer the linguistic phenomena commonly observed in the dataset obtained. We evaluate the dataset using a standard mBERT-based pipeline for NLI and report results.

Key facts. Cited by 29 papers in the map (data through 7 Oct 2026). First posted on arXiv 10 Apr 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 5; 2022: 6; 2023: 8; 2024: 4; 2025: 5; 2026: 1.

29 papers.

Sort:

By area:

  1. 2023MEGA: Multilingual Evaluation of Generative AIcited by 291
  2. 2023MEGAVERSE: Benchmarking Large Language Models Across Languages, Modalities, Models and Taskscited by 57
  3. 2022The Decades Progress on Code-Switching Research in NLP: A Systematic Survey on Trends and Challengescited by 35
  4. 2024Code-Switching Red-Teaming: LLM Evaluation for Safety and Multilingual Understandingcited by 34
  5. 2024Code-Switching Curriculum Learning for Multilingual Transfer in LLMscited by 26
  6. 2021IndoNLI: A Natural Language Inference Dataset for Indonesiancited by 24
  7. 2022Evaluating the Diversity, Equity and Inclusion of NLP Technology: A Case Study for Indian Languagescited by 20
  8. 2021Challenges and Limitations with the Metrics Measuring the Complexity of Code-Mixed Textcited by 18
  9. 2023Representativeness as a Forgotten Lesson for Multilingual and Code-switched Data Collection and Preparationcited by 16
  10. 2022JamPatoisNLI: A Jamaican Patois Natural Language Inference Datasetcited by 11
  11. 2025CodeMixBench: Evaluating Code-Mixing Capabilities of LLMs Across 18 Languagescited by 8
  12. 2021MIPE: A Metric Independent Pipeline for Effective Code-Mixed NLG Evaluationcited by 7
17 more
  1. 2023Exploring Methods for Building Dialects-Mandarin Code-Mixing Corpora: A Case Study in Taiwanese Hokkiencited by 7
  2. 2025COMI-LINGUA: Expert Annotated Large-Scale Dataset for Multitask NLP in Hindi-English Code-Mixingcited by 6
  3. 2021GupShup: An Annotated Corpus for Abstractive Summarization of Open-Domain Code-Switched Conversationscited by 4
  4. 2021The Effectiveness of Intermediate-Task Training for Code-Switched Natural Language Understandingcited by 4
  5. 2022CMNEROne at SemEval-2022 Task 11: Code-Mixed Named Entity Recognition by leveraging multilingual datacited by 4
  6. 2024Code-mixed Sentiment and Hate-speech Predictioncited by 4
  7. 2025Beyond Monolingual Assumptions: A Survey of Code-Switched NLP in the Era of Large Language Models across Modalitiescited by 4
  8. 2022Prabhupadavani: A Code-mixed Speech Translation Data for 25 Languagescited by 2
  9. 2023MUTANT: A Multi-sentential Code-mixed Hinglish Datasetcited by 2
  10. 2023Marathi-English Code-mixed Text Generationcited by 2
  11. 2022Automatic Identification of Motivation for Code-Switching in Speech Transcriptscited by 1
  12. 2023Linguistically-Informed Neural Architectures for Lexical, Syntactic and Semantic Tasks in Sanskritcited by 1
  13. 2024Improving Cross-lingual Representation for Semantic Retrieval with Code-switchingcited by 1
  14. 2026ViLegalNLI: Natural Language Inference for Vietnamese Legal Textscited by 1
  15. 2023Thematic context vector association based on event uncertainty for Twittercited by 0
  16. 2025Creating and Evaluating Code-Mixed Nepali-English and Telugu-English Datasets for Abusive Language Detection Using Traditional and Deep Learning Modelscited by 0
  17. 2025Disentangling Codemixing in Chats: The NUS ABC Codemixed Corpuscited by 0