mlsanityData to 7 Oct 2026

The IIT Bombay English-Hindi Parallel Corpus

arXiv 1710.02855 ↗First posted 8 Oct 2017cs.CLcited by 74

Not on the map. Why?

Abstract (arXiv)

We present the IIT Bombay English-Hindi Parallel Corpus. The corpus is a compilation of parallel corpora previously available in the public domain as well as new parallel corpora we collected. The corpus contains 1.49 million parallel segments, of which 694k segments were not previously available in the public domain. The corpus has been pre-processed for machine translation, and we report baseline phrase-based SMT and NMT translation results on this corpus. This corpus has been used in two editions of shared tasks at the Workshop on Asian Language Translation (2016 and 2017). The corpus is freely available for non-commercial research. To the best of our knowledge, this is the largest publicly available English-Hindi parallel corpus.

Key facts. Cited by 74 papers in the map (data through 7 Oct 2026). First posted on arXiv 8 Oct 2017.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 24; 2022: 16; 2023: 15; 2024: 6; 2025: 8; 2026: 5.

74 papers.

Sort:

By area:

  1. 2023The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Datasetcited by 148
  2. 2021Samanantar: The Largest Publicly Available Parallel Corpora Collection for 11 Indic Languagescited by 133
  3. 2021AMMUS : A Survey of Transformer-based Pretrained Models in Natural Language Processingcited by 131
  4. 2023Accelerating Transformer Inference for Translation via Parallel Decodingcited by 123
  5. 2023Glot500: Scaling Multilingual Corpora and Language Models to 500 Languagescited by 116
  6. 2021XLM-E: Cross-lingual Language Model Pre-training via ELECTRAcited by 72
  7. 2023An Open Dataset and Model for Language Identificationcited by 49
  8. 2024Multilingual Large Language Model: A Survey of Resources, Taxonomy and Frontierscited by 49
  9. 2021MT6: Multilingual Pretrained Text-to-Text Transformer with Translation Pairscited by 41
  10. 2021Improving Pretrained Cross-Lingual Language Models via Self-Labeled Word Alignmentcited by 41
  11. 2022A Survey on Cross-Lingual Summarizationcited by 38
  12. 2023GlotLID: Language Identification for Low-Resource Languagescited by 37
38 more
  1. 2021Many-to-English Machine Translation Tools, Data, and Pretrained Modelscited by 31
  2. 2021From Machine Translation to Code-Switching: Generating High-Quality Code-Switched Textcited by 29
  3. 2021Socially Aware Bias Measurements for Hindi Language Representationscited by 29
  4. 2022ERNIE-Code: Beyond English-Centric Cross-lingual Pretraining for Programming Languagescited by 29
  5. 2021HinGE: A Dataset for Generation and Evaluation of Code-Mixed Hinglish Textcited by 28
  6. 2024Goldfish: Monolingual Language Models for 350 Languagescited by 27
  7. 2021Role of Language Relatedness in Multilingual Fine-tuning of Language Models: A Case Study in Indo-Aryan Languagescited by 24
  8. 2023Taxi1500: A Multilingual Dataset for Text Classification in 1500 Languagescited by 23
  9. 2021Multilingual Unsupervised Neural Machine Translation with Denoising Adapterscited by 22
  10. 2021PARADISE: Exploiting Parallel Data for Multilingual Sequence-to-Sequence Pretrainingcited by 21
  11. 2022Evaluating the Diversity, Equity and Inclusion of NLP Technology: A Case Study for Indian Languagescited by 20
  12. 2021Evaluating Gender Bias in Hindi-English Machine Translationcited by 19
  13. 2021Using Optimal Transport as Alignment Objective for fine-tuning Multilingual Contextualized Embeddingscited by 19
  14. 2022Aksharantar: Open Indic-language Transliteration datasets and models for the Next Billion Userscited by 19
  15. 2021Adapting High-resource NMT Models to Translate Low-resource Related Languages without Parallel Datacited by 17
  16. 2021Exploring Text-to-Text Transformers for English to Hinglish Machine Translation with Synthetic Code-Mixingcited by 16
  17. 2024EMMA-500: Enhancing Massively Multilingual Adaptation of Large Language Modelscited by 16
  18. 2025Llama-3-Nanda-10B-Chat: An Open Generative Large Language Model for Hindicited by 10
  19. 2021MIPE: A Metric Independent Pipeline for Effective Code-Mixed NLG Evaluationcited by 7
  20. 2021Quality Evaluation of the Low-Resource Synthetically Generated Code-Mixed Hinglish Textcited by 7
  21. 2022When does Parameter-Efficient Transfer Learning Work for Machine Translation?cited by 7
  22. 2022ERNIE-UniX2: A Unified Cross-lingual Cross-modal Framework for Understanding and Generationcited by 7
  23. 2023LIMIT: Language Identification, Misidentification, and Translation using Hierarchical Models in 350+ Languagescited by 6
  24. 2025COMI-LINGUA: Expert Annotated Large-Scale Dataset for Multitask NLP in Hindi-English Code-Mixingcited by 6
  25. 2021"Wikily" Supervised Neural Translation Tailored to Cross-Lingual Taskscited by 5
  26. 2021ViTA: Visual-Linguistic Translation by Aligning Object Tagscited by 5
  27. 2024Synthetic Data Generation and Joint Learning for Robust Code-Mixed Translationcited by 5
  28. 2023MILPaC: A Novel Benchmark for Evaluating Translation of Legal Text to Indian Languagescited by 4
  29. 2025Parallel Corpora for Machine Translation in Low-resource Indic Languages: A Comprehensive Reviewcited by 4
  30. 2026OpenLID-v3: Improving the Precision of Closely Related Language Identification -- An Experience Reportcited by 4
  31. 2021HintedBT: Augmenting Back-Translation with Quality and Transliteration Hintscited by 3
  32. 2021Ceasing hate withMoH: Hate Speech Detection in Hindi-English Code-Switched Languagecited by 3
  33. 2022OneAligner: Zero-shot Cross-lingual Transfer with One Rich-Resource Language Pair for Low-Resource Sentence Retrievalcited by 3
  34. 2022Nebula-I: A General Framework for Collaboratively Training Deep Learning Models on Low-Bandwidth Cloud Clusterscited by 3
  35. 2022Multi-level Distillation of Semantic Knowledge for Pre-training Multilingual Language Modelcited by 3
  36. 2022Language Agnostic Code-Mixing Data Augmentation by Predicting Linguistic Patternscited by 3
  37. 2024HindiLLM: Large Language Model for Hindicited by 3
  38. 2025Pivot Language for Low-Resource Machine Translationcited by 3

50 most cited of 74 All 74 (JSON)