mlsanityData to 14 Oct 2026

bharatSetu: a 1M x 22 bridge for indic translation

arXiv 2610.15705 ↗First posted 11 Oct 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

India's Eighth Schedule recognises 22 languages, yet parallel data is uneven across them, and many language pairs, especially among lower-resource languages such as Bodo, Dogri, Santali and Kashmiri, lack direct bitext. We present BharatSetu 22-Indic 1M, a row-aligned table of 984,764 English sentences, each paired with machine translations into all 22 scheduled languages (21,664,808 Indic cells), generated with the sarvamai/sarvam-translate model family. Because every Indic cell in a row translates the same English sentence, any two columns form a translation pair: 462 directed Indic-to-Indic pairs, or 506 including English, without direct bitext. We call these pivot-derived pairs and propose a confidence layer that lets users choose how strictly each pair is connected. The corpus is machine-generated and not human-verified; quality is expected to vary by language, domain and sentence style, and pivot-derived pairs can inherit errors from both sides. We therefore release BharatSetu as a machine layer and propose a human-correction layer keyed to the same row identifiers, so that each corrected column upgrades every pair that uses it, together with an evaluation protocol. We report no translation-quality results.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 21 references that are in the map. First posted on arXiv 11 Oct 2026.

Builds on

10 of 21 references.

References · 10

  1. 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,035
  2. 2020COMET: A Neural Framework for MT Evaluationcited by 1,033
  3. 2015Improving Neural Machine Translation Models with Monolingual Datacited by 788
  4. 2020Beyond English-Centric Multilingual Machine Translationcited by 561
  5. 2021Documenting Large Webtext Corpora: A Case Study on the Colossal Clean Crawled Corpuscited by 492
  6. 2021Experts, Errors, and Context: A Large-Scale Study of Human Evaluation for Machine Translationcited by 338
  7. 2019WikiMatrix: Mining 135M Parallel Sentences in 1620 Language Pairs from Wikipediacited by 223
  8. 2023IndicTrans2: Towards High-Quality and Accessible Machine Translation Models for all 22 Scheduled Indian Languagescited by 152
  9. 2021Samanantar: The Largest Publicly Available Parallel Corpora Collection for 11 Indic Languagescited by 136
  10. 2020The Tatoeba Translation Challenge -- Realistic Data Sets for Low Resource and Multilingual MTcited by 128

Built on by

Not cited yet.