mlsanityData to 7 Oct 2026

MILPaC: A Novel Benchmark for Evaluating Translation of Legal Text to Indian Languages

arXiv 2310.09765 ↗First posted 15 Oct 2023cs.CL cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

Most legal text in the Indian judiciary is written in complex English due to historical reasons. However, only a small fraction of the Indian population is comfortable in reading English. Hence legal text needs to be made available in various Indian languages, possibly by translating the available legal text from English. Though there has been a lot of research on translation to and between Indian languages, to our knowledge, there has not been much prior work on such translation in the legal domain. In this work, we construct the first high-quality legal parallel corpus containing aligned text units in English and nine Indian languages, that includes several low-resource languages. We also benchmark the performance of a wide variety of Machine Translation (MT) systems over this corpus, including commercial MT systems, open-source MT systems and Large Language Models. Through a comprehensive survey by Law practitioners, we check how satisfied they are with the translations by some of these MT systems, and how well automatic MT evaluation metrics agree with the opinions of Law practitioners.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 13 of its 29 references that are in the map. First posted on arXiv 15 Oct 2023.

Builds on

13 of 29 references.

References · 13

  1. 2018A Call for Clarity in Reporting BLEU Scorescited by 1,790
  2. 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,471
  3. 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,290
  4. 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,028
  5. 2021The FLORES-101 Evaluation Benchmark for Low-Resource and Multilingual Machine Translationcited by 556
  6. 2020Multilingual Translation with Extensible Multilingual Pretraining and Finetuningcited by 287
  7. 2021Samanantar: The Largest Publicly Available Parallel Corpora Collection for 11 Indic Languagescited by 133
  8. 2017The IIT Bombay English-Hindi Parallel Corpuscited by 74
  9. 2020Not Low-Resource Anymore: Aligner Ensembling, Batch Filtering, and New Datasets for Bengali-English Machine Translationcited by 53
  10. 2020PMIndia -- A Collection of Parallel Corpora of Languages of Indiacited by 40
  11. 2020ChrEn: Cherokee-English Machine Translation for Endangered Language Revitalizationcited by 20
  12. 2020A Multilingual Parallel Corpora Collection Effort for Indian Languagescited by 16
1 more
  1. 2020Leveraging Multilingual News Websites for Building a Kurdish Parallel Corpuscited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 2; 2026: 1.

4 papers.

  1. 2024IL-TUR: Benchmark for Indian Legal Text Understanding and Reasoningcited by 16
  2. 2026Do LLM hallucination detectors suffer from low-resource effect?cited by 3
  3. 2025Judging by Appearances? Auditing and Intervening Vision-Language Models for Bail Predictioncited by 0
  4. 2025From Scratch to Fine-Tuned: A Comparative Study of Transformer Training Strategies for Legal Machine Translationcited by 0