# Automatic Identification of Closely-related Indian Languages: Resources and Experiments

arXiv: https://arxiv.org/abs/1803.09405 · HTML: https://mlsanity.com/paper/1803.09405/

## Key facts

- Cited by 5 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 26 Mar 2018.

## Built on by (most cited first, 5 of 5)

- [Role of Language Relatedness in Multilingual Fine-tuning of Language Models: A Case Study in Indo-Aryan Languages](https://mlsanity.com/paper/2109.10534/) (2021)
- [UniMorph 4.0: Universal Morphology](https://mlsanity.com/paper/2205.03608/) (2022)
- [Multilingual Text Style Transfer: Datasets & Models for Indian Languages](https://mlsanity.com/paper/2405.20805/) (2024)
- [Language Resources and Technologies for Non-Scheduled and Endangered Indian Languages](https://mlsanity.com/paper/2204.02822/) (2022)
- [Developing Universal Dependency Treebanks for Magahi and Braj](https://mlsanity.com/paper/2204.12633/) (2022)

## Abstract (arXiv)

In this paper, we discuss an attempt to develop an automatic language identification system for 5 closely-related Indo-Aryan languages of India, Awadhi, Bhojpuri, Braj, Hindi and Magahi. We have compiled a comparable corpora of varying length for these languages from various resources. We discuss the method of creation of these corpora in detail. Using these corpora, a language identification system was developed, which currently gives state of the art accuracy of 96.48%. We also used these corpora to study the similarity between the 5 languages at the lexical level, which is the first data-based study of the extent of closeness of these languages.