Learnings from Technological Interventions in a Low Resource Language: Enhancing Information Access in Gondi
Not on the map. Why?
Abstract (arXiv)
The primary obstacle to developing technologies for low-resource languages is the lack of representative, usable data. In this paper, we report the deployment of technology-driven data collection methods for creating a corpus of more than 60,000 translations from Hindi to Gondi, a low-resource vulnerable language spoken by around 2.3 million tribal people in south and central India. During this process, we help expand information access in Gondi across 2 different dimensions (a) The creation of linguistic resources that can be used by the community, such as a dictionary, children's stories, Gondi translations from multiple sources and an Interactive Voice Response (IVR) based mass awareness platform; (b) Enabling its use in the digital domain by developing a Hindi-Gondi machine translation model, which is compressed by nearly 4 times to enable it's edge deployment on low-resource edge devices and in areas of little to no internet connectivity. We also present preliminary evaluations of utilizing the developed machine translation model to provide assistance to volunteers who are involved in collecting more data for the target language. Through these interventions, we not only created a refined and evaluated corpus of 26,240 Hindi-Gondi translations that was used for building the translation model but also engaged nearly 850 community members who can help take Gondi onto the internet.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 65 references that are in the map. First posted on arXiv 29 Nov 2022.
Builds on
15 of 65 references.
References · 15
- 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,813
- 2021Quality at a Glance: An Audit of Web-Crawled Multilingual Datasetscited by 241
- 2018On the Impact of Various Types of Noise on Neural Machine Translationcited by 76
- 2020Language ID in the Wild: Unexpected Challenges on the Path to a Thousand-Language Web Text Corpuscited by 76
- 2021Beyond Fair Pay: Ethical Implications of NLP Crowdsourcingcited by 52
- 2022Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptationcited by 44
- 2020OCR Post Correction for Endangered Language Textscited by 31
- 2021What Ingredients Make for an Effective Crowdsourcing Protocol for Difficult NLU Data Collection Tasks?cited by 23
- 2019Unsung Challenges of Building and Deploying Language Technologies for Low Resource Language Communitiescited by 19
- 2020Unmet Needs and Opportunities for Mobile Translation AIcited by 14
- 2021Toward Annotator Group Bias in Crowdsourcingcited by 14
- 2021Quantifying and Avoiding Unfair Qualification Labour in Crowdsourcingcited by 11
Built on by
Not cited yet.