mlsanityData to 7 Oct 2026

LEVOS: Leveraging Vocabulary Overlap with Sanskrit to Generate Technical Lexicons in Indian Languages

arXiv 2407.06331 ↗First posted 8 Jul 2024cs.CLcited by 4

Not on the map. Why?

Abstract (arXiv)

Translating technical terms into lexically similar, low-resource Indian languages remains a challenge due to limited parallel data and the complexity of linguistic structures. We propose a novel use-case of Sanskrit-based segments for linguistically informed translation of such terms, leveraging subword-level similarity and morphological alignment across related languages. Our approach uses character-level segmentation to identify meaningful subword units, facilitating more accurate and context-aware translation. To enable this, we utilize a Character-level Transformer model for Sanskrit Word Segmentation (CharSS), which addresses the complexities of sandhi and morpho-phonemic changes during segmentation. We observe consistent improvements in two experimental settings for technical term translation using Sanskrit-derived segments, averaging 8.46 and 6.79 chrF++ scores, respectively. Further, we conduct a post hoc human evaluation to verify the quality assessment of the translated technical terms using automated metrics. This work has important implications for the education field, especially in creating accessible, high-quality learning materials in Indian languages. By supporting the accurate and linguistically rooted translation of technical content, our approach facilitates inclusivity and aids in bridging the resource gap for learners in low-resource language communities.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 9 of its 22 references that are in the map. First posted on arXiv 8 Jul 2024.

Builds on

9 of 22 references.

References · 9

  1. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  2. 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,290
  3. 2021ByT5: Towards a token-free future with pre-trained byte-to-byte modelscited by 504
  4. 2022TransLIST: A Transformer-Based Linguistically Informed Sanskrit Tokenizercited by 13
  5. 2020Validation and Normalization of DCS corpus using Sanskrit Heritage tools to build a tagged Gold Corpuscited by 6
  6. 2018Sanskrit Sandhi Splitting using seq2(seq)^2cited by 5
  7. 2020Neural Compound-Word (Sandhi) Generation and Splitting in Sanskrit Languagecited by 4
  8. 2024LexGen: Domain-aware Multilingual Lexicon Generationcited by 2
  9. 2016Faster decoding for subword level Phrase-based SMT between related languagescited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.