mlsanityData to 7 Oct 2026

Evaluating Neural Word Embeddings for Sanskrit

arXiv 2104.00270 ↗First posted 1 Apr 2021cs.CLcited by 8

Not on the map. Why?

Abstract (arXiv)

Recently, the supervised learning paradigm's surprisingly remarkable performance has garnered considerable attention from Sanskrit Computational Linguists. As a result, the Sanskrit community has put laudable efforts to build task-specific labeled data for various downstream Natural Language Processing (NLP) tasks. The primary component of these approaches comes from representations of word embeddings. Word embedding helps to transfer knowledge learned from readily available unlabelled data for improving task-specific performance in low-resource setting. Last decade, there has been much excitement in the field of digitization of Sanskrit. To effectively use such readily available resources, it is very much essential to perform a systematic study on word embedding approaches for the Sanskrit language. In this work, we investigate the effectiveness of word embeddings. We classify word embeddings in broad categories to facilitate systematic experimentation and evaluate them on four intrinsic tasks. We investigate the efficacy of embeddings approaches (originally proposed for languages other than Sanskrit) for Sanskrit along with various challenges posed by language.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 22 of its 53 references that are in the map. First posted on arXiv 1 Apr 2021.

Builds on

22 of 53 references.

References · 22

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
  4. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
  5. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
  6. 2018Deep contextualized word representationscited by 2,285
  7. 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
  8. 2016Enriching Word Vectors with Subword Informationcited by 1,578
  9. 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,471
  10. 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 789
  11. 2018WiC: the Word-in-Context Dataset for Evaluating Context-Sensitive Meaning Representationscited by 370
  12. 2015Semi-supervised Sequence Learningcited by 198
10 more
  1. 2016Exploring the Limits of Language Modelingcited by 172
  2. 2015Character-Aware Neural Language Modelscited by 129
  3. 2017BPEmb: Tokenization-free Pre-trained Subword Embeddings in 275 Languagescited by 52
  4. 2018A Survey of Word Embeddings Evaluation Methodscited by 26
  5. 2016Charagram: Embedding Words and Sentences via Character n-gramscited by 14
  6. 2021A Little Pretraining Goes a Long Way: A Case Study on Dependency Parsing Task for Low-resource Morphologically Rich Languagescited by 9
  7. 2018Free as in Free Word Order: An Energy Based Model for Word Segmentation and Morphological Tagging in Sanskritcited by 8
  8. 2020Evaluating Neural Morphological Taggers for Sanskritcited by 7
  9. 2020Neural Approaches for Data Driven Dependency Parsing in Sanskritcited by 4
  10. 2018Building a Word Segmenter for Sanskrit Overnightcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 1; 2023: 3; 2024: 1; 2025: 2; 2026: 1.

8 papers.