Evaluating Neural Word Embeddings for Sanskrit
Not on the map. Why?
Abstract (arXiv)
Recently, the supervised learning paradigm's surprisingly remarkable performance has garnered considerable attention from Sanskrit Computational Linguists. As a result, the Sanskrit community has put laudable efforts to build task-specific labeled data for various downstream Natural Language Processing (NLP) tasks. The primary component of these approaches comes from representations of word embeddings. Word embedding helps to transfer knowledge learned from readily available unlabelled data for improving task-specific performance in low-resource setting. Last decade, there has been much excitement in the field of digitization of Sanskrit. To effectively use such readily available resources, it is very much essential to perform a systematic study on word embedding approaches for the Sanskrit language. In this work, we investigate the effectiveness of word embeddings. We classify word embeddings in broad categories to facilitate systematic experimentation and evaluate them on four intrinsic tasks. We investigate the efficacy of embeddings approaches (originally proposed for languages other than Sanskrit) for Sanskrit along with various challenges posed by language.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 22 of its 53 references that are in the map. First posted on arXiv 1 Apr 2021.
Builds on
22 of 53 references.
References · 22
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
- 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
- 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
- 2018Deep contextualized word representationscited by 2,285
- 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
- 2016Enriching Word Vectors with Subword Informationcited by 1,578
- 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,471
- 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 789
- 2018WiC: the Word-in-Context Dataset for Evaluating Context-Sensitive Meaning Representationscited by 370
- 2015Semi-supervised Sequence Learningcited by 198
10 more
- 2016Exploring the Limits of Language Modelingcited by 172
- 2015Character-Aware Neural Language Modelscited by 129
- 2017BPEmb: Tokenization-free Pre-trained Subword Embeddings in 275 Languagescited by 52
- 2018A Survey of Word Embeddings Evaluation Methodscited by 26
- 2016Charagram: Embedding Words and Sentences via Character n-gramscited by 14
- 2021A Little Pretraining Goes a Long Way: A Case Study on Dependency Parsing Task for Low-resource Morphologically Rich Languagescited by 9
- 2018Free as in Free Word Order: An Energy Based Model for Word Segmentation and Morphological Tagging in Sanskritcited by 8
- 2020Evaluating Neural Morphological Taggers for Sanskritcited by 7
- 2020Neural Approaches for Data Driven Dependency Parsing in Sanskritcited by 4
- 2018Building a Word Segmenter for Sanskrit Overnightcited by 2
Built on by
Citing papers per year: 2022: 1; 2023: 3; 2024: 1; 2025: 2; 2026: 1.
8 papers.
- 2024NLP Systems That Can't Tell Use from Mention Censor Counterspeech, but Teaching the Distinction Helpscited by 19
- 2023SanskritShala: A Neural Sanskrit NLP Toolkit with Web-Based Interface for Pedagogical and Annotation Purposescited by 5
- 2022A Novel Multi-Task Learning Approach for Context-Sensitive Compound Type Identification in Sanskritcited by 4
- 2023Linguistically-Informed Neural Architectures for Lexical, Syntactic and Semantic Tasks in Sanskritcited by 1
- 2025Mapping Hymns and Organizing Concepts in the Rigveda: Quantitatively Connecting the Vedic Suktascited by 1
- 2025Transformer-Enabled Diachronic Analysis of Vedic Sanskrit: Neural Methods for Quantifying Types of Language Changecited by 1
- 2023San-BERT: Extractive Summarization for Sanskrit Documents using BERT and it's variantscited by 0
- 2026A Computational Approach to Measuring Semantic Change in Sanskrit Literaturecited by 0
- 2026A Computational Approach to Measuring Semantic Change in Sanskrit Literature31 Jul 2026
- 2025Transformer-Enabled Diachronic Analysis of Vedic Sanskrit: Neural Methods for Quantifying Types of Language Change5 Dec 2025
- 2025Mapping Hymns and Organizing Concepts in the Rigveda: Quantitatively Connecting the Vedic Suktas23 Mar 2025
- 2024NLP Systems That Can't Tell Use from Mention Censor Counterspeech, but Teaching the Distinction Helps2 Apr 2024
- 2023Linguistically-Informed Neural Architectures for Lexical, Syntactic and Semantic Tasks in Sanskrit17 Aug 2023
- 2023San-BERT: Extractive Summarization for Sanskrit Documents using BERT and it's variants4 Apr 2023
- 2023SanskritShala: A Neural Sanskrit NLP Toolkit with Web-Based Interface for Pedagogical and Annotation Purposes19 Feb 2023
- 2022A Novel Multi-Task Learning Approach for Context-Sensitive Compound Type Identification in Sanskrit22 Aug 2022