An evaluation of Google Translate for Sanskrit to English translation via sentiment and semantic analysis
Not on the map. Why?
Abstract (arXiv)
Google Translate has been prominent for language translation; however, limited work has been done in evaluating the quality of translation when compared to human experts. Sanskrit one of the oldest written languages in the world. In 2022, the Sanskrit language was added to the Google Translate engine. Sanskrit is known as the mother of languages such as Hindi and an ancient source of the Indo-European group of languages. Sanskrit is the original language for sacred Hindu texts such as the Bhagavad Gita. In this study, we present a framework that evaluates the Google Translate for Sanskrit using the Bhagavad Gita. We first publish a translation of the Bhagavad Gita in Sanskrit using Google Translate. Our framework then compares Google Translate version of Bhagavad Gita with expert translations using sentiment and semantic analysis via BERT-based language models. Our results indicate that in terms of sentiment and semantic analysis, there is low level of similarity in selected verses of Google Translate when compared to expert translations. In the qualitative evaluation, we find that Google translate is unsuitable for translation of certain Sanskrit words and phrases due to its poetic nature, contextual significance, metaphor and imagery. The mistranslations are not surprising since the Bhagavad Gita is known as a difficult text not only to translate, but also to interpret since it relies on contextual, philosophical and historical information. Our framework lays the foundation for automatic evaluation of other languages by Google Translate
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 24 of its 103 references that are in the map. First posted on arXiv 28 Feb 2023.
Builds on
24 of 103 references.
References · 24
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
- 2020Reformer: The Efficient Transformercited by 1,658
- 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,046
- 2020MPNet: Masked and Permuted Pre-training for Language Understandingcited by 973
- 2015Improving Neural Machine Translation Models with Monolingual Datacited by 784
- 2019MASS: Masked Sequence to Sequence Pre-training for Language Generationcited by 345
- 2020Tangled up in BLEU: Reevaluating the Evaluation of Automatic Machine Translation Evaluation Metricscited by 155
- 2018Deep Learning for Sentiment Analysis : A Surveycited by 139
12 more
- 2021Neural Machine Translation for Low-Resource Languages: A Surveycited by 108
- 2020Leveraging Monolingual Data with Self-Supervision for Multilingual Neural Machine Translationcited by 51
- 2019Evaluating Word Embedding Models: Methods and Experimental Resultscited by 37
- 2020Sentiment Analysis Based on Deep Learning: A Comparative Studycited by 37
- 2020Sentiment Analysis: Automatically Detecting Valence, Emotions, and Other Affectual States from Textcited by 26
- 2021COVID-19 sentiment analysis via deep learning during the rise of novel casescited by 18
- 2020SenWave: Monitoring the Global Sentiments under the COVID-19 Pandemiccited by 16
- 2022Semantic and sentiment analysis of selected Bhagavad Gita translations using BERT-based language frameworkcited by 12
- 2020Neural Machine Translation: Challenges, Progress and Futurecited by 10
- 2022Artificial intelligence for topic modelling in Hindu philosophy: mapping themes between the Upanishads and the Bhagavad Gitacited by 6
- 2018Machine Translation: A Literature Reviewcited by 5
- 2021Sicilian Translator: A Recipe for Low-Resource NMTcited by 1
Built on by
Citing papers per year: 2024: 3; 2025: 2; 2026: 1.
6 papers.
- 2024Large language models for newspaper sentiment analysis during COVID-19: The Guardiancited by 4
- 2024Evaluation of Google Translate for Mandarin Chinese translation using sentiment and semantic analysiscited by 2
- 2025An evaluation of LLMs and Google Translate for translation of selected Indian languages via sentiment and semantic analysescited by 2
- 2025HP-BERT: A framework for longitudinal study of Hinduphobia on social media via language modelscited by 1
- 2024Large language model for Bible sentiment analysis: Sermon on the Mountcited by 0
- 2026Automated evaluation of LLMs for effective machine translation of Mandarin Chinese to Englishcited by 0
- 2026Automated evaluation of LLMs for effective machine translation of Mandarin Chinese to English15 Feb 2026
- 2025An evaluation of LLMs and Google Translate for translation of selected Indian languages via sentiment and semantic analyses27 Mar 2025
- 2025HP-BERT: A framework for longitudinal study of Hinduphobia on social media via language models7 Jan 2025
- 2024Evaluation of Google Translate for Mandarin Chinese translation using sentiment and semantic analysis8 Sep 2024
- 2024Large language models for newspaper sentiment analysis during COVID-19: The Guardian20 May 2024
- 2024Large language model for Bible sentiment analysis: Sermon on the Mount1 Jan 2024