Artificial intelligence for topic modelling in Hindu philosophy: mapping themes between the Upanishads and the Bhagavad Gita
Not on the map. Why?
Abstract (arXiv)
A distinct feature of Hindu religious and philosophical text is that they come from a library of texts rather than single source. The Upanishads is known as one of the oldest philosophical texts in the world that forms the foundation of Hindu philosophy. The Bhagavad Gita is core text of Hindu philosophy and is known as a text that summarises the key philosophies of the Upanishads with major focus on the philosophy of karma. These texts have been translated into many languages and there exists studies about themes and topics that are prominent; however, there is not much study of topic modelling using language models which are powered by deep learning. In this paper, we use advanced language produces such as BERT to provide topic modelling of the key texts of the Upanishads and the Bhagavad Gita. We analyse the distinct and overlapping topics amongst the texts and visualise the link of selected texts of the Upanishads with Bhagavad Gita. Our results show a very high similarity between the topics of these two texts with the mean cosine similarity of 73%. We find that out of the fourteen topics extracted from the Bhagavad Gita, nine of them have a cosine similarity of more than 70% with the topics of the Upanishads. We also found that topics generated by the BERT-based models show very high coherence as compared to that of conventional models. Our best performing model gives a coherence score of 73% on the Bhagavad Gita and 69% on The Upanishads. The visualization of the low dimensional embeddings of these texts shows very clear overlapping among their topics adding another level of validation to our results.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 34 of its 186 references that are in the map. First posted on arXiv 23 May 2022.
Builds on
34 of 186 references.
References · 34
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
- 2020Longformer: The Long-Document Transformercited by 3,362
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
- 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
- 2015Character-level Convolutional Networks for Text Classificationcited by 2,293
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
22 more
- 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
- 2022BERTopic: Neural topic modeling with a class-based TF-IDF procedurecited by 779
- 2021Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategiescited by 736
- 2018Universal Sentence Encodercited by 485
- 2020Med-BERT: pre-trained contextualized embeddings on large-scale structured electronic health records for disease predictioncited by 368
- 2015LSTM: A Search Space Odysseycited by 315
- 2019Benchmarking Zero-shot Text Classification: Datasets, Evaluation and Entailment Approachcited by 299
- 2016LSTM-based Encoder-Decoder for Multi-sensor Anomaly Detectioncited by 213
- 2020Top2Vec: Distributed Representations of Topicscited by 124
- 2020LEGAL-BERT: The Muppets straight out of Law Schoolcited by 111
- 2017Accelerated Hierarchical Density Clusteringcited by 100
- 2020COVID-Twitter-BERT: A Natural Language Processing Model to Analyse COVID-19 Content on Twittercited by 96
- 2020Tired of Topic Models? Clusters of Pretrained Word Embeddings Make for Fast and Good Topics too!cited by 73
- 2019Exploiting BERT for End-to-End Aspect-based Sentiment Analysiscited by 57
- 2020QED: A Framework and Dataset for Explanations in Question Answeringcited by 55
- 2019Towards Making the Most of BERT in Neural Machine Translationcited by 43
- 2020Topic Modeling with Contextualized Word Representation Clusterscited by 41
- 2019On the use of BERT for Neural Machine Translationcited by 23
- 2020Context-Guided BERT for Targeted Aspect-Based Sentiment Analysiscited by 18
- 2021COVID-19 sentiment analysis via deep learning during the rise of novel casescited by 18
- 2022Semantic and sentiment analysis of selected Bhagavad Gita translations using BERT-based language frameworkcited by 12
- 2021Better Neural Machine Translation by Extracting Linguistic Information from BERTcited by 5
Built on by
Citing papers per year: 2023: 2; 2024: 2; 2025: 2.
6 papers.
- 2023An evaluation of Google Translate for Sanskrit to English translation via sentiment and semantic analysiscited by 6
- 2023Deep learning for COVID-19 topic modelling via Twitter: Alpha, Delta and Omicroncited by 4
- 2024Modeling the Sacred: Considerations when Using Religious Texts in Natural Language Processingcited by 1
- 2025Mapping Hymns and Organizing Concepts in the Rigveda: Quantitatively Connecting the Vedic Suktascited by 1
- 2025Machine Learning for Detection and Analysis of Novel LLM Jailbreakscited by 1
- 2024Large language model for Bible sentiment analysis: Sermon on the Mountcited by 0
- 2025Machine Learning for Detection and Analysis of Novel LLM Jailbreaks2 Oct 2025
- 2025Mapping Hymns and Organizing Concepts in the Rigveda: Quantitatively Connecting the Vedic Suktas23 Mar 2025
- 2024Modeling the Sacred: Considerations when Using Religious Texts in Natural Language Processing23 Apr 2024
- 2024Large language model for Bible sentiment analysis: Sermon on the Mount1 Jan 2024
- 2023An evaluation of Google Translate for Sanskrit to English translation via sentiment and semantic analysis28 Feb 2023
- 2023Deep learning for COVID-19 topic modelling via Twitter: Alpha, Delta and Omicron28 Feb 2023