mlsanityData to 14 Oct 2026

SiPaKosa: A Comprehensive Corpus of Canonical and Classical Buddhist Texts in Sinhala and Pali

arXiv 2603.29221 ↗First posted 31 Mar 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

SiPaKosa is a comprehensive corpus of Sinhala and Pali doctrinal texts comprising approximately 786K sentences and 9.25M words, incorporating 16 copyright-cleared historical Buddhist documents alongside the complete web-scraped Tripitaka canonical texts. The corpus was created through high-quality OCR using Google Document AI on historical manuscripts, combined with systematic web scraping of canonical repositories, followed by rigorous quality control and metadata annotation. The corpus is organised into language-specific subcorpora: Sinhala and Mixed Sinhala-Pali. We evaluate the performance of language models using ten pretrained models, with perplexity scores ranging from 1.09 to 189.67 on our corpus. This analysis shows that proprietary models significantly outperform open-source alternatives by factors of three to six times. This corpus supports the pretraining of domain-adapted language models, facilitates historical language analysis, and aids in the development of information retrieval systems for Buddhist scholarship while preserving Sinhala cultural heritage.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 32 of its 65 references that are in the map. First posted on arXiv 31 Mar 2026.

Builds on

32 of 65 references.

References · 32

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,899
  3. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
  4. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
  5. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  6. 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
  7. 2019SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systemscited by 1,729
  8. 2024Qwen2.5-Coder Technical Reportcited by 1,203
  9. 2023CMMLU: Measuring massive multitask language understanding in Chinesecited by 449
  10. 2020XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and Generationcited by 222
  11. 2021XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluationcited by 168
  12. 2024Towards Measuring and Modeling "Culture" in LLMs: A Surveycited by 167
20 more
  1. 2023Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answeringcited by 151
  2. 2021Samanantar: The Largest Publicly Available Parallel Corpora Collection for 11 Indic Languagescited by 136
  3. 2024Aya Expanse: Combining Research Breakthroughs for a New Multilingual Frontiercited by 129
  4. 2022Towards Leaving No Indic Language Behind: Building Monolingual Corpora, Benchmark and Models for Indic Languagescited by 102
  5. 2024KMMLU: Measuring Massive Multitask Language Understanding in Koreancited by 91
  6. 2024ArabicMMLU: Assessing Massive Multitask Language Understanding in Arabiccited by 88
  7. 2022Some Languages are More Equal than Others: Probing Deeper into the Linguistic Disparity in the NLP Worldcited by 55
  8. 2019Survey on Publicly Available Sinhala Natural Language Processing Tools and Researchcited by 46
  9. 2020AI4Bharat-IndicNLP Corpus: Monolingual Corpora and Word Embeddings for Indic Languagescited by 44
  10. 2024IrokoBench: A New Benchmark for African Languages in the Age of Large Language Modelscited by 43
  11. 2024Trans-Tokenization and Cross-lingual Vocabulary Transfers: Language Adaptation of LLMs for Low-Resource NLPcited by 36
  12. 2024TurkishMMLU: Measuring Massive Multitask Language Understanding in Turkishcited by 32
  13. 2022BERTifying Sinhala -- A Comprehensive Analysis of Pre-trained Language Models for Sinhala Text Classificationcited by 16
  14. 2023Improving Cross-lingual Information Retrieval on Low-Resource Languages via Optimal Transport Distillationcited by 15
  15. 2025Zero-shot OCR Accuracy of Low-Resourced Languages: A Comparative Analysis on Sinhala and Tamilcited by 9
  16. 2025SinLlama -- A Large Language Model for Sinhalacited by 9
  17. 2026MITRA: A Large-Scale Parallel Corpus and Multilingual Pretrained Language Model for Machine Translation and Semantic Retrieval for P=ali, Sanskrit, Buddhist Chinese, and Tibetancited by 5
  18. 2025Cross-Lingual Transfer for Low-Resource Natural Language Processingcited by 1
  19. 2025Improving Low-Resource Retrieval Effectiveness using Zero-Shot Linguistic Similarity Transfercited by 1
  20. 2026SinFoS: A Parallel Dataset for Translating Sinhala Figures of Speechcited by 1

Built on by

Not cited yet.