mlsanityData to 7 Oct 2026

New Textual Corpora for Serbian Language Modeling

arXiv 2405.09250 ↗First posted 15 May 2024cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

This paper will present textual corpora for Serbian (and Serbo-Croatian), usable for the training of large language models and publicly available at one of the several notable online repositories. Each corpus will be classified using multiple methods and its characteristics will be detailed. Additionally, the paper will introduce three new corpora: a new umbrella web corpus of Serbo-Croatian, a new high-quality corpus based on the doctoral dissertations stored within National Repository of Doctoral Dissertations from all Universities in Serbia, and a parallel corpus of abstract translation from the same source. The uniqueness of both old and new corpora will be accessed via frequency-based stylometric methods, and the results will be briefly discussed.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 12 of its 49 references that are in the map. First posted on arXiv 15 May 2024.

Builds on

12 of 49 references.

References · 12

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  3. 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,018
  4. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  5. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,813
  6. 2020Aligning AI With Shared Human Valuescited by 706
  7. 2021XL-Sum: Large-Scale Multilingual Abstractive Summarization for 44 Languagescited by 346
  8. 2020EXAMS: A Multi-Subject High School Examinations Dataset for Cross-Lingual and Multilingual Question Answeringcited by 60
  9. 2014POLYGLOT-NER: Massive Multilingual Named Entity Recognitioncited by 32
  10. 2021BERTi'c -- The Transformer Language Model for Bosnian, Croatian, Montenegrin and Serbiancited by 21
  11. 2021MFAQ: a Multilingual FAQ Datasetcited by 16
  12. 2023Massively Multilingual Corpus of Sentiment Datasets and Multi-faceted Sentiment Classification Benchmarkcited by 10

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

  1. 2025Large Language Models for Toxic Language Detection in Low-Resource Balkan Languagescited by 0