# AlbNews: A Corpus of Headlines for Topic Modeling in Albanian

arXiv: https://arxiv.org/abs/2402.04028 · HTML: https://mlsanity.com/paper/2402.04028/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 16 of its 32 references that are in the map.
- First posted on arXiv 6 Feb 2024.

## Builds on (most cited first, 16 of 16)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding](https://mlsanity.com/paper/1810.04805/) (2018)
- [PyTorch: An Imperative Style, High-Performance Deep Learning Library](https://mlsanity.com/paper/1912.01703/) (2019)
- [RoBERTa: A Robustly Optimized BERT Pretraining Approach](https://mlsanity.com/paper/1907.11692/) (2019)
- [XGBoost: A Scalable Tree Boosting System](https://mlsanity.com/paper/1603.02754/) (2016)
- [BERTopic: Neural topic modeling with a class-based TF-IDF procedure](https://mlsanity.com/paper/2203.05794/) (2022)
- [How to Fine-Tune BERT for Text Classification?](https://mlsanity.com/paper/1905.05583/) (2019)
- [Top2Vec: Distributed Representations of Topics](https://mlsanity.com/paper/2008.09470/) (2020)
- [A Survey of Corpora for Germanic Low-Resource Languages and Dialects](https://mlsanity.com/paper/2304.09805/) (2023)
- [Data-driven Summarization of Scientific Articles](https://mlsanity.com/paper/1804.08875/) (2018)
- [Efficiency Metrics for Data-Driven Models: A Text Summarization Case Study](https://mlsanity.com/paper/1909.06618/) (2019)
- [Infrastructure for Artificial Intelligence, Quantum and High Performance Computing](https://mlsanity.com/paper/2012.09303/) (2020)
- [AlbMoRe: A Corpus of Movie Reviews for Sentiment Analysis in Albanian](https://mlsanity.com/paper/2306.08526/) (2023)
- [Detecting Abusive Albanian](https://mlsanity.com/paper/2107.13592/) (2021)
- [Topic Segmentation of Research Article Collections](https://mlsanity.com/paper/2205.11249/) (2022)
- [AlbNER: A Corpus for Named Entity Recognition in Albanian](https://mlsanity.com/paper/2309.08741/) (2023)

## Abstract (arXiv)

The scarcity of available text corpora for low-resource languages like Albanian is a serious hurdle for research in natural language processing tasks. This paper introduces AlbNews, a collection of 600 topically labeled news headlines and 2600 unlabeled ones in Albanian. The data can be freely used for conducting topic modeling research. We report the initial classification scores of some traditional machine learning classifiers trained with the AlbNews samples. These results show that basic models outrun the ensemble learning ones and can serve as a baseline for future experiments.