GreekT5: A Series of Greek Sequence-to-Sequence Models for News Summarization
Not on the map. Why?
Abstract (arXiv)
Text summarization (TS) is a natural language processing (NLP) subtask pertaining to the automatic formulation of a concise and coherent summary that covers the major concepts and topics from one or multiple documents. Recent advancements in deep learning have led to the development of abstractive summarization transformer-based models, which outperform classical approaches. In any case, research in this field focuses on high resource languages such as English, while the corresponding work for low resource languages is still underdeveloped. Taking the above into account, this paper proposes a series of novel TS models for Greek news articles. The proposed models were thoroughly evaluated on the same dataset against GreekBART, which is the state-of-the-art model in Greek abstractive news summarization. Our evaluation results reveal that most of the proposed models significantly outperform GreekBART on various evaluation metrics. We make our evaluation code public, aiming to increase the reproducibility of this work and facilitate future research in the field.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 13 of its 29 references that are in the map. First posted on arXiv 13 Nov 2023.
Builds on
13 of 29 references.
References · 13
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,818
- 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,035
- 2019CCNet: Extracting High Quality Monolingual Datasets from Web Crawl Datacited by 548
- 2019MASS: Masked Sequence to Sequence Pre-training for Language Generationcited by 347
- 2023UniMax: Fairer and more Effective Language Sampling for Large-Scale Multilingual Pretrainingcited by 151
- 2022Towards a Cleaner Document-Oriented Multilingual Crawled Corpuscited by 143
- 2020A Monolingual Approach to Contextualized Word Embeddings for Mid-Resource Languagescited by 131
- 2020GREEK-BERT: The Greeks visiting Sesame Streetcited by 38
- 2023GreekBART: The First Pretrained Greek Sequence-to-Sequence Modelcited by 8
1 more
- 2018Word Embeddings from Large-Scale Greek Web Contentcited by 6
Built on by
Citing papers per year: 2024: 2.
2 papers.