mlsanityData to 7 Oct 2026

RoLargeSum: A Large Dialect-Aware Romanian News Dataset for Summary, Headline, and Keyword Generation

arXiv 2412.11317 ↗First posted 15 Dec 2024cs.CLcited by 3

Not on the map. Why?

Abstract (arXiv)

Using supervised automatic summarisation methods requires sufficient corpora that include pairs of documents and their summaries. Similarly to many tasks in natural language processing, most of the datasets available for summarization are in English, posing challenges for developing summarization models in other languages. Thus, in this work, we introduce RoLargeSum, a novel large-scale summarization dataset for the Romanian language crawled from various publicly available news websites from Romania and the Republic of Moldova that were thoroughly cleaned to ensure a high-quality standard. RoLargeSum contains more than 615K news articles, together with their summaries, as well as their headlines, keywords, dialect, and other metadata that we found on the targeted websites. We further evaluated the performance of several BART variants and open-source large language models on RoLargeSum for benchmarking purposes. We manually evaluated the results of the best-performing system to gain insight into the potential pitfalls of this data set and future development.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 34 of its 60 references that are in the map. First posted on arXiv 15 Dec 2024.

Builds on

34 of 60 references.

References · 34

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2023GPT-4 Technical Reportcited by 18,132
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  6. 2024The Llama 3 Herd of Modelscited by 14,192
  7. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  8. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  9. 2015Domain-Adversarial Training of Neural Networkscited by 3,023
  10. 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
  11. 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,928
  12. 2018Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarizationcited by 1,308
22 more
  1. 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,100
  2. 2015Teaching Machines to Read and Comprehendcited by 1,039
  3. 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,028
  4. 2016Abstractive Text Summarization Using Sequence-to-Sequence RNNs and Beyondcited by 809
  5. 2019CCNet: Extracting High Quality Monolingual Datasets from Web Crawl Datacited by 544
  6. 2020Extractive Summarization as Text Matchingcited by 189
  7. 2021BookSum: A Collection of Datasets for Long-form Narrative Summarizationcited by 184
  8. 2018Ranking Sentences for Extractive Summarization with Reinforcement Learningcited by 128
  9. 2023Extractive Summarization via ChatGPT for Faithful Summary Generationcited by 58
  10. 2018BanditSum: Extractive Summarization as a Contextual Banditcited by 46
  11. 2020BARThez: a Skilled Pretrained French Sequence-to-Sequence Modelcited by 39
  12. 2019Jointly Extracting and Compressing Documents with Summary State Representationscited by 12
  13. 2019Introducing RONEC -- the Romanian Named Entity Corpuscited by 12
  14. 2021SaRoCo: Detecting Satire in a Novel Romanian Corpus of News Articlescited by 12
  15. 2024RoQLlama: A Lightweight Romanian Adapted Language Modelcited by 7
  16. 2024HistNERo: Historical Named Entity Recognition for the Romanian Languagecited by 5
  17. 2024From News to Summaries: Building a Hungarian Corpus for Extractive and Abstractive Summarizationcited by 4
  18. 2023Adversarial Capsule Networks for Romanian Satire Detection and Sentiment Analysiscited by 3
  19. 2023Abstractive Text Summarization Using the BRIO Training Paradigmcited by 1
  20. 2024SumHiS: Extractive Summarization Exploiting Hidden Structurecited by 1
  21. 2024Investigating the Impact of Semi-Supervised Methods with Data Augmentation on Offensive Language Detection in Romanian Languagecited by 1
  22. 2024Enhancing Romanian Offensive Language Detection through Knowledge Distillation, Multi-Task Learning, and Data Augmentationcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 1.

3 papers.

  1. 2025MoRoVoc: A Large Dataset for Geographical Variation Identification of the Spoken Romanian Languagecited by 1
  2. 2025UniBERT: Adversarial Training for Language-Universal Representationscited by 0
  3. 2026ROMPAR: Morphological Completion and Demographic Unlearning for Romanian-Accented Speech Recognitioncited by 0