Sequence-to-Sequence Resources for Catalan
Not on the map. Why?
Abstract (arXiv)
In this work, we introduce sequence-to-sequence language resources for Catalan, a moderately under-resourced language, towards two tasks, namely: Summarization and Machine Translation (MT). We present two new abstractive summarization datasets in the domain of newswire. We also introduce a parallel Catalan-English corpus, paired with three different brand new test sets. Finally, we evaluate the data presented with competing state of the art models, and we develop baselines for these tasks using a newly created Catalan BART. We release the resulting resources of this work under open license to encourage the development of language technology in Catalan.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 27 references that are in the map. First posted on arXiv 14 Feb 2022.
Builds on
17 of 27 references.
References · 17
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,818
- 2018A Call for Clarity in Reporting BLEU Scorescited by 1,799
- 2018Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarizationcited by 1,317
- 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,035
- 2021The FLORES-101 Evaluation Benchmark for Low-Resource and Multilingual Machine Translationcited by 560
- 2019CamemBERT: a Tasty French Language Modelcited by 368
- 2021Quality at a Glance: An Audit of Web-Crawled Multilingual Datasetscited by 243
- 2019WikiMatrix: Mining 135M Parallel Sentences in 1620 Language Pairs from Wikipediacited by 223
- 2016Transfer Learning for Low-Resource Neural Machine Translationcited by 188
5 more
- 2019CCAligned: A Massive Collection of Cross-Lingual Web-Document Pairscited by 136
- 2020MLSUM: The Multilingual Summarization Corpuscited by 121
- 2020Extending Multilingual BERT to Low-Resource Languagescited by 88
- 2020CoVoST 2 and Massively Multilingual Speech-to-Text Translationcited by 74
- 2021Are Multilingual Models the Best Choice for Moderately Under-resourced Languages? A Comprehensive Assessment for Catalancited by 26
Built on by
Not cited yet.