Models and Datasets for Cross-Lingual Summarisation
Not on the map. Why?
Abstract (arXiv)
We present a cross-lingual summarisation corpus with long documents in a source language associated with multi-sentence summaries in a target language. The corpus covers twelve language pairs and directions for four European languages, namely Czech, English, French and German, and the methodology for its creation can be applied to several other languages. We derive cross-lingual document-summary instances from Wikipedia by combining lead paragraphs and articles' bodies from language aligned Wikipedia titles. We analyse the proposed cross-lingual summarisation task with automatic metrics and validate it with a human study. To illustrate the utility of our dataset we report experiments with multi-lingual pre-trained models in supervised, zero- and few-shot, and out-of-domain scenarios.
Key facts. Cited by 36 papers in the map (data through 14 Oct 2026). Builds on 28 of its 46 references that are in the map. First posted on arXiv 19 Feb 2022.
Builds on
28 of 46 references.
References · 28
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,989
- 2019fairseq: A Fast, Extensible Toolkit for Sequence Modelingcited by 1,488
- 2018Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarizationcited by 1,317
- 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,102
- 2015Teaching Machines to Read and Comprehendcited by 1,049
- 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,035
- 2020Stanza: A Python Natural Language Processing Toolkit for Many Human Languagescited by 723
- 2019Text Summarization with Pretrained Encoderscited by 556
16 more
- 2015A Neural Attention Model for Abstractive Sentence Summarizationcited by 396
- 2018Generating Wikipedia by Summarizing Long Sequencescited by 335
- 2018Newsroom: A Dataset of 1.3 Million Summaries with Diverse Extractive Strategiescited by 294
- 2020Multilingual Translation with Extensible Multilingual Pretraining and Finetuningcited by 287
- 2016SummaRuNNer: A Recurrent Neural Network based Sequence Model for Extractive Summarization of Documentscited by 246
- 2020WikiLingua: A New Benchmark Dataset for Cross-Lingual Abstractive Summarizationcited by 154
- 2017A Survey Of Cross-lingual Word Embedding Modelscited by 143
- 2019Hierarchical Transformers for Multi-Document Summarizationcited by 132
- 2020MLSUM: The Multilingual Summarization Corpuscited by 121
- 2020Finding Universal Grammatical Relations in Multilingual BERTcited by 110
- 2018Semi-Supervised Sequence Modeling with Cross-View Trainingcited by 75
- 2019NCLS: Neural Cross-Lingual Summarizationcited by 64
- 2019Cross-Lingual Natural Language Generation via Pre-Trainingcited by 63
- 2020WikiAsp: A Dataset for Multi-domain Aspect-based Summarizationcited by 56
- 2019Generating Summaries with Topic Templates and Structured Convolutional Decoderscited by 20
- 2019Global Voices: Crossing Borders in Automatic News Summarizationcited by 20
Built on by
Citing papers per year: 2022: 11; 2023: 12; 2024: 9; 2025: 2; 2026: 2.
36 papers.
Sort:
By area:
- 2023ChatGPT Beyond English: Towards a Comprehensive Evaluation of Large Language Models in Multilingual Learningcited by 206
- 2023Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedbackcited by 190
- 2024Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuningcited by 177
- 2024Bias in Large Language Models: Origin, Evaluation, and Mitigationcited by 77
- 2022EUR-Lex-Sum: A Multi- and Cross-lingual Dataset for Long-form Summarization in the Legal Domaincited by 40
- 2022A Survey on Cross-Lingual Summarizationcited by 38
- 2022GEMv2: Multilingual NLG Benchmarking in a Single Line of Codecited by 36
- 2022A Variational Hierarchical Model for Neural Cross-Lingual Summarizationcited by 17
- 2023Zero-Shot Cross-Lingual Summarization via Large Language Modelscited by 16
- 2022DuReader_retrieval: A Large-scale Chinese Benchmark for Passage Retrieval from Web Search Enginecited by 15
- 2022UniSumm and SummZoo: Unified Model and Diverse Benchmark for Few-Shot Summarizationcited by 15
- 2023Towards Unifying Multi-Lingual and Cross-Lingual Summarizationcited by 15
24 more
- 2023Exploring Methods for Cross-lingual Text Style Transfer: The Case of Text Detoxificationcited by 15
- 2022Understanding Translationese in Cross-Lingual Summarizationcited by 14
- 2023Low-Rank Adaptation for Multilingual Summarization: An Empirical Studycited by 13
- 2023InheritSumm: A General, Versatile and Compact Summarizer by Distilling from GPTcited by 9
- 2024Retrieval-Augmented Machine Translation with Unstructured Knowledgecited by 9
- 2022The Cross-lingual Conversation Summarization Challengecited by 8
- 2023CroCoSum: A Benchmark Dataset for Cross-Lingual Code-Switched Summarizationcited by 8
- 2023μPLAN: Summarizing using a Content Plan as Cross-Lingual Bridgecited by 7
- 2023Revisiting Cross-Lingual Summarization: A Corpus-based Study and A New Benchmark with Improved Annotationcited by 7
- 2022WikiDes: A Wikipedia-Based Dataset for Generating Short Descriptions from Paragraphscited by 6
- 2022Long-Document Cross-Lingual Summarizationcited by 6
- 2025WETBench: A Benchmark for Detecting Task-Specific Machine-Generated Text on Wikipediacited by 6
- 2022Examining Large Pre-Trained Language Models for Machine Translation: What You Don't Know About Itcited by 3
- 2023UniPCM: Universal Pre-trained Conversation Model with Task-aware Automatic Promptcited by 3
- 2024The State and Fate of Summarization Datasets: A Surveycited by 3
- 2024Multi-Target Cross-Lingual Summarization: a novel task and a language-neutral approachcited by 2
- 2026TSM-Bench: Detecting LLM-Generated Text in Real-World Wikipedia Editing Practicescited by 2
- 2023On the State of German (Abstractive) Text Summarizationcited by 1
- 2024SumTra: A Differentiable Pipeline for Few-Shot Cross-Lingual Summarizationcited by 1
- 2024Leveraging Entailment Judgements in Cross-Lingual Summarisationcited by 0
- 2024ConVerSum: A Contrastive Learning-based Approach for Data-Scarce Solution of Cross-Lingual Summarization Beyond Direct Equivalentscited by 0
- 2024With Good MT There is No Need For End-to-End: A Case for Translate-then-Summarize Cross-lingual Summarizationcited by 0
- 2025An Empirical Study of Many-to-Many Summarization with Large Language Modelscited by 0
- 2026Using Multimodal and Language-Agnostic Sentence Embeddings for Abstractive Summarizationcited by 0
- 2026TSM-Bench: Detecting LLM-Generated Text in Real-World Wikipedia Editing Practices29 May 2026
- 2026Using Multimodal and Language-Agnostic Sentence Embeddings for Abstractive Summarization9 Mar 2026
- 2025WETBench: A Benchmark for Detecting Task-Specific Machine-Generated Text on Wikipedia4 Jul 2025
- 2025An Empirical Study of Many-to-Many Summarization with Large Language Models19 May 2025
- 2024Retrieval-Augmented Machine Translation with Unstructured Knowledge5 Dec 2024
- 2024Bias in Large Language Models: Origin, Evaluation, and Mitigation16 Nov 2024
- 2024The State and Fate of Summarization Datasets: A Survey7 Nov 2024
- 2024Multi-Target Cross-Lingual Summarization: a novel task and a language-neutral approach1 Oct 2024
- 2024With Good MT There is No Need For End-to-End: A Case for Translate-then-Summarize Cross-lingual Summarization31 Aug 2024
- 2024ConVerSum: A Contrastive Learning-based Approach for Data-Scarce Solution of Cross-Lingual Summarization Beyond Direct Equivalents17 Aug 2024
- 2024Leveraging Entailment Judgements in Cross-Lingual Summarisation1 Aug 2024
- 2024SumTra: A Differentiable Pipeline for Few-Shot Cross-Lingual Summarization20 Mar 2024
24 more
- 2024Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuning9 Feb 2024
- 2023Exploring Methods for Cross-lingual Text Style Transfer: The Case of Text Detoxification23 Nov 2023
- 2023Low-Rank Adaptation for Multilingual Summarization: An Empirical Study14 Nov 2023
- 2023UniPCM: Universal Pre-trained Conversation Model with Task-aware Automatic Prompt20 Sep 2023
- 2023Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback29 Jul 2023
- 2023Revisiting Cross-Lingual Summarization: A Corpus-based Study and A New Benchmark with Improved Annotation8 Jul 2023
- 2023μPLAN: Summarizing using a Content Plan as Cross-Lingual Bridge23 May 2023
- 2023InheritSumm: A General, Versatile and Compact Summarizer by Distilling from GPT22 May 2023
- 2023Towards Unifying Multi-Lingual and Cross-Lingual Summarization16 May 2023
- 2023ChatGPT Beyond English: Towards a Comprehensive Evaluation of Large Language Models in Multilingual Learning12 Apr 2023
- 2023CroCoSum: A Benchmark Dataset for Cross-Lingual Code-Switched Summarization7 Mar 2023
- 2023Zero-Shot Cross-Lingual Summarization via Large Language Models28 Feb 2023
- 2023On the State of German (Abstractive) Text Summarization17 Jan 2023
- 2022Understanding Translationese in Cross-Lingual Summarization14 Dec 2022
- 2022Long-Document Cross-Lingual Summarization1 Dec 2022
- 2022UniSumm and SummZoo: Unified Model and Diverse Benchmark for Few-Shot Summarization17 Nov 2022
- 2022EUR-Lex-Sum: A Multi- and Cross-lingual Dataset for Long-form Summarization in the Legal Domain24 Oct 2022
- 2022WikiDes: A Wikipedia-Based Dataset for Generating Short Descriptions from Paragraphs27 Sep 2022
- 2022Examining Large Pre-Trained Language Models for Machine Translation: What You Don't Know About It15 Sep 2022
- 2022GEMv2: Multilingual NLG Benchmarking in a Single Line of Code22 Jun 2022
- 2022The Cross-lingual Conversation Summarization Challenge1 May 2022
- 2022A Survey on Cross-Lingual Summarization23 Mar 2022
- 2022DuReader_retrieval: A Large-scale Chinese Benchmark for Passage Retrieval from Web Search Engine19 Mar 2022
- 2022A Variational Hierarchical Model for Neural Cross-Lingual Summarization8 Mar 2022
- 2023ChatGPT Beyond English: Towards a Comprehensive Evaluation of Large Language Models in Multilingual Learningcited by 206
- 2024Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuningcited by 177
- 2024Bias in Large Language Models: Origin, Evaluation, and Mitigationcited by 77
- 2022EUR-Lex-Sum: A Multi- and Cross-lingual Dataset for Long-form Summarization in the Legal Domaincited by 40
- 2022A Survey on Cross-Lingual Summarizationcited by 38
- 2022GEMv2: Multilingual NLG Benchmarking in a Single Line of Codecited by 36
- 2022A Variational Hierarchical Model for Neural Cross-Lingual Summarizationcited by 17
- 2023Zero-Shot Cross-Lingual Summarization via Large Language Modelscited by 16
- 2022DuReader_retrieval: A Large-scale Chinese Benchmark for Passage Retrieval from Web Search Enginecited by 15
- 2022UniSumm and SummZoo: Unified Model and Diverse Benchmark for Few-Shot Summarizationcited by 15
- 2023Towards Unifying Multi-Lingual and Cross-Lingual Summarizationcited by 15
- 2023Exploring Methods for Cross-lingual Text Style Transfer: The Case of Text Detoxificationcited by 15
12 most cited of 34 All 34 (JSON)
- 2026TSM-Bench: Detecting LLM-Generated Text in Real-World Wikipedia Editing Practices29 May 2026
- 2026Using Multimodal and Language-Agnostic Sentence Embeddings for Abstractive Summarization9 Mar 2026
- 2025WETBench: A Benchmark for Detecting Task-Specific Machine-Generated Text on Wikipedia4 Jul 2025
- 2025An Empirical Study of Many-to-Many Summarization with Large Language Models19 May 2025
- 2024Bias in Large Language Models: Origin, Evaluation, and Mitigation16 Nov 2024
- 2024The State and Fate of Summarization Datasets: A Survey7 Nov 2024
- 2024Multi-Target Cross-Lingual Summarization: a novel task and a language-neutral approach1 Oct 2024
- 2024With Good MT There is No Need For End-to-End: A Case for Translate-then-Summarize Cross-lingual Summarization31 Aug 2024
- 2024ConVerSum: A Contrastive Learning-based Approach for Data-Scarce Solution of Cross-Lingual Summarization Beyond Direct Equivalents17 Aug 2024
- 2024Leveraging Entailment Judgements in Cross-Lingual Summarisation1 Aug 2024
- 2024SumTra: A Differentiable Pipeline for Few-Shot Cross-Lingual Summarization20 Mar 2024
- 2024Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuning9 Feb 2024
12 newest of 34 All 34 (JSON)