Long-Document Cross-Lingual Summarization
Not on the map. Why?
Abstract (arXiv)
Cross-Lingual Summarization (CLS) aims at generating summaries in one language for the given documents in another language. CLS has attracted wide research attention due to its practical significance in the multi-lingual world. Though great contributions have been made, existing CLS works typically focus on short documents, such as news articles, short dialogues and guides. Different from these short texts, long documents such as academic articles and business reports usually discuss complicated subjects and consist of thousands of words, making them non-trivial to process and summarize. To promote CLS research on long documents, we construct Perseus, the first long-document CLS dataset which collects about 94K Chinese scientific documents paired with English summaries. The average length of documents in Perseus is more than two thousand tokens. As a preliminary study on long-document CLS, we build and evaluate various CLS baselines, including pipeline and end-to-end methods. Experimental results on Perseus show the superiority of the end-to-end baseline, outperforming the strong pipeline models equipped with sophisticated machine translation systems. Furthermore, to provide a deeper understanding, we manually analyze the model outputs and discuss specific challenges faced by current approaches. We hope that our work could benchmark long-document CLS and benefit future studies.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 26 of its 45 references that are in the map. First posted on arXiv 1 Dec 2022.
Builds on
26 of 45 references.
References · 26
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2020Longformer: The Long-Document Transformercited by 3,362
- 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,027
- 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,281
- 2020Efficient Transformers: A Surveycited by 784
- 2018A Discourse-Aware Attention Model for Abstractive Summarization of Long Documentscited by 477
- 2021Efficient Attentions for Long Document Summarizationcited by 342
- 2016SummaRuNNer: A Recurrent Neural Network based Sequence Model for Extractive Summarization of Documentscited by 245
- 2019BIGPATENT: A Large-Scale Dataset for Abstractive and Coherent Summarizationcited by 155
- 2020WikiLingua: A New Benchmark Dataset for Cross-Lingual Abstractive Summarizationcited by 154
- 2019ScisummNet: A Large Annotated Corpus and Content-Impact Models for Scientific Paper Summarization with Citation Networkscited by 73
14 more
- 2020Multi-View Sequence-to-Sequence Models with Conversational Structure for Abstractive Dialogue Summarizationcited by 72
- 2019Sentence Centrality Revisited for Unsupervised Summarizationcited by 64
- 2019NCLS: Neural Cross-Lingual Summarizationcited by 64
- 2022A Survey on Cross-Lingual Summarizationcited by 38
- 2022Models and Datasets for Cross-Lingual Summarisationcited by 36
- 2021Cross-Lingual Abstractive Summarization with Limited Parallel Resourcescited by 27
- 2022ClidSum: A Benchmark Dataset for Cross-Lingual Dialogue Summarizationcited by 25
- 2019Global Voices: Crossing Borders in Automatic News Summarizationcited by 20
- 2020Mixed-Lingual Pre-training for Cross-lingual Summarizationcited by 17
- 2022A Variational Hierarchical Model for Neural Cross-Lingual Summarizationcited by 17
- 2021Knowledge Enhanced Sports Game Summarizationcited by 9
- 2021SportsSum2.0: Generating High-Quality Sports News from Live Text Commentarycited by 7
- 2022Incorporating Commonsense Knowledge into Story Ending Generation via Heterogeneous Graph Networkscited by 6
- 2022GOAL: Towards Benchmarking Few-Shot Sports Game Summarizationcited by 2
Built on by
Citing papers per year: 2023: 4; 2024: 1; 2025: 1.
6 papers.
- 2023Zero-Shot Cross-Lingual Summarization via Large Language Modelscited by 16
- 2023Towards Unifying Multi-Lingual and Cross-Lingual Summarizationcited by 15
- 2023CroCoSum: A Benchmark Dataset for Cross-Lingual Code-Switched Summarizationcited by 8
- 2025Beyond Decoder-only: Large Language Models Can be Good Encoders for Machine Translationcited by 8
- 2024Think Carefully and Check Again! Meta-Generation Unlocking LLMs for Low-Resource Cross-Lingual Summarizationcited by 3
- 2023Surveying the Landscape of Text Summarization with Deep Learning: A Comprehensive Reviewcited by 2
- 2025Beyond Decoder-only: Large Language Models Can be Good Encoders for Machine Translation9 Mar 2025
- 2024Think Carefully and Check Again! Meta-Generation Unlocking LLMs for Low-Resource Cross-Lingual Summarization26 Oct 2024
- 2023Surveying the Landscape of Text Summarization with Deep Learning: A Comprehensive Review13 Oct 2023
- 2023Towards Unifying Multi-Lingual and Cross-Lingual Summarization16 May 2023
- 2023CroCoSum: A Benchmark Dataset for Cross-Lingual Code-Switched Summarization7 Mar 2023
- 2023Zero-Shot Cross-Lingual Summarization via Large Language Models28 Feb 2023