Summarising Historical Text in Modern Languages
Not on the map. Why?
Abstract (arXiv)
We introduce the task of historical text summarisation, where documents in historical forms of a language are summarised in the corresponding modern language. This is a fundamentally important routine to historians and digital humanities researchers but has never been automated. We compile a high-quality gold-standard text summarisation dataset, which consists of historical German and Chinese news from hundreds of years ago summarised in modern German or Chinese. Based on cross-lingual transfer learning techniques, we propose a summarisation model that can be trained even with no cross-lingual (historical to modern) parallel data, and further benchmark it against state-of-the-art algorithms. We report automatic and human evaluations that distinguish the historic to modern language summarisation task from standard cross-lingual summarisation (i.e., modern to modern language), highlight the distinctness and value of our dataset, and demonstrate that our transfer learning approach outperforms standard cross-lingual benchmarks on this task.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 17 of its 55 references that are in the map. First posted on arXiv 26 Jan 2021.
Builds on
17 of 55 references.
References · 17
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,281
- 2019Cross-lingual Language Model Pretrainingcited by 1,088
- 2015Teaching Machines to Read and Comprehendcited by 1,039
- 2016Bag of Tricks for Efficient Text Classificationcited by 869
- 2020CLUE: A Chinese Language Understanding Evaluation Benchmarkcited by 277
- 2018A robust self-learning method for fully unsupervised cross-lingual mappings of word embeddingscited by 145
- 2017A Survey Of Cross-lingual Word Embedding Modelscited by 142
- 2020MLSUM: The Multilingual Summarization Corpuscited by 121
- 2015LCSTS: A Large Scale Chinese Short Text Summarization Datasetcited by 65
- 2019NCLS: Neural Cross-Lingual Summarizationcited by 64
- 2018Analogical Reasoning on Chinese Morphological and Semantic Relationscited by 50
5 more
- 2019Evaluating Word Embedding Models: Methods and Experimental Resultscited by 37
- 2020When and Why is Unsupervised Neural Machine Translation Useless?cited by 34
- 2019A Large-Scale Comparison of Historical Text Normalization Systemscited by 25
- 2016Inducing Domain-Specific Sentiment Lexicons from Unlabeled Corporacited by 19
- 2019Attention Optimization for Abstractive Document Summarizationcited by 4
Built on by
Citing papers per year: 2021: 1; 2022: 2; 2023: 3.
6 papers.
- 2023FactKB: Generalizable Factuality Evaluation using Language Models Enhanced with Factual Knowledgecited by 55
- 2023SikuGPT: A Generative Pre-trained Model for Intelligent Information Processing of Ancient Texts from the Perspective of Digital Humanitiescited by 9
- 2023Cross-lingual Cross-temporal Summarization: Dataset, Models, Evaluationcited by 8
- 2021Cross-Lingual Word Embedding Refinement by ℓ1 Norm Optimisationcited by 6
- 2022ClueGraphSum: Let Key Clues Guide the Cross-Lingual Abstractive Summarizationcited by 3
- 2022Isomorphic Cross-lingual Embeddings for Low-Resource Languagescited by 1
- 2023Cross-lingual Cross-temporal Summarization: Dataset, Models, Evaluation22 Jun 2023
- 2023FactKB: Generalizable Factuality Evaluation using Language Models Enhanced with Factual Knowledge14 May 2023
- 2023SikuGPT: A Generative Pre-trained Model for Intelligent Information Processing of Ancient Texts from the Perspective of Digital Humanities16 Apr 2023
- 2022Isomorphic Cross-lingual Embeddings for Low-Resource Languages28 Mar 2022
- 2022ClueGraphSum: Let Key Clues Guide the Cross-Lingual Abstractive Summarization5 Mar 2022
- 2021Cross-Lingual Word Embedding Refinement by ℓ1 Norm Optimisation11 Apr 2021