mlsanityData to 14 Oct 2026

Multilingual Event Extraction from Historical Newspaper Adverts

arXiv 2305.10928 ↗First posted 18 May 2023cs.CL cs.LGcited by 5

Not on the map. Why?

Abstract (arXiv)

NLP methods can aid historians in analyzing textual materials in greater volumes than manually feasible. Developing such methods poses substantial challenges though. First, acquiring large, annotated historical datasets is difficult, as only domain experts can reliably label them. Second, most available off-the-shelf NLP models are trained on modern language texts, rendering them significantly less effective when applied to historical corpora. This is particularly problematic for less well studied tasks, and for languages other than English. This paper addresses these challenges while focusing on the under-explored task of event extraction from a novel domain of historical texts. We introduce a new multilingual dataset in English, French, and Dutch composed of newspaper ads from the early modern colonial period reporting on enslaved people who liberated themselves from enslavement. We find that: 1) even with scarce annotated data, it is possible to achieve surprisingly good results by formulating the problem as an extractive QA task and leveraging existing datasets and models for modern languages; and 2) cross-lingual low-resource learning for historical languages is highly challenging, and machine translation of the historical datasets to the considered target languages is, in practice, often the best-performing solution.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 25 of its 70 references that are in the map. First posted on arXiv 18 May 2023.

Builds on

25 of 70 references.

References · 25

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  3. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
  4. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  5. 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,554
  6. 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,470
  7. 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,312
  8. 2019On the Cross-lingual Transferability of Monolingual Representationscited by 578
  9. 2019CamemBERT: a Tasty French Language Modelcited by 368
  10. 2020How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Modelscited by 318
  11. 2020Are All Languages Created Equal in Multilingual BERT?cited by 207
  12. 2020Event Extraction by Answering (Almost) Natural Questionscited by 177
13 more
  1. 2020Detecting Hallucinated Content in Conditional Neural Sequence Generationcited by 152
  2. 2020Beat the AI: Investigating Adversarial Human Annotation for Reading Comprehensioncited by 131
  3. 2020RobBERT: a Dutch RoBERTa-based Language Modelcited by 88
  4. 2020FQuAD: French Question Answering Datasetcited by 58
  5. 2021Named Entity Recognition and Classification on Historical Documents: A Surveycited by 47
  6. 2020Do Multi-Hop Question Answering Systems Know How to Answer the Single-Hop Sub-Questions?cited by 30
  7. 2019A Large-Scale Comparison of Historical Text Normalization Systemscited by 25
  8. 2021Neural OCR Post-Hoc Correction of Historical Corporacited by 12
  9. 2018Evaluating historical text normalization systems: How well do they generalize?cited by 11
  10. 2016Improving historical spelling normalization with bi-directional LSTMs and multi-task learningcited by 8
  11. 2022Entities, Dates, and Languages: Zero-Shot on Historical Texts with T0cited by 6
  12. 2021Lemmatization of Historical Old Literary Finnish Texts in Modern Orthographycited by 5
  13. 2016Part-of-Speech Tagging for Historical Englishcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 2; 2024: 0; 2025: 2; 2026: 1.

5 papers.