Pre-Editorial Normalization for Automatically Transcribed Medieval Manuscripts in Old French and Latin
Not on the map. Why?
Abstract (arXiv)
Recent advances in Automatic Text Recognition (ATR) have improved access to historical archives, yet a methodological divide persists between palaeographic transcriptions and normalized digital editions. While ATR models trained on more palaeographically-oriented datasets such as CATMuS have shown greater generalizability, their raw outputs remain poorly compatible with most readers and downstream NLP tools, thus creating a usability gap. On the other hand, ATR models trained to produce normalized outputs have been shown to struggle to adapt to new domains and tend to over-normalize and hallucinate. We introduce the task of Pre-Editorial Normalization (PEN), which consists in normalizing graphemic ATR output according to editorial conventions, which has the advantage of keeping an intermediate step with palaeographic fidelity while providing a normalized version for practical usability. We present a new dataset derived from the CoMMA corpus and aligned with digitized Old French and Latin editions using passim. We also produce a manually corrected gold-standard evaluation set. We benchmark this resource using ByT5-based sequence-to-sequence models on normalization and pre-annotation tasks. Our contributions include the formal definition of PEN, a 4.66M-sample silver training corpus, a 1.8k-sample gold evaluation set, and a normalization model achieving a 6.7% CER, substantially outperforming previous models for this task.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 78 references that are in the map. First posted on arXiv 14 Feb 2026.
Builds on
12 of 78 references.
References · 12
- 2021ByT5: Towards a token-free future with pre-trained byte-to-byte modelscited by 509
- 2017Synthetic and Natural Noise Both Break Neural Machine Translationcited by 306
- 2018MTNT: A Testbed for Machine Translation of Noisy Textcited by 54
- 2022Exploring Document-Level Literary Machine Translation with Parallel Paragraphs from World Literaturecited by 45
- 2019Improving Robustness of Machine Translation with Synthetic Noisecited by 36
- 2024Did Translation Models Get More Robust Without Anyone Even Noticing?cited by 9
- 2018Utilizing Character and Word Embeddings for Text Normalization with Sequence-to-Sequence Modelscited by 7
- 2020Adversarial Subword Regularization for Robust Neural Machine Translationcited by 6
- 2018Normalization of Transliterated Words in Code-Mixed Data Using Seq2Seq Model & Levenshtein Distancecited by 5
- 2023GNAT: A General Narrative Alignment Toolcited by 3
- 2025Normalized vs Diplomatic Annotation: A Case Study of Automatic Information Extraction from Handwritten Uruguayan Birth Certificatescited by 3
- 2025Transcribing Spanish Texts from the Past: Experiments with Transkribus, Tesseract and Granitecited by 1
Built on by
Not cited yet.