mlsanityData to 14 Oct 2026

Which papyrus HTR is good enough? Character-error-rate tolerance of four papyrological tasks on Greek texts

arXiv 2609.37755 ↗First posted 29 Sep 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Purpose: Most Greek papyri remain unpublished and undigitised; a handwritten text recognition (HTR) pipeline that transcribes them automatically would let scholars discover documents and literary works that have so far gone unread. Recognition systems for Ancient Greek papyri are in statu nascendi, and how accurate they must be for a given papyrological task has not been examined. To answer this and set a benchmark for Greek papyrus HTR, we test a range of character error rates (CER) against four papyrological tasks, using published editions as ground truth. Methods: From 63,846 current editions of Greek texts in papyri.info, we imitate a letters-only "perfect HTR" output by removing the editorial layer, then degrade it with a seeded algorithm to exact CERs of 1 - 50%, with lost lines and four error-shape variants. On these data we train small models (TF-IDF, fastText, a character CNN, ByT5-small) for document type, dating and documentary-versus-literary classification, and apply eight keyword search methods. We compare models trained on clean text with models retrained at a specific CER level, and evaluate across CERs. Results: Tolerance differs by task. With clean-trained models, documentary-versus-literary classification retains 90% of its metric up to 20% CER; document type up to 7.5%; subtypes and search up to 5%; dating only up to 3%. Retraining on text containing character errors largely eliminates the sharp degradation that otherwise sets in above 15% CER. Models generally tolerate concentrated damage in a long document better than small errors spread across a short text. Conclusion: The study provides a CER target for each of the four tasks and shows that models trained on noisy text make current, imperfect text recognition useful for them.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 38 references that are in the map. First posted on arXiv 29 Sep 2026.

Builds on

9 of 38 references.

References · 9

  1. 2015Character-level Convolutional Networks for Text Classificationcited by 2,330
  2. 2016Bag of Tricks for Efficient Text Classificationcited by 876
  3. 2021ByT5: Towards a token-free future with pre-trained byte-to-byte modelscited by 509
  4. 2022An Assessment of the Impact of OCR Noise on Language Modelscited by 5
  5. 2026Structure-Aware Text Recognition for Ancient Greek Critical Editionscited by 5
  6. 2026Reading or Guessing? Visual Grounding Failures of Vision-Language Models for OCR in Ancient Greek Editionscited by 5
  7. 2024Instruct-Tuning Pretrained Causal Language Models for Ancient Greek Papyrology and Epigraphycited by 3
  8. 2024Detecting and recognizing characters in Greek papyri with YOLOv8, DeiT and SimCLRcited by 1
  9. 2024A New Framework for Error Analysis in Computational Paleographic Dating of Greek Papyricited by 1

Built on by

Not cited yet.