mlsanityData to 7 Oct 2026

Error Patterns in Historical OCR: A Comparative Analysis of TrOCR and a Vision-Language Model

arXiv 2602.14524 ↗First posted 16 Feb 2026cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Optical Character Recognition (OCR) of eighteenth-century printed texts remains challenging due to degraded print quality, archaic glyphs, and non-standardized orthography. Although transformer-based OCR systems and Vision-Language Models (VLMs) achieve strong aggregate accuracy, metrics such as Character Error Rate (CER) and Word Error Rate (WER) provide limited insight into their reliability for scholarly use. We compare a dedicated OCR transformer (TrOCR) and a general-purpose Vision-Language Model (Qwen) on line-level historical English texts using length-weighted accuracy metrics and hypothesis driven error analysis. While Qwen achieves lower CER/WER and greater robustness to degraded input, it exhibits selective linguistic regularization and orthographic normalization that may silently alter historically meaningful forms. TrOCR preserves orthographic fidelity more consistently but is more prone to cascading error propagation. Our findings show that architectural inductive biases shape OCR error structure in systematic ways. Models with similar aggregate accuracy can differ substantially in error locality, detectability, and downstream scholarly risk, underscoring the need for architecture-aware evaluation in historical digitization workflows.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 8 of its 21 references that are in the map. First posted on arXiv 16 Feb 2026.

Builds on

8 of 21 references.

References · 8

  1. 2023Qwen Technical Reportcited by 3,273
  2. 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 466
  3. 2021TrOCR: Transformer-based Optical Character Recognition with Pre-trained Modelscited by 278
  4. 2023UReader: Universal OCR-free Visually-situated Language Understanding with Multimodal Large Language Modelcited by 143
  5. 2018Ground Truth for training OCR engines on historical documents in German Fraktur and Early Modern Latincited by 12
  6. 2019OCR4all -- An Open-Source Tool Providing a (Semi-)Automatic OCR Workflow for Historical Printingscited by 12
  7. 2021Lacuna Reconstruction: Self-supervised Pre-training for Low-Resource Historical Document Transcriptioncited by 3
  8. 2023Optimization of Image Processing Algorithms for Character Recognition in Cultural Typewritten Documentscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026A Survey of OCR Evaluation Methods and Metrics and the Invisibility of Historical Documents
  2. 2025Evaluating LLMs for Historical Document OCR: A Methodological Framework for Digital Humanities
  3. 2026When Simpler Is Better: Evaluating Translation Pipelines for Medieval Latin Manuscripts
  4. 2026When Low CER is Not Enough: An Analysis of Hallucinations in Vision-Language OCR Systems on Historical Uruguayan Documents
  5. 2026Reading or Guessing? Visual Grounding Failures of Vision-Language Models for OCR in Ancient Greek Editions
  6. 2024Scrambled text: training Language Models to correct OCR errors using synthetic data
  7. 2025Finetuning Vision-Language Models as OCR Systems for Low-Resource Languages: A Case Study of Manchu
  8. 2026Combining Synthetic and Real Data for Low-Resource Historical OCR: A Manchu Case Study