mlsanityData to 7 Oct 2026

Adapting TrOCR for Printed Tigrinya Text Recognition: Word-Aware Loss Weighting for Cross-Script Transfer Learning

arXiv 2604.20813 ↗First posted 22 Apr 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Transformer-based OCR models have shown strong performance on Latin and CJK scripts, but their application to African syllabic writing systems remains limited. We present the first adaptation of TrOCR for printed Tigrinya using the Ge'ez script. Starting from a pre-trained model, we extend the byte-level BPE tokenizer to cover 230 Ge'ez characters and introduce Word-Aware Loss Weighting to resolve systematic word-boundary failures that arise when applying Latin-centric BPE conventions to a new script. The unmodified model produces no usable output on Ge'ez text. After adaptation, the TrOCR-Printed variant achieves 0.22% Character Error Rate and 97.20% exact match accuracy on a held-out test set of 5,000 synthetic images from the GLOCR dataset. An ablation study confirms that Word-Aware Loss Weighting is the critical component, reducing CER by two orders of magnitude compared to vocabulary extension alone. The full pipeline trains in under three hours on a single 8 GB consumer GPU. All code, model weights, and evaluation scripts are publicly released.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 7 of its 19 references that are in the map. First posted on arXiv 22 Apr 2026.

Builds on

7 of 19 references.

References · 7

  1. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  2. 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
  3. 2021TrOCR: Transformer-based Optical Character Recognition with Pre-trained Modelscited by 278
  4. 2020UNKs Everywhere: Adapting Multilingual Language Models to New Scriptscited by 113
  5. 2023DTrOCR: Decoder-only Transformer for Optical Character Recognitioncited by 40
  6. 2022Transformer-based HTR for Historical Documentscited by 10
  7. 2025Finetuning Vision-Language Models as OCR Systems for Low-Resource Languages: A Case Study of Manchucited by 5

Built on by

Not cited yet.