mlsanityData to 14 Oct 2026

Finetuning Vision-Language Models as OCR Systems for Low-Resource Languages: A Case Study of Manchu

arXiv 2507.06761 ↗First posted 9 Jul 2025cs.CVcited by 5

On the map: Multimodal LLMs / vision-language models → Document understanding and multimodal RAG

Abstract (arXiv)

Manchu, a critically endangered language essential for understanding early modern Eastern Eurasian history, lacks effective OCR systems that can handle real-world historical documents. This study develops high-performing OCR systems by fine-tuning three open-source vision-language models (LLaMA-3.2-11B, Qwen2.5-VL-7B, Qwen2.5-VL-3B) on 60,000 synthetic Manchu word images using parameter-efficient training. LLaMA-3.2-11B achieved exceptional performance with 98.3% word accuracy and 0.0024 character error rate on synthetic data, while crucially maintaining 93.1% accuracy on real-world handwritten documents. Comparative evaluation reveals substantial advantages over traditional approaches: while a CRNN baseline achieved 99.8% synthetic accuracy, it suffered severe degradation to 72.5% on real documents. Our approach demonstrates effective synthetic-to-real domain transfer, providing a cost-effective solution deployable on accessible infrastructure. This work establishes a transferable framework for endangered language OCR that removes technical and financial barriers in digital humanities, enabling historians and linguists to process historical archives without specialized computing resources. Code and model weights are available at https://github.com/mic7ch1/ManchuAI-OCR.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Document understanding and multimodal RAG, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 5 of its 21 references that are in the map. First posted on arXiv 9 Jul 2025.

Builds on

5 of 21 references.

References · 5

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2024TinyLlama: An Open-Source Small Language Modelcited by 618
  4. 2023An Empirical Study of Scaling Law for OCRcited by 7
  5. 2024Xmodel-VLM: A Simple Baseline for Multimodal Vision Language Modelcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Combining Synthetic and Real Data for Low-Resource Historical OCR: A Manchu Case Study
  2. 2026KazakhOCR: A Synthetic Benchmark for Evaluating Multimodal Models in Low-Resource Kazakh Script OCR
  3. 2025Benchmarking Vision-Language Models on Chinese Ancient Documents: From OCR to Knowledge Reasoning
  4. 2026When Simpler Is Better: Evaluating Translation Pipelines for Medieval Latin Manuscripts
  5. 2026Error Patterns in Historical OCR: A Comparative Analysis of TrOCR and a Vision-Language Model
  6. 2026Designing Production-Scale OCR for India: Multilingual and Domain-Specific Systems
  7. 2026When Low CER is Not Enough: An Analysis of Hallucinations in Vision-Language OCR Systems on Historical Uruguayan Documents
  8. 2025Evaluating LLMs for Historical Document OCR: A Methodological Framework for Digital Humanities