Advancing Post-OCR Correction: A Comparative Study of Synthetic Data
Not on the map. Why?
Abstract (arXiv)
This paper explores the application of synthetic data in the post-OCR domain on multiple fronts by conducting experiments to assess the impact of data volume, augmentation, and synthetic data generation methods on model performance. Furthermore, we introduce a novel algorithm that leverages computer vision feature detection algorithms to calculate glyph similarity for constructing post-OCR synthetic data. Through experiments conducted across a variety of languages, including several low-resource ones, we demonstrate that models like ByT5 can significantly reduce Character Error Rates (CER) without the need for manually annotated data, and our proposed synthetic data generation method shows advantages over traditional methods, particularly in low-resource languages.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 26 of its 68 references that are in the map. First posted on arXiv 5 Aug 2024.
Builds on
26 of 68 references.
References · 26
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
- 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,989
- 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,818
- 2015Improving Neural Machine Translation Models with Monolingual Datacited by 788
- 2021ByT5: Towards a token-free future with pre-trained byte-to-byte modelscited by 509
- 2020Multilingual Translation with Extensible Multilingual Pretraining and Finetuningcited by 287
14 more
- 2014Synthetic Data and Artificial Neural Networks for Natural Scene Text Recognitioncited by 214
- 2020Training Question Answering Models From Synthetic Datacited by 95
- 2022DataPerf: Benchmarks for Data-Centric AI Developmentcited by 90
- 2021Data Augmentation Approaches in Natural Language Processing: A Surveycited by 82
- 2020CharBERT: Character-aware Pre-trained Language Modelcited by 63
- 2017Sequence-to-Label Script Identification for Multilingual OCRcited by 12
- 2022A Benchmark and Dataset for Post-OCR text correction in Sanskritcited by 10
- 2021Post-OCR Document Correction with large Ensembles of Character Sequence-to-Sequence Modelscited by 8
- 2018Upcycle Your OCR: Reusing OCRs for Post-OCR Text Correction in Romanised Sanskritcited by 7
- 2023DMOps: Data Management Operation and Recipescited by 7
- 2023PALI: A Language Identification Benchmark for Perso-Arabic Scriptscited by 7
- 2023Byte-Level Grammatical Error Correction Using Synthetic and Curated Corporacited by 7
- 2023Enhancing OCR Performance through Post-OCR Models: Adopting Glyph Embedding for Improved Correctioncited by 2
- 2023Data Generation for Post-OCR correction of Cyrillic handwritingcited by 1
Built on by
Citing papers per year: 2024: 2; 2025: 2; 2026: 4.
8 papers.
- 2024LLaVA Steering: Visual Instruction Tuning with 500x Fewer Parameters through Modality Linear Representation-Steeringcited by 51
- 2025PreP-OCR: A Complete Pipeline for Document Image Restoration and Enhanced OCR Accuracycited by 5
- 2024RoundTripOCR: A Data Generation Technique for Enhancing Post-OCR Error Correction in Low-Resource Devanagari Languagescited by 3
- 2026OCR-EDR: Rendering-Aware Diagnosis and Repair for Closed-Loop OCR Improvementcited by 1
- 2025PsOCR: Benchmarking Large Multimodal Models for Optical Character Recognition in Low-resource Pashto Languagecited by 0
- 2026KazakhOCR: A Synthetic Benchmark for Evaluating Multimodal Models in Low-Resource Kazakh Script OCRcited by 0
- 2026DocRevive: A Unified Pipeline for Document Text Restorationcited by 0
- 2026Evaluating In-Context Learning and Retrieval Strategies for Devanagari Post-OCR Correctioncited by 0
- 2026Evaluating In-Context Learning and Retrieval Strategies for Devanagari Post-OCR Correction18 Sep 2026
- 2026OCR-EDR: Rendering-Aware Diagnosis and Repair for Closed-Loop OCR Improvement3 Sep 2026
- 2026DocRevive: A Unified Pipeline for Document Text Restoration11 Apr 2026
- 2026KazakhOCR: A Synthetic Benchmark for Evaluating Multimodal Models in Low-Resource Kazakh Script OCR17 Feb 2026
- 2025PreP-OCR: A Complete Pipeline for Document Image Restoration and Enhanced OCR Accuracy26 May 2025
- 2025PsOCR: Benchmarking Large Multimodal Models for Optical Character Recognition in Low-resource Pashto Language15 May 2025
- 2024LLaVA Steering: Visual Instruction Tuning with 500x Fewer Parameters through Modality Linear Representation-Steering16 Dec 2024
- 2024RoundTripOCR: A Data Generation Technique for Enhancing Post-OCR Error Correction in Low-Resource Devanagari Languages14 Dec 2024