mlsanityData to 14 Oct 2026

Advancing Post-OCR Correction: A Comparative Study of Synthetic Data

arXiv 2408.02253 ↗First posted 5 Aug 2024cs.CLcited by 8

Not on the map. Why?

Abstract (arXiv)

This paper explores the application of synthetic data in the post-OCR domain on multiple fronts by conducting experiments to assess the impact of data volume, augmentation, and synthetic data generation methods on model performance. Furthermore, we introduce a novel algorithm that leverages computer vision feature detection algorithms to calculate glyph similarity for constructing post-OCR synthetic data. Through experiments conducted across a variety of languages, including several low-resource ones, we demonstrate that models like ByT5 can significantly reduce Character Error Rates (CER) without the need for manually annotated data, and our proposed synthetic data generation method shows advantages over traditional methods, particularly in low-resource languages.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 26 of its 68 references that are in the map. First posted on arXiv 5 Aug 2024.

Builds on

26 of 68 references.

References · 26

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  5. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  6. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  7. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
  8. 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,989
  9. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,818
  10. 2015Improving Neural Machine Translation Models with Monolingual Datacited by 788
  11. 2021ByT5: Towards a token-free future with pre-trained byte-to-byte modelscited by 509
  12. 2020Multilingual Translation with Extensible Multilingual Pretraining and Finetuningcited by 287
14 more
  1. 2014Synthetic Data and Artificial Neural Networks for Natural Scene Text Recognitioncited by 214
  2. 2020Training Question Answering Models From Synthetic Datacited by 95
  3. 2022DataPerf: Benchmarks for Data-Centric AI Developmentcited by 90
  4. 2021Data Augmentation Approaches in Natural Language Processing: A Surveycited by 82
  5. 2020CharBERT: Character-aware Pre-trained Language Modelcited by 63
  6. 2017Sequence-to-Label Script Identification for Multilingual OCRcited by 12
  7. 2022A Benchmark and Dataset for Post-OCR text correction in Sanskritcited by 10
  8. 2021Post-OCR Document Correction with large Ensembles of Character Sequence-to-Sequence Modelscited by 8
  9. 2018Upcycle Your OCR: Reusing OCRs for Post-OCR Text Correction in Romanised Sanskritcited by 7
  10. 2023DMOps: Data Management Operation and Recipescited by 7
  11. 2023PALI: A Language Identification Benchmark for Perso-Arabic Scriptscited by 7
  12. 2023Byte-Level Grammatical Error Correction Using Synthetic and Curated Corporacited by 7
  13. 2023Enhancing OCR Performance through Post-OCR Models: Adopting Glyph Embedding for Improved Correctioncited by 2
  14. 2023Data Generation for Post-OCR correction of Cyrillic handwritingcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 2; 2025: 2; 2026: 4.

8 papers.