OCR Post Correction for Endangered Language Texts
Not on the map. Why?
Abstract (arXiv)
There is little to no data available to build natural language processing models for most endangered languages. However, textual data in these languages often exists in formats that are not machine-readable, such as paper books and scanned images. In this work, we address the task of extracting text from these resources. We create a benchmark dataset of transcriptions for scanned books in three critically endangered languages and present a systematic analysis of how general-purpose OCR tools are not robust to the data-scarce setting of endangered languages. We develop an OCR post-correction method tailored to ease training in this data-scarce setting, reducing the recognition error rate by 34% on average across the three languages.
Key facts. Cited by 31 papers in the map (data through 14 Oct 2026). First posted on arXiv 10 Nov 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 6; 2023: 8; 2024: 4; 2025: 2; 2026: 5.
31 papers.
Sort:
By area:
- 2021OCR-free Document Understanding Transformercited by 407
- 2021Robust Open-Vocabulary Translation from Visual Text Representationscited by 47
- 2022Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptationcited by 44
- 2023XTREME-UP: A User-Centric Scarce-Data Benchmark for Under-Represented Languagescited by 34
- 2021Searchable Hidden Intermediates for End-to-End Models of Decomposable Sequence Taskscited by 24
- 2023A Material Lens on Coloniality in NLPcited by 21
- 2022How can NLP Help Revitalize Endangered Languages? A Case Study and Roadmap for the Cherokee Languagecited by 19
- 2023GlotScript: A Resource and Tool for Low Resource Writing System Identificationcited by 15
- 2022Benchmarking Online Sequence-to-Sequence and Character-based Handwriting Recognition from IMU-Enhanced Penscited by 13
- 2021Lexically Aware Semi-Supervised Learning for OCR Post-Correctioncited by 12
- 2023Efficient OCR for Building a Diverse Digital Historycited by 10
- 2021Post-OCR Document Correction with large Ensembles of Character Sequence-to-Sequence Modelscited by 8
19 more
- 2023Has It All Been Solved? Open NLP Research Questions Not Solved by Large Language Modelscited by 7
- 2024Extracting Training Data from Document-Based VQA Modelscited by 6
- 2022OCR Improves Machine Translation for Low-Resource Languagescited by 5
- 2025PreP-OCR: A Complete Pipeline for Document Image Restoration and Enhanced OCR Accuracycited by 5
- 2023User-Centric Evaluation of OCR Systems for Kwak'walacited by 4
- 2021Lacuna Reconstruction: Self-supervised Pre-training for Low-Resource Historical Document Transcriptioncited by 3
- 2024Post-OCR Text Correction for Bulgarian Historical Documentscited by 3
- 2024RoundTripOCR: A Data Generation Technique for Enhancing Post-OCR Error Correction in Low-Resource Devanagari Languagescited by 3
- 2022Dim Wihl Gat Tun: The Case for Linguistic Expertise in NLP for Underdocumented Languagescited by 2
- 2026synthocr-gen: A synthetic ocr dataset generator for low-resource languages- breaking the data barriercited by 2
- 2026A Survey of OCR Evaluation Methods and Metrics and the Invisibility of Historical Documentscited by 2
- 2023Noisy Parallel Data Alignmentcited by 1
- 2024CMULAB: An Open-Source Framework for Training and Deployment of Natural Language Processing Modelscited by 1
- 2022Learnings from Technological Interventions in a Low Resource Language: Enhancing Information Access in Gondicited by 0
- 2023DUBLIN -- Document Understanding By Language-Image Networkcited by 0
- 2025Developing a Mixed-Methods Pipeline for Community-Oriented Digitization of Kwak'wala Legacy Textscited by 0
- 2026Low-Resource Heuristics for Bahnaric Optical Character Recognition Improvementcited by 0
- 2026Structured Layout Priors for Robust Out-of-Distribution Visual Document Understandingcited by 0
- 2026Sensitivity, Causality, and Repair Dissociate: A Layer-Wise Analysis of Perturbation Robustness and Its Scalingcited by 0
- 2026Sensitivity, Causality, and Repair Dissociate: A Layer-Wise Analysis of Perturbation Robustness and Its Scaling4 Aug 2026
- 2026Structured Layout Priors for Robust Out-of-Distribution Visual Document Understanding19 May 2026
- 2026A Survey of OCR Evaluation Methods and Metrics and the Invisibility of Historical Documents26 Mar 2026
- 2026synthocr-gen: A synthetic ocr dataset generator for low-resource languages- breaking the data barrier22 Jan 2026
- 2026Low-Resource Heuristics for Bahnaric Optical Character Recognition Improvement6 Jan 2026
- 2025Developing a Mixed-Methods Pipeline for Community-Oriented Digitization of Kwak'wala Legacy Texts2 Jun 2025
- 2025PreP-OCR: A Complete Pipeline for Document Image Restoration and Enhanced OCR Accuracy26 May 2025
- 2024RoundTripOCR: A Data Generation Technique for Enhancing Post-OCR Error Correction in Low-Resource Devanagari Languages14 Dec 2024
- 2024Post-OCR Text Correction for Bulgarian Historical Documents31 Aug 2024
- 2024Extracting Training Data from Document-Based VQA Models11 Jul 2024
- 2024CMULAB: An Open-Source Framework for Training and Deployment of Natural Language Processing Models3 Apr 2024
- 2023A Material Lens on Coloniality in NLP14 Nov 2023
19 more
- 2023GlotScript: A Resource and Tool for Low Resource Writing System Identification23 Sep 2023
- 2023DUBLIN -- Document Understanding By Language-Image Network23 May 2023
- 2023Has It All Been Solved? Open NLP Research Questions Not Solved by Large Language Models21 May 2023
- 2023XTREME-UP: A User-Centric Scarce-Data Benchmark for Under-Represented Languages19 May 2023
- 2023Efficient OCR for Building a Diverse Digital History5 Apr 2023
- 2023User-Centric Evaluation of OCR Systems for Kwak'wala26 Feb 2023
- 2023Noisy Parallel Data Alignment23 Jan 2023
- 2022Learnings from Technological Interventions in a Low Resource Language: Enhancing Information Access in Gondi29 Nov 2022
- 2022How can NLP Help Revitalize Endangered Languages? A Case Study and Roadmap for the Cherokee Language25 Apr 2022
- 2022Dim Wihl Gat Tun: The Case for Linguistic Expertise in NLP for Underdocumented Languages17 Mar 2022
- 2022Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptation17 Mar 2022
- 2022OCR Improves Machine Translation for Low-Resource Languages27 Feb 2022
- 2022Benchmarking Online Sequence-to-Sequence and Character-based Handwriting Recognition from IMU-Enhanced Pens14 Feb 2022
- 2021Lacuna Reconstruction: Self-supervised Pre-training for Low-Resource Historical Document Transcription16 Dec 2021
- 2021OCR-free Document Understanding Transformer30 Nov 2021
- 2021Lexically Aware Semi-Supervised Learning for OCR Post-Correction4 Nov 2021
- 2021Post-OCR Document Correction with large Ensembles of Character Sequence-to-Sequence Models13 Sep 2021
- 2021Searchable Hidden Intermediates for End-to-End Models of Decomposable Sequence Tasks2 May 2021
- 2021Robust Open-Vocabulary Translation from Visual Text Representations16 Apr 2021
- 2021OCR-free Document Understanding Transformercited by 407
- 2021Robust Open-Vocabulary Translation from Visual Text Representationscited by 47
- 2022Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptationcited by 44
- 2023XTREME-UP: A User-Centric Scarce-Data Benchmark for Under-Represented Languagescited by 34
- 2021Searchable Hidden Intermediates for End-to-End Models of Decomposable Sequence Taskscited by 24
- 2023A Material Lens on Coloniality in NLPcited by 21
- 2022How can NLP Help Revitalize Endangered Languages? A Case Study and Roadmap for the Cherokee Languagecited by 19
- 2023GlotScript: A Resource and Tool for Low Resource Writing System Identificationcited by 15
- 2022Benchmarking Online Sequence-to-Sequence and Character-based Handwriting Recognition from IMU-Enhanced Penscited by 13
- 2021Lexically Aware Semi-Supervised Learning for OCR Post-Correctioncited by 12
- 2023Efficient OCR for Building a Diverse Digital Historycited by 10
- 2021Post-OCR Document Correction with large Ensembles of Character Sequence-to-Sequence Modelscited by 8
12 most cited of 29 All 29 (JSON)
- 2026Sensitivity, Causality, and Repair Dissociate: A Layer-Wise Analysis of Perturbation Robustness and Its Scaling4 Aug 2026
- 2026A Survey of OCR Evaluation Methods and Metrics and the Invisibility of Historical Documents26 Mar 2026
- 2026synthocr-gen: A synthetic ocr dataset generator for low-resource languages- breaking the data barrier22 Jan 2026
- 2026Low-Resource Heuristics for Bahnaric Optical Character Recognition Improvement6 Jan 2026
- 2025Developing a Mixed-Methods Pipeline for Community-Oriented Digitization of Kwak'wala Legacy Texts2 Jun 2025
- 2025PreP-OCR: A Complete Pipeline for Document Image Restoration and Enhanced OCR Accuracy26 May 2025
- 2024RoundTripOCR: A Data Generation Technique for Enhancing Post-OCR Error Correction in Low-Resource Devanagari Languages14 Dec 2024
- 2024Post-OCR Text Correction for Bulgarian Historical Documents31 Aug 2024
- 2024CMULAB: An Open-Source Framework for Training and Deployment of Natural Language Processing Models3 Apr 2024
- 2023A Material Lens on Coloniality in NLP14 Nov 2023
- 2023GlotScript: A Resource and Tool for Low Resource Writing System Identification23 Sep 2023
- 2023DUBLIN -- Document Understanding By Language-Image Network23 May 2023
12 newest of 29 All 29 (JSON)