Synthetic Data and Artificial Neural Networks for Natural Scene Text Recognition
Not on the map. Why?
Abstract (arXiv)
In this work we present a framework for the recognition of natural scene text. Our framework does not require any human-labelled data, and performs word recognition on the whole image holistically, departing from the character based recognition systems of the past. The deep neural network models at the centre of this framework are trained solely on data produced by a synthetic text generation engine -- synthetic data that is highly realistic and sufficient to replace real data, giving us infinite amounts of training data. This excess of data exposes new possibilities for word recognition models, and here we consider three models, each one "reading" words in a different way: via 90k-way dictionary encoding, character sequence encoding, and bag-of-N-grams encoding. In the scenarios of language based and completely unconstrained text recognition we greatly improve upon state-of-the-art performance on standard datasets, using our fast, simple machinery and requiring zero data-acquisition costs.
Key facts. Cited by 214 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Jun 2014.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 47; 2022: 52; 2023: 45; 2024: 41; 2025: 17; 2026: 12.
214 papers.
Sort:
By area:
- 2022GIT: A Generative Image-to-text Transformer for Vision and Languagecited by 536
- 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 466
- 2021OCR-free Document Understanding Transformercited by 400
- 2021TrOCR: Transformer-based Optical Character Recognition with Pre-trained Modelscited by 278
- 2023TextDiffuser: Diffusion Models as Text Painterscited by 223
- 2021Read Like Humans: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Recognitioncited by 194
- 2021TextOCR: Towards large-scale end-to-end reasoning for arbitrary-shaped scene textcited by 170
- 2022Scene Text Recognition with Permuted Autoregressive Sequence Modelscited by 148
- 2021From Two to One: A New Scene Text Recognizer with Visual Language Modeling Networkcited by 97
- 2023KOSMOS-2.5: A Multimodal Literate Modelcited by 95
- 2022SVTR: Scene Text Recognition with a Single Visual Modelcited by 86
- 2021Vision Transformer for Fast and Efficient Scene Text Recognitioncited by 81
38 more
- 2021What If We Only Use Real Datasets for Scene Text Recognition? Toward Scene Text Recognition With Fewer Labelscited by 63
- 2023Conditional Text Image Generation with Diffusion Modelscited by 57
- 2021Rethinking Text Line Recognition Modelscited by 45
- 2022Reading and Writing: Discriminative and Generative Modeling for Self-Supervised Text Recognitioncited by 45
- 2022Toward Understanding WordArt: Corner-Guided Transformer for Scene Text Recognitioncited by 45
- 2023Revisiting Scene Text Recognition: A Data Perspectivecited by 45
- 2021SynthTIGER: Synthetic Text Image GEneratoR Towards Better Text Recognition Modelscited by 43
- 2022ABINet++: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Spottingcited by 40
- 2021Text Prior Guided Scene Text Image Super-resolutioncited by 37
- 2024HRVDA: High-Resolution Visual Document Assistantcited by 37
- 2021CDistNet: Perceiving Multi-Domain Character Distance for Robust Text Recognitioncited by 36
- 2022Multi-Granularity Prediction for Scene Text Recognitioncited by 36
- 2022Exploring Stroke-Level Modifications for Scene Text Editingcited by 36
- 2021Multi-modal Text Recognition Networks: Interactive Enhancements between Visual and Semantic Featurescited by 34
- 2022MaskOCR: Text Recognition with Masked Encoder-Decoder Pretrainingcited by 34
- 2022GLASS: Global to Local Attention for Scene-Text Spottingcited by 34
- 2023CLIP4STR: A Simple Baseline for Scene Text Recognition with Pre-trained Vision-Language Modelcited by 30
- 2021Primitive Representation Learning for Scene Text Recognitioncited by 28
- 2022PreSTU: Pre-Training for Scene-Text Understandingcited by 27
- 2022Self-supervised Character-to-Character Distillation for Text Recognitioncited by 27
- 2021A Bilingual, OpenWorld Video Text Dataset and End-to-end Video Text Spotter with Transformercited by 26
- 2021Visual Semantics Allow for Textual Reasoning Better in Scene Text Recognitioncited by 25
- 2022Self-supervised Implicit Glyph Attention for Text Recognitioncited by 25
- 2021Joint Visual Semantic Reasoning: Multi-Stage Decoder for Text Recognitioncited by 24
- 2022Levenshtein OCRcited by 24
- 2023ICDAR 2023 Competition on Hierarchical Text Detection and Recognitioncited by 23
- 2024SVTRv2: CTC Beats Encoder-Decoder Models in Scene Text Recognitioncited by 23
- 2022End-to-End Video Text Spotting with Transformercited by 21
- 2022General Intelligence Requires Rethinking Explorationcited by 20
- 2023Context Perception Parallel Decoder for Scene Text Recognitioncited by 19
- 2023Linguistic More: Taking a Further Step toward Efficient and Accurate Scene Text Recognitioncited by 18
- 2023Attention Where It Matters: Rethinking Visual Document Understanding with Selective Region Concentrationcited by 18
- 2024Choose What You Need: Disentangled Representation Learning for Scene Text Recognition, Removal and Editingcited by 18
- 2021Text is Text, No Matter What: Unifying Text Recognition using Knowledge Distillationcited by 17
- 2024Instruction-Guided Scene Text Recognitioncited by 17
- 2022Multimodal Semi-Supervised Learning for Text Recognitioncited by 16
- 2023CLIPTER: Looking at the Bigger Picture in Scene Text Recognitioncited by 16
- 2023Scene Text Image Super-resolution based on Text-conditional Diffusion Modelscited by 15
50 most cited of 214 All 214 (JSON)
- 2026Combining Synthetic and Real Data for Low-Resource Historical OCR: A Manchu Case Study10 Sep 2026
- 2026Can Scene Text Recognition Read Rare Compositions?1 Sep 2026
- 2026Noise-Free One-Step LoRA for Task-Driven Image Restoration with Diffusion Priors28 Jul 2026
- 2026StepX-Edge: An On-Device UI Vision-Language Model via Architecture-Training-Deployment Co-Design20 Jul 2026
- 2026TextileNet: Towards Zero-shot Text-style Segmentation of Manuscripts10 Jul 2026
- 2026Advancing WordArt-Oriented Scene Text Recognition: Datasets and Methods23 Jun 2026
- 2026Does Synthetic Layered Design Data Benefit Layered Design Decomposition?14 May 2026
- 2026Batch Loss Score for Dynamic Data Pruning6 Apr 2026
- 2026Few-shot Writer Adaptation via Multimodal In-Context Learning31 Mar 2026
- 2026What Is Wrong with Synthetic Data for Scene Text Recognition? A Strong Synthetic Engine with Diverse Simulations and Self-Evolution6 Feb 2026
- 2026synthocr-gen: A synthetic ocr dataset generator for low-resource languages- breaking the data barrier22 Jan 2026
- 2026600k-ks-ocr: a large-scale synthetic dataset for optical character recognition in kashmiri script3 Jan 2026
38 more
- 2025UniRec-0.1B: Unified Text and Formula Recognition with 0.1B Parameters24 Dec 2025
- 2025SELECT: Detecting Label Errors in Real-world Scene Text Data16 Dec 2025
- 2025MDiff4STR: Mask Diffusion Model for Scene Text Recognition1 Dec 2025
- 2025An Adaptive Resonance Theory-based Topological Clustering Algorithm with a Self-Adjusting Vigilance Parameter22 Nov 2025
- 2025ClapperText: A Benchmark for Text Recognition in Low-Resource Archival Documents17 Oct 2025
- 2025A Large-scale Dataset for Robust Complex Anime Scene Text Detection9 Oct 2025
- 2025Using Images from a Video Game to Improve the Detection of Truck Axles30 Sep 2025
- 2025Optimal Transport for Handwritten Text Recognition in a Low-Resource Regime21 Sep 2025
- 2025PRIM: Towards Practical In-Image Multilingual Machine Translation5 Sep 2025
- 2025AutoGeTS: Knowledge-based Automated Generation of Text Synthetics for Improving Text Classification4 Aug 2025
- 2025TEACH: Text Encoding as Curriculum Hints for Scene Text Recognition2 Aug 2025
- 2025ESTR-CoT: Towards Explainable and Accurate Event Stream based Scene Text Recognition with Chain-of-Thought Reasoning2 Jul 2025
- 2025Hyper-Local Deformable Transformers for Text Spotting on Historical Maps17 Jun 2025
- 2025PsOCR: Benchmarking Large Multimodal Models for Optical Character Recognition in Low-resource Pashto Language15 May 2025
- 2025Joint Low-level and High-level Textual Representation Learning with Multiple Masking Strategies11 May 2025
- 2025Scale Efficient Training for Large Datasets17 Mar 2025
- 2025EVE: Towards End-to-End Video Subtitle Extraction with Vision-Language Models6 Mar 2025
- 2024Deciphering the Underserved: Benchmarking LLM OCR for Low-Resource Scripts20 Dec 2024
- 2024LLaVA-UHD v2: an MLLM Integrating High-Resolution Semantic Pyramid via Hierarchical Window Transformer18 Dec 2024
- 2024TextSSR: Diffusion-based Data Synthesis for Scene Text Recognition2 Dec 2024
- 2024On the Generalization of Handwritten Text Recognition Models26 Nov 2024
- 2024SVTRv2: CTC Beats Encoder-Decoder Models in Scene Text Recognition24 Nov 2024
- 2024Boosting Semi-Supervised Scene Text Recognition via Viewing and Summarizing23 Nov 2024
- 2024Relational Contrastive Learning and Masked Image Modeling for Scene Text Recognition18 Nov 2024
- 2024KhmerST: A Low-Resource Khmer Scene Text Detection and Recognition Benchmark23 Oct 2024
- 2024Stratified Domain Adaptation: A Progressive Self-Training Approach for Scene Text Recognition13 Oct 2024
- 2024AI-Powered Augmented Reality for Satellite Assembly, Integration and Test26 Sep 2024
- 2024Text Image Generation for Low-Resource Languages with Dual Translation Learning26 Sep 2024
- 2024One Model for Two Tasks: Cooperatively Recognizing and Recovering Low-Resolution Scene Text Images by Iterative Mutual Guidance22 Sep 2024
- 2024@Bench: Benchmarking Vision-Language Models for Human-centered Assistive Technology21 Sep 2024
- 2024VL-Reader: Vision and Language Reconstructor is an Effective Scene Text Recognizer18 Sep 2024
- 2024Platypus: A Generalized Specialist Model for Reading Text in Various Forms27 Aug 2024
- 2024Advancing Post-OCR Correction: A Comparative Study of Synthetic Data5 Aug 2024
- 2024LEGO: Self-Supervised Representation Learning for Scene Text Images4 Aug 2024
- 2024Self-Supervised Learning for Text Recognition: A Critical Survey29 Jul 2024
- 2024Learning Instance-Specific Parameters of Black-Box Models Using Differentiable Surrogates23 Jul 2024
- 2024Out of Length Text Recognition with Sub-String Matching17 Jul 2024
- 2024Spanish TrOCR: Leveraging Transfer Learning for Language Adaptation9 Jul 2024
50 newest of 214 All 214 (JSON)
- 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 466
- 2021From Two to One: A New Scene Text Recognizer with Visual Language Modeling Networkcited by 97
- 2024HRVDA: High-Resolution Visual Document Assistantcited by 37
- 2023CLIP4STR: A Simple Baseline for Scene Text Recognition with Pre-trained Vision-Language Modelcited by 30
- 2023CLIPTER: Looking at the Bigger Picture in Scene Text Recognitioncited by 16
- 2024LLaVA-UHD v2: an MLLM Integrating High-Resolution Semantic Pyramid via Hierarchical Window Transformercited by 8
- 2025EVE: Towards End-to-End Video Subtitle Extraction with Vision-Language Modelscited by 6
- 2024@Bench: Benchmarking Vision-Language Models for Human-centered Assistive Technologycited by 2
- 2026StepX-Edge: An On-Device UI Vision-Language Model via Architecture-Training-Deployment Co-Designcited by 1
- 2025PsOCR: Benchmarking Large Multimodal Models for Optical Character Recognition in Low-resource Pashto Languagecited by 0
- 2026StepX-Edge: An On-Device UI Vision-Language Model via Architecture-Training-Deployment Co-Design20 Jul 2026
- 2025PsOCR: Benchmarking Large Multimodal Models for Optical Character Recognition in Low-resource Pashto Language15 May 2025
- 2025EVE: Towards End-to-End Video Subtitle Extraction with Vision-Language Models6 Mar 2025
- 2024LLaVA-UHD v2: an MLLM Integrating High-Resolution Semantic Pyramid via Hierarchical Window Transformer18 Dec 2024
- 2024@Bench: Benchmarking Vision-Language Models for Human-centered Assistive Technology21 Sep 2024
- 2024HRVDA: High-Resolution Visual Document Assistant10 Apr 2024
- 2023CLIP4STR: A Simple Baseline for Scene Text Recognition with Pre-trained Vision-Language Model23 May 2023
- 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Models13 May 2023
- 2023CLIPTER: Looking at the Bigger Picture in Scene Text Recognition18 Jan 2023
- 2021From Two to One: A New Scene Text Recognizer with Visual Language Modeling Network22 Aug 2021
- 2023TextDiffuser: Diffusion Models as Text Painterscited by 223
- 2023Conditional Text Image Generation with Diffusion Modelscited by 57
- 2023Scene Text Image Super-resolution based on Text-conditional Diffusion Modelscited by 15
- 2024Text Image Inpainting via Global Structure-Guided Diffusion Modelscited by 8
- 2023DiffusionSTR: Diffusion Model for Scene Text Recognitioncited by 7
- 2025MDiff4STR: Mask Diffusion Model for Scene Text Recognitioncited by 4
- 2026Noise-Free One-Step LoRA for Task-Driven Image Restoration with Diffusion Priorscited by 0
- 2026Noise-Free One-Step LoRA for Task-Driven Image Restoration with Diffusion Priors28 Jul 2026
- 2025MDiff4STR: Mask Diffusion Model for Scene Text Recognition1 Dec 2025
- 2024Text Image Inpainting via Global Structure-Guided Diffusion Models26 Jan 2024
- 2023Scene Text Image Super-resolution based on Text-conditional Diffusion Models16 Nov 2023
- 2023DiffusionSTR: Diffusion Model for Scene Text Recognition29 Jun 2023
- 2023Conditional Text Image Generation with Diffusion Models19 Jun 2023
- 2023TextDiffuser: Diffusion Models as Text Painters18 May 2023
- 2022GIT: A Generative Image-to-text Transformer for Vision and Languagecited by 536
- 2021OCR-free Document Understanding Transformercited by 400
- 2021TrOCR: Transformer-based Optical Character Recognition with Pre-trained Modelscited by 278
- 2021Read Like Humans: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Recognitioncited by 194
- 2021TextOCR: Towards large-scale end-to-end reasoning for arbitrary-shaped scene textcited by 170
- 2022Scene Text Recognition with Permuted Autoregressive Sequence Modelscited by 148
- 2023KOSMOS-2.5: A Multimodal Literate Modelcited by 95
- 2022SVTR: Scene Text Recognition with a Single Visual Modelcited by 86
- 2021Vision Transformer for Fast and Efficient Scene Text Recognitioncited by 81
- 2021What If We Only Use Real Datasets for Scene Text Recognition? Toward Scene Text Recognition With Fewer Labelscited by 63
- 2021Rethinking Text Line Recognition Modelscited by 45
- 2022Reading and Writing: Discriminative and Generative Modeling for Self-Supervised Text Recognitioncited by 45
12 most cited of 196 All 196 (JSON)
- 2026Combining Synthetic and Real Data for Low-Resource Historical OCR: A Manchu Case Study10 Sep 2026
- 2026Can Scene Text Recognition Read Rare Compositions?1 Sep 2026
- 2026TextileNet: Towards Zero-shot Text-style Segmentation of Manuscripts10 Jul 2026
- 2026Advancing WordArt-Oriented Scene Text Recognition: Datasets and Methods23 Jun 2026
- 2026Does Synthetic Layered Design Data Benefit Layered Design Decomposition?14 May 2026
- 2026Batch Loss Score for Dynamic Data Pruning6 Apr 2026
- 2026Few-shot Writer Adaptation via Multimodal In-Context Learning31 Mar 2026
- 2026What Is Wrong with Synthetic Data for Scene Text Recognition? A Strong Synthetic Engine with Diverse Simulations and Self-Evolution6 Feb 2026
- 2026synthocr-gen: A synthetic ocr dataset generator for low-resource languages- breaking the data barrier22 Jan 2026
- 2026600k-ks-ocr: a large-scale synthetic dataset for optical character recognition in kashmiri script3 Jan 2026
- 2025UniRec-0.1B: Unified Text and Formula Recognition with 0.1B Parameters24 Dec 2025
- 2025SELECT: Detecting Label Errors in Real-world Scene Text Data16 Dec 2025
12 newest of 196 All 196 (JSON)