What Is Wrong with Synthetic Data for Scene Text Recognition? A Strong Synthetic Engine with Diverse Simulations and Self-Evolution
Not on the map. Why?
Abstract (arXiv)
Large-scale and categorical-balanced text data is essential for training effective Scene Text Recognition (STR) models, which is hard to achieve when collecting real data. Synthetic data offers a cost-effective and perfectly labeled alternative. However, its performance often lags behind, revealing a significant domain gap between real and current synthetic data. In this work, we systematically analyze mainstream rendering-based synthetic datasets and identify their key limitations: insufficient diversity in corpus, font, and layout, which restricts their realism in complex scenarios. To address these issues, we introduce UnionST, a strong data engine synthesizes text covering a union of challenging samples and better aligns with the complexity observed in the wild. We then construct UnionST-S, a large-scale synthetic dataset with improved simulations in challenging scenarios. Furthermore, we develop a self-evolution learning (SEL) framework for effective real data annotation. Experiments show that models trained on UnionST-S achieve significant improvements over existing synthetic datasets. They even surpass real-data performance in certain scenarios. Moreover, when using SEL, the trained models achieve competitive performance by only seeing 9% of real data labels. Code is available at https://github.com/YesianRohn/UnionST.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 39 of its 56 references that are in the map. First posted on arXiv 6 Feb 2026.
Builds on
39 of 56 references.
References · 39
- 2017Attention Is All You Needcited by 59,932
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
- 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,261
- 2025Qwen-Image Technical Reportcited by 973
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2015An End-to-End Trainable Neural Network for Image-based Sequence Recognition and Its Application to Scene Text Recognitioncited by 519
- 2016Synthetic Data for Text Localisation in Natural Imagescited by 396
- 2014Synthetic Data and Artificial Neural Networks for Natural Scene Text Recognitioncited by 214
- 2021Read Like Humans: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Recognitioncited by 194
- 2019What Is Wrong With Scene Text Recognition Model Comparisons? Dataset and Model Analysiscited by 191
- 2023AnyText: Multilingual Visual Text Generation And Editingcited by 165
- 2022Scene Text Recognition with Permuted Autoregressive Sequence Modelscited by 148
27 more
- 2018Show, Attend and Read: A Simple and Strong Baseline for Irregular Text Recognitioncited by 130
- 2020SEED: Semantics Enhanced Encoder-Decoder Framework for Scene Text Recognitioncited by 119
- 2022SVTR: Scene Text Recognition with a Single Visual Modelcited by 86
- 2019Editing Text in the Wildcited by 81
- 2018NRTR: A No-Recurrence Sequence-to-Sequence Model For Scene Text Recognitioncited by 73
- 2021What If We Only Use Real Datasets for Scene Text Recognition? Toward Scene Text Recognition With Fewer Labelscited by 63
- 2023Conditional Text Image Generation with Diffusion Modelscited by 57
- 2023Revisiting Scene Text Recognition: A Data Perspectivecited by 45
- 2024TextCtrl: Diffusion-based Scene Text Editing with Prior Guidance Controlcited by 44
- 2020UnrealText: Synthesizing Realistic Scene Text Images from the Unreal Worldcited by 43
- 2021SynthTIGER: Synthetic Text Image GEneratoR Towards Better Text Recognition Modelscited by 43
- 2021CDistNet: Perceiving Multi-Domain Character Distance for Robust Text Recognitioncited by 36
- 2022Exploring Stroke-Level Modifications for Scene Text Editingcited by 36
- 2022Self-supervised Character-to-Character Distillation for Text Recognitioncited by 27
- 2024SVTRv2: CTC Beats Encoder-Decoder Models in Scene Text Recognitioncited by 23
- 2024Visual Text Generation in the Wildcited by 22
- 2023Context Perception Parallel Decoder for Scene Text Recognitioncited by 19
- 2023Linguistic More: Taking a Further Step toward Efficient and Accurate Scene Text Recognitioncited by 18
- 2024Instruction-Guided Scene Text Recognitioncited by 17
- 2019SynthText3D: Synthesizing Scene Text Images from 3D Virtual Worldscited by 15
- 2023IPAD: Iterative, Parallel, and Diffusion-based Network for Scene Text Recognitioncited by 12
- 2025Handwritten Text Recognition: A Surveycited by 12
- 2025UniRec-0.1B: Unified Text and Formula Recognition with 0.1B Parameterscited by 12
- 2024Out of Length Text Recognition with Sub-String Matchingcited by 11
- 2024TextSSR: Diffusion-based Data Synthesis for Scene Text Recognitioncited by 8
- 2019Rethinking Irregular Scene Text Recognitioncited by 4
- 2024Boosting Semi-Supervised Scene Text Recognition via Viewing and Summarizingcited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.