mlsanityData to 7 Oct 2026

What Is Wrong with Synthetic Data for Scene Text Recognition? A Strong Synthetic Engine with Diverse Simulations and Self-Evolution

arXiv 2602.06450 ↗First posted 6 Feb 2026cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Large-scale and categorical-balanced text data is essential for training effective Scene Text Recognition (STR) models, which is hard to achieve when collecting real data. Synthetic data offers a cost-effective and perfectly labeled alternative. However, its performance often lags behind, revealing a significant domain gap between real and current synthetic data. In this work, we systematically analyze mainstream rendering-based synthetic datasets and identify their key limitations: insufficient diversity in corpus, font, and layout, which restricts their realism in complex scenarios. To address these issues, we introduce UnionST, a strong data engine synthesizes text covering a union of challenging samples and better aligns with the complexity observed in the wild. We then construct UnionST-S, a large-scale synthetic dataset with improved simulations in challenging scenarios. Furthermore, we develop a self-evolution learning (SEL) framework for effective real data annotation. Experiments show that models trained on UnionST-S achieve significant improvements over existing synthetic datasets. They even surpass real-data performance in certain scenarios. Moreover, when using SEL, the trained models achieve competitive performance by only seeing 9% of real data labels. Code is available at https://github.com/YesianRohn/UnionST.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 39 of its 56 references that are in the map. First posted on arXiv 6 Feb 2026.

Builds on

39 of 56 references.

References · 39

  1. 2017Attention Is All You Needcited by 59,932
  2. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  3. 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,261
  4. 2025Qwen-Image Technical Reportcited by 973
  5. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
  6. 2015An End-to-End Trainable Neural Network for Image-based Sequence Recognition and Its Application to Scene Text Recognitioncited by 519
  7. 2016Synthetic Data for Text Localisation in Natural Imagescited by 396
  8. 2014Synthetic Data and Artificial Neural Networks for Natural Scene Text Recognitioncited by 214
  9. 2021Read Like Humans: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Recognitioncited by 194
  10. 2019What Is Wrong With Scene Text Recognition Model Comparisons? Dataset and Model Analysiscited by 191
  11. 2023AnyText: Multilingual Visual Text Generation And Editingcited by 165
  12. 2022Scene Text Recognition with Permuted Autoregressive Sequence Modelscited by 148
27 more
  1. 2018Show, Attend and Read: A Simple and Strong Baseline for Irregular Text Recognitioncited by 130
  2. 2020SEED: Semantics Enhanced Encoder-Decoder Framework for Scene Text Recognitioncited by 119
  3. 2022SVTR: Scene Text Recognition with a Single Visual Modelcited by 86
  4. 2019Editing Text in the Wildcited by 81
  5. 2018NRTR: A No-Recurrence Sequence-to-Sequence Model For Scene Text Recognitioncited by 73
  6. 2021What If We Only Use Real Datasets for Scene Text Recognition? Toward Scene Text Recognition With Fewer Labelscited by 63
  7. 2023Conditional Text Image Generation with Diffusion Modelscited by 57
  8. 2023Revisiting Scene Text Recognition: A Data Perspectivecited by 45
  9. 2024TextCtrl: Diffusion-based Scene Text Editing with Prior Guidance Controlcited by 44
  10. 2020UnrealText: Synthesizing Realistic Scene Text Images from the Unreal Worldcited by 43
  11. 2021SynthTIGER: Synthetic Text Image GEneratoR Towards Better Text Recognition Modelscited by 43
  12. 2021CDistNet: Perceiving Multi-Domain Character Distance for Robust Text Recognitioncited by 36
  13. 2022Exploring Stroke-Level Modifications for Scene Text Editingcited by 36
  14. 2022Self-supervised Character-to-Character Distillation for Text Recognitioncited by 27
  15. 2024SVTRv2: CTC Beats Encoder-Decoder Models in Scene Text Recognitioncited by 23
  16. 2024Visual Text Generation in the Wildcited by 22
  17. 2023Context Perception Parallel Decoder for Scene Text Recognitioncited by 19
  18. 2023Linguistic More: Taking a Further Step toward Efficient and Accurate Scene Text Recognitioncited by 18
  19. 2024Instruction-Guided Scene Text Recognitioncited by 17
  20. 2019SynthText3D: Synthesizing Scene Text Images from 3D Virtual Worldscited by 15
  21. 2023IPAD: Iterative, Parallel, and Diffusion-based Network for Scene Text Recognitioncited by 12
  22. 2025Handwritten Text Recognition: A Surveycited by 12
  23. 2025UniRec-0.1B: Unified Text and Formula Recognition with 0.1B Parameterscited by 12
  24. 2024Out of Length Text Recognition with Sub-String Matchingcited by 11
  25. 2024TextSSR: Diffusion-based Data Synthesis for Scene Text Recognitioncited by 8
  26. 2019Rethinking Irregular Scene Text Recognitioncited by 4
  27. 2024Boosting Semi-Supervised Scene Text Recognition via Viewing and Summarizingcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.