mlsanityData to 14 Oct 2026

TextSSR: Diffusion-based Data Synthesis for Scene Text Recognition

arXiv 2412.01137 ↗First posted 2 Dec 2024cs.CVcited by 8

Not on the map. Why?

Abstract (arXiv)

Scene text recognition (STR) suffers from challenges of either less realistic synthetic training data or the difficulty of collecting sufficient high-quality real-world data, limiting the effectiveness of trained models. Meanwhile, despite producing holistically appealing text images, diffusion-based visual text generation methods struggle to synthesize accurate and realistic instance-level text at scale. To tackle this, we introduce TextSSR: a novel pipeline for Synthesizing Scene Text Recognition training data. TextSSR targets three key synthesizing characteristics: accuracy, realism, and scalability. It achieves accuracy through a proposed region-centric text generation with position-glyph enhancement, ensuring proper character placement. It maintains realism by guiding style and appearance generation using contextual hints from surrounding text or background. This character-aware diffusion architecture enjoys precise character-level control and semantic coherence preservation, without relying on natural language prompts. Therefore, TextSSR supports large-scale generation through combinatorial text permutations. Based on these, we present TextSSR-F, a dataset of 3.55 million quality-screened text instances. Extensive experiments show that STR models trained on TextSSR-F outperform those trained on existing synthetic datasets by clear margins on common benchmarks, and further improvements are observed when mixed with real-world training data. Code is available at https://github.com/YesianRohn/TextSSR.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 56 of its 71 references that are in the map. First posted on arXiv 2 Dec 2024.

Builds on

56 of 71 references.

References · 56

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,555
  4. 2015An End-to-End Trainable Neural Network for Image-based Sequence Recognition and Its Application to Scene Text Recognitioncited by 520
  5. 2016Synthetic Data for Text Localisation in Natural Imagescited by 396
  6. 2023Synthetic Data from Diffusion Models Improves ImageNet Classificationcited by 327
  7. 2022Is synthetic data from generative models ready for image recognition?cited by 320
  8. 2016COCO-Text: Dataset and Benchmark for Text Detection and Recognition in Natural Imagescited by 236
  9. 2023TextDiffuser: Diffusion Models as Text Painterscited by 229
  10. 2014Synthetic Data and Artificial Neural Networks for Natural Scene Text Recognitioncited by 214
  11. 2021Read Like Humans: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Recognitioncited by 194
  12. 2023Mixed-Type Tabular Data Synthesis with Score-based Diffusion in Latent Spacecited by 186
38 more
  1. 2021TextOCR: Towards large-scale end-to-end reasoning for arbitrary-shaped scene textcited by 171
  2. 2023AnyText: Multilingual Visual Text Generation And Editingcited by 170
  3. 2022Scene Text Recognition with Permuted Autoregressive Sequence Modelscited by 149
  4. 2019ICDAR2019 Robust Reading Challenge on Arbitrary-Shaped Text (RRC-ArT)cited by 147
  5. 2023TextDiffuser-2: Unleashing the Power of Language Models for Text Renderingcited by 140
  6. 2019ICDAR2019 Robust Reading Challenge on Multi-lingual Scene Text Detection and Recognition -- RRC-MLT-2019cited by 139
  7. 2023GlyphControl: Glyph Conditional Control for Visual Text Generationcited by 131
  8. 2018Show, Attend and Read: A Simple and Strong Baseline for Irregular Text Recognitioncited by 130
  9. 2019ICDAR 2019 Robust Reading Challenge on Reading Chinese Text on Signboardcited by 128
  10. 2023DatasetDM: Synthesizing Data with Perception Annotations Using Diffusion Modelscited by 123
  11. 2019ICDAR 2019 Competition on Large-scale Street View Text with Partial Labeling -- RRC-LSVTcited by 122
  12. 2022Wukong: A 100 Million Large-scale Chinese Cross-modal Pre-training Benchmarkcited by 114
  13. 2023Dataset Diffusion: Diffusion-based Synthetic Dataset Generation for Pixel-Level Semantic Segmentationcited by 112
  14. 2022PP-OCRv3: More Attempts for the Improvement of Ultra Lightweight OCR Systemcited by 106
  15. 2017ICDAR2017 Competition on Reading Chinese Text in the Wild (RCTW-17)cited by 105
  16. 2023Leaving Reality to Imagination: Robust Classification via Generated Datasetscited by 91
  17. 2022SVTR: Scene Text Recognition with a Single Visual Modelcited by 88
  18. 2019Editing Text in the Wildcited by 82
  19. 2023Diversity is Definitely Needed: Improving Model-Agnostic Zero-shot Classification via Stable Diffusioncited by 81
  20. 2022Generating High Fidelity Data from Low-density Regions using Diffusion Modelscited by 78
  21. 2018NRTR: A No-Recurrence Sequence-to-Sequence Model For Scene Text Recognitioncited by 73
  22. 2021What If We Only Use Real Datasets for Scene Text Recognition? Toward Scene Text Recognition With Fewer Labelscited by 63
  23. 2023UDiffText: A Unified Framework for High-quality Text Synthesis in Arbitrary Images via Character-aware Diffusion Modelscited by 59
  24. 2023Conditional Text Image Generation with Diffusion Modelscited by 58
  25. 2020SwapText: Image Based Texts Transfer in Scenescited by 50
  26. 2023Improving Diffusion Models for Scene Text Editing with Dual Encoderscited by 45
  27. 2023DiffUTE: Universal Text Editing Diffusion Modelcited by 45
  28. 2023Revisiting Scene Text Recognition: A Data Perspectivecited by 45
  29. 2024TextCtrl: Diffusion-based Scene Text Editing with Prior Guidance Controlcited by 45
  30. 2018Verisimilar Image Synthesis for Accurate Detection and Recognition of Texts in Scenescited by 44
  31. 2020UnrealText: Synthesizing Realistic Scene Text Images from the Unreal Worldcited by 43
  32. 2022ABINet++: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Spottingcited by 40
  33. 2022Exploring Stroke-Level Modifications for Scene Text Editingcited by 37
  34. 2021CDistNet: Perceiving Multi-Domain Character Distance for Robust Text Recognitioncited by 36
  35. 2019A Multi-Object Rectified Attention Network for Scene Text Recognitioncited by 30
  36. 2024SVTRv2: CTC Beats Encoder-Decoder Models in Scene Text Recognitioncited by 24
  37. 2024Visual Text Generation in the Wildcited by 22
  38. 2023Context Perception Parallel Decoder for Scene Text Recognitioncited by 19

50 most cited of 56 All 56 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 7.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2023Enhancing Scene Text Detectors with Realistic Text Image Synthesis Using Diffusion Models
  2. 2024Layout Agnostic Scene Text Image Synthesis with Diffusion Models
  3. 2023Scene Text Image Super-resolution based on Text-conditional Diffusion Models
  4. 2024Text Image Generation for Low-Resource Languages with Dual Translation Learning
  5. 2023DiffusionSTR: Diffusion Model for Scene Text Recognition
  6. 2025TextFlux: An OCR-Free DiT Model for High-Fidelity Multilingual Scene Text Synthesis
  7. 2025TextSR: Diffusion Super-Resolution with Multilingual OCR Guidance
  8. 2023Brush Your Text: Synthesize Any Scene Text on Images via Diffusion Model