TextSSR: Diffusion-based Data Synthesis for Scene Text Recognition
Not on the map. Why?
Abstract (arXiv)
Scene text recognition (STR) suffers from challenges of either less realistic synthetic training data or the difficulty of collecting sufficient high-quality real-world data, limiting the effectiveness of trained models. Meanwhile, despite producing holistically appealing text images, diffusion-based visual text generation methods struggle to synthesize accurate and realistic instance-level text at scale. To tackle this, we introduce TextSSR: a novel pipeline for Synthesizing Scene Text Recognition training data. TextSSR targets three key synthesizing characteristics: accuracy, realism, and scalability. It achieves accuracy through a proposed region-centric text generation with position-glyph enhancement, ensuring proper character placement. It maintains realism by guiding style and appearance generation using contextual hints from surrounding text or background. This character-aware diffusion architecture enjoys precise character-level control and semantic coherence preservation, without relying on natural language prompts. Therefore, TextSSR supports large-scale generation through combinatorial text permutations. Based on these, we present TextSSR-F, a dataset of 3.55 million quality-screened text instances. Extensive experiments show that STR models trained on TextSSR-F outperform those trained on existing synthetic datasets by clear margins on common benchmarks, and further improvements are observed when mixed with real-world training data. Code is available at https://github.com/YesianRohn/TextSSR.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 56 of its 71 references that are in the map. First posted on arXiv 2 Dec 2024.
Builds on
56 of 71 references.
References · 56
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,555
- 2015An End-to-End Trainable Neural Network for Image-based Sequence Recognition and Its Application to Scene Text Recognitioncited by 520
- 2016Synthetic Data for Text Localisation in Natural Imagescited by 396
- 2023Synthetic Data from Diffusion Models Improves ImageNet Classificationcited by 327
- 2022Is synthetic data from generative models ready for image recognition?cited by 320
- 2016COCO-Text: Dataset and Benchmark for Text Detection and Recognition in Natural Imagescited by 236
- 2023TextDiffuser: Diffusion Models as Text Painterscited by 229
- 2014Synthetic Data and Artificial Neural Networks for Natural Scene Text Recognitioncited by 214
- 2021Read Like Humans: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Recognitioncited by 194
- 2023Mixed-Type Tabular Data Synthesis with Score-based Diffusion in Latent Spacecited by 186
38 more
- 2021TextOCR: Towards large-scale end-to-end reasoning for arbitrary-shaped scene textcited by 171
- 2023AnyText: Multilingual Visual Text Generation And Editingcited by 170
- 2022Scene Text Recognition with Permuted Autoregressive Sequence Modelscited by 149
- 2019ICDAR2019 Robust Reading Challenge on Arbitrary-Shaped Text (RRC-ArT)cited by 147
- 2023TextDiffuser-2: Unleashing the Power of Language Models for Text Renderingcited by 140
- 2019ICDAR2019 Robust Reading Challenge on Multi-lingual Scene Text Detection and Recognition -- RRC-MLT-2019cited by 139
- 2023GlyphControl: Glyph Conditional Control for Visual Text Generationcited by 131
- 2018Show, Attend and Read: A Simple and Strong Baseline for Irregular Text Recognitioncited by 130
- 2019ICDAR 2019 Robust Reading Challenge on Reading Chinese Text on Signboardcited by 128
- 2023DatasetDM: Synthesizing Data with Perception Annotations Using Diffusion Modelscited by 123
- 2019ICDAR 2019 Competition on Large-scale Street View Text with Partial Labeling -- RRC-LSVTcited by 122
- 2022Wukong: A 100 Million Large-scale Chinese Cross-modal Pre-training Benchmarkcited by 114
- 2023Dataset Diffusion: Diffusion-based Synthetic Dataset Generation for Pixel-Level Semantic Segmentationcited by 112
- 2022PP-OCRv3: More Attempts for the Improvement of Ultra Lightweight OCR Systemcited by 106
- 2017ICDAR2017 Competition on Reading Chinese Text in the Wild (RCTW-17)cited by 105
- 2023Leaving Reality to Imagination: Robust Classification via Generated Datasetscited by 91
- 2022SVTR: Scene Text Recognition with a Single Visual Modelcited by 88
- 2019Editing Text in the Wildcited by 82
- 2023Diversity is Definitely Needed: Improving Model-Agnostic Zero-shot Classification via Stable Diffusioncited by 81
- 2022Generating High Fidelity Data from Low-density Regions using Diffusion Modelscited by 78
- 2018NRTR: A No-Recurrence Sequence-to-Sequence Model For Scene Text Recognitioncited by 73
- 2021What If We Only Use Real Datasets for Scene Text Recognition? Toward Scene Text Recognition With Fewer Labelscited by 63
- 2023UDiffText: A Unified Framework for High-quality Text Synthesis in Arbitrary Images via Character-aware Diffusion Modelscited by 59
- 2023Conditional Text Image Generation with Diffusion Modelscited by 58
- 2020SwapText: Image Based Texts Transfer in Scenescited by 50
- 2023Improving Diffusion Models for Scene Text Editing with Dual Encoderscited by 45
- 2023DiffUTE: Universal Text Editing Diffusion Modelcited by 45
- 2023Revisiting Scene Text Recognition: A Data Perspectivecited by 45
- 2024TextCtrl: Diffusion-based Scene Text Editing with Prior Guidance Controlcited by 45
- 2018Verisimilar Image Synthesis for Accurate Detection and Recognition of Texts in Scenescited by 44
- 2020UnrealText: Synthesizing Realistic Scene Text Images from the Unreal Worldcited by 43
- 2022ABINet++: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Spottingcited by 40
- 2022Exploring Stroke-Level Modifications for Scene Text Editingcited by 37
- 2021CDistNet: Perceiving Multi-Domain Character Distance for Robust Text Recognitioncited by 36
- 2019A Multi-Object Rectified Attention Network for Scene Text Recognitioncited by 30
- 2024SVTRv2: CTC Beats Encoder-Decoder Models in Scene Text Recognitioncited by 24
- 2024Visual Text Generation in the Wildcited by 22
- 2023Context Perception Parallel Decoder for Scene Text Recognitioncited by 19
50 most cited of 56 All 56 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 7.
8 papers.
- 2026ICPR 2026 Competition on Low-Resolution License Plate Recognitioncited by 4
- 2025OmniText: A Training-Free Generalist for Controllable Text-Image Manipulationcited by 3
- 2026What Is Wrong with Synthetic Data for Scene Text Recognition? A Strong Synthetic Engine with Diverse Simulations and Self-Evolutioncited by 2
- 2026Advancing WordArt-Oriented Scene Text Recognition: Datasets and Methodscited by 2
- 2026All-in-One Multilingual Scene Text Recognition with Script-aware Mixture-of-Expertscited by 1
- 2026UniTriGen: Unified Triplet Generation of Aligned Visible-Infrared-Label for Few-Shot RGB-T Semantic Segmentationcited by 0
- 2026TraRA: Trajectory-level Recognition Aggregation for Video Text Spotting in Urban Surveillancecited by 0
- 2026Decompose Radicals, Then Reward: Fine-Grained Inspection for Accurate Chinese Text Renderingcited by 0
- 2026Decompose Radicals, Then Reward: Fine-Grained Inspection for Accurate Chinese Text Rendering29 Sep 2026
- 2026All-in-One Multilingual Scene Text Recognition with Script-aware Mixture-of-Experts21 Sep 2026
- 2026Advancing WordArt-Oriented Scene Text Recognition: Datasets and Methods23 Jun 2026
- 2026TraRA: Trajectory-level Recognition Aggregation for Video Text Spotting in Urban Surveillance5 Jun 2026
- 2026UniTriGen: Unified Triplet Generation of Aligned Visible-Infrared-Label for Few-Shot RGB-T Semantic Segmentation14 May 2026
- 2026ICPR 2026 Competition on Low-Resolution License Plate Recognition24 Apr 2026
- 2026What Is Wrong with Synthetic Data for Scene Text Recognition? A Strong Synthetic Engine with Diverse Simulations and Self-Evolution6 Feb 2026
- 2025OmniText: A Training-Free Generalist for Controllable Text-Image Manipulation28 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2023Enhancing Scene Text Detectors with Realistic Text Image Synthesis Using Diffusion Models
- 2024Layout Agnostic Scene Text Image Synthesis with Diffusion Models
- 2023Scene Text Image Super-resolution based on Text-conditional Diffusion Models
- 2024Text Image Generation for Low-Resource Languages with Dual Translation Learning
- 2023DiffusionSTR: Diffusion Model for Scene Text Recognition
- 2025TextFlux: An OCR-Free DiT Model for High-Fidelity Multilingual Scene Text Synthesis
- 2025TextSR: Diffusion Super-Resolution with Multilingual OCR Guidance
- 2023Brush Your Text: Synthesize Any Scene Text on Images via Diffusion Model