DualTSR: Unified Dual-Diffusion Transformer for Scene Text Image Super-Resolution
On the map: Diffusion models → Inverse problems and image restoration
Abstract (arXiv)
Scene Text Image Super-Resolution (STISR) aims to restore high-resolution details in low-resolution text images, which is crucial for both human readability and machine recognition. Existing methods, however, often depend on external Optical Character Recognition (OCR) models for textual priors or rely on complex multi-component architectures that are difficult to train and reproduce. In this paper, we introduce DualTSR, a unified end-to-end framework that addresses both issues. DualTSR employs a single multimodal transformer backbone trained with a dual diffusion objective. It simultaneously models the continuous distribution of high-resolution images via Conditional Flow Matching and the discrete distribution of textual content via discrete diffusion. This shared design enables visual and textual information to interact at every layer, allowing the model to infer text priors internally instead of relying on an external OCR module. Compared with prior multi-branch diffusion systems, DualTSR offers a simpler end-to-end formulation with fewer hand-crafted components. Experiments on synthetic Chinese benchmarks and a curated real-world evaluation protocol show that DualTSR achieves strong perceptual quality and text fidelity.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 41 of its 46 references that are in the map. First posted on arXiv 15 Mar 2026.
Builds on
41 of 46 references.
Closest ancestors · 7
Same direction, newest first
- 2024Diffusion Models, Image Super-Resolution And Everything: A Survey1 Jan
- 2023Diffusion-based Blind Text Image Super-Resolution13 Dec
- 2023Recognition-Guided Diffusion Model for Scene Text Image Super-Resolution22 Nov
- 2023Scene Text Image Super-resolution based on Text-conditional Diffusion Models16 Nov
- 2023TextDiff: Mask-Guided Residual Diffusion Models for Scene Text Image Super-Resolution13 Aug
- 2023ACDMSR: Accelerated Conditional Diffusion Models for Single Image Super-Resolution3 Jul
- 2023ResDiff: Combining CNN and Diffusion Model for Image Super-Resolution15 Mar
Other references · 34
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
- 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,665
- 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,250
- 2021Variational Diffusion Modelscited by 1,145
- 2022Diffusion-LM Improves Controllable Text Generationcited by 1,006
- 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
22 more
- 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 835
- 2024Simple and Effective Masked Diffusion Language Modelscited by 800
- 2021Designing a Practical Degradation Model for Deep Blind Image Super-Resolutioncited by 524
- 2022Analog Bits: Generating Discrete Data using Diffusion Models with Self-Conditioningcited by 362
- 2022Continuous diffusion for categorical datacited by 202
- 2023Likelihood-Based Diffusion Language Modelscited by 147
- 2022Concrete Score Matching: Generalized Score Matching for Discrete Datacited by 144
- 2022Latent Diffusion for Language Generationcited by 110
- 2024Dual Diffusion for Unified Image Generation and Understandingcited by 76
- 2020Scene Text Image Super-Resolution in the Wildcited by 62
- 2021Benchmarking Chinese Text Recognition: Datasets, Baselines, and an Empirical Studycited by 52
- 2021Text Prior Guided Scene Text Image Super-resolutioncited by 37
- 2022A Text Attention Network for Spatial Deformation Robust Scene Text Image Super-resolutioncited by 35
- 2021A Practical Contrastive Learning Framework for Single-Image Super-Resolutioncited by 30
- 2021Text Gestalt: Stroke-Aware Scene Text Image Super-Resolutioncited by 28
- 2025Diffusion Models without Classifier-free Guidancecited by 28
- 2022C3-STISR: Scene Text Image Super-resolution with Triple Cluescited by 26
- 2023Learning Generative Structure Prior for Blind Text Image Super-resolutioncited by 24
- 2019AIM 2019 Challenge on Constrained Super-Resolution: Methods and Resultscited by 18
- 2023A Benchmark for Chinese-English Scene Text Image Super-resolutioncited by 17
- 2023PEAN: A Diffusion-Based Prior-Enhanced Attention Network for Scene Text Image Super-Resolutioncited by 4
- 2025Enhanced Generative Structure Prior for Chinese Text Image Super-resolutioncited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Coupled Continuous-Discrete Generation for Scene Text Image Super-Resolution
- 2025TextSR: Diffusion Super-Resolution with Multilingual OCR Guidance
- 2025Text-Aware Real-World Image Super-Resolution via Diffusion Model with Joint Segmentation Decoders
- 2026TEXTS-Diff: TEXTS-Aware Diffusion Model for Real-World Text Image Super-Resolution
- 2026Disentangled Textual Priors for Diffusion-based Image Super-Resolution
- 2025Boosting Diffusion-Based Text Image Super-Resolution Model Towards Generalized Real-World Scenarios
- 2026DreamSR: Towards Ultra-High-Resolution Image Super-Resolution via a Receptive-Field Enhanced Diffusion Transformer
- 2025Unified Diffusion Transformer for High-fidelity Text-Aware Image Restoration