mlsanityData to 7 Oct 2026

Coupled Continuous-Discrete Generation for Scene Text Image Super-Resolution

arXiv 2608.04525 ↗First posted 5 Aug 2026cs.CVcited by 0

On the map: Diffusion models → Inverse problems and image restoration

Abstract (arXiv)

Scene text image super-resolution (STISR) aims to recover visually plausible appearance while preserving character semantics from degraded inputs. Existing STISR systems often rely on externally generated priors or separate image and text models, resulting in error propagation and costly multi-stage inference. We present DualTSR, a unified framework that formulates STISR as coupled continuous-discrete generation. Conditional flow matching restores continuous image latents, while absorbing-state discrete diffusion reconstructs text tokens. Both processes share a multimodal transformer backbone, allowing the evolving image and text states to interact throughout generation without an external OCR prior at inference. On CTR-TSR, DualTSR achieves the best FID, LPIPS, ACC, and NED among the compared methods at both X2 and X4. On an aligned RealCE subset, it obtains the best FID, ACC, and NED with competitive LPIPS. Compared with DiffTSR at X4, DualTSR improves ACC by 12.78 percentage points while reducing the parameter count from 1.23B to 203M and end-to-end latency from 13.3s to 132ms. These results establish DualTSR as an accurate and efficient method for STISR.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 22 of its 33 references that are in the map. First posted on arXiv 5 Aug 2026.

Builds on

22 of 33 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024Diffusion Models, Image Super-Resolution And Everything: A Survey1 Jan

Other references · 21

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2020Denoising Diffusion Implicit Modelscited by 9,655
  3. 2022Classifier-Free Diffusion Guidancecited by 5,717
  4. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  5. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
  6. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
  7. 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,250
  8. 2021Variational Diffusion Modelscited by 1,145
  9. 2022Diffusion-LM Improves Controllable Text Generationcited by 1,006
  10. 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
  11. 2024Simplified and Generalized Masked Diffusion for Discrete Datacited by 606
  12. 2021Designing a Practical Degradation Model for Deep Blind Image Super-Resolutioncited by 524
9 more
  1. 2022Analog Bits: Generating Discrete Data using Diffusion Models with Self-Conditioningcited by 362
  2. 2022Continuous diffusion for categorical datacited by 202
  3. 2022Concrete Score Matching: Generalized Score Matching for Discrete Datacited by 144
  4. 2024Dual Diffusion for Unified Image Generation and Understandingcited by 76
  5. 2020Scene Text Image Super-Resolution in the Wildcited by 62
  6. 2021Benchmarking Chinese Text Recognition: Datasets, Baselines, and an Empirical Studycited by 52
  7. 2025Diffusion Models without Classifier-free Guidancecited by 28
  8. 2022C3-STISR: Scene Text Image Super-resolution with Triple Cluescited by 26
  9. 2019AIM 2019 Challenge on Constrained Super-Resolution: Methods and Resultscited by 18

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026DualTSR: Unified Dual-Diffusion Transformer for Scene Text Image Super-Resolution
  2. 2025Text-Aware Real-World Image Super-Resolution via Diffusion Model with Joint Segmentation Decoders
  3. 2023Scene Text Image Super-resolution based on Text-conditional Diffusion Models
  4. 2023TextDiff: Mask-Guided Residual Diffusion Models for Scene Text Image Super-Resolution
  5. 2026Disentangled Textual Priors for Diffusion-based Image Super-Resolution
  6. 2025Boosting Diffusion-Based Text Image Super-Resolution Model Towards Generalized Real-World Scenarios
  7. 2026TOLA: Text-aware One-Step Latent Adaptation for Diffusion-based Text Image Super-Resolution
  8. 2026PRISM: Prior Rectification and Uncertainty-Aware Structure Modeling for Diffusion-Based Text Image Super-Resolution