mlsanityData to 7 Oct 2026

GLYPH-SR: Can We Achieve Both High-Quality Image Super-Resolution and High-Fidelity Text Recovery via VLM-guided Latent Diffusion Model?

arXiv 2510.26339 ↗First posted 30 Oct 2025cs.CV cs.AIcited by 0

On the map: Diffusion models → Inverse problems and image restoration

Abstract (arXiv)

Image super-resolution(SR) is fundamental to many vision system-from surveillance and autonomy to document analysis and retail analytics-because recovering high-frequency details, especially scene-text, enables reliable downstream perception. Scene-text, i.e., text embedded in natural images such as signs, product labels, and storefronts, often carries the most actionable information; when characters are blurred or hallucinated, optical character recognition(OCR) and subsequent decisions fail even if the rest of the image appears sharp. Yet previous SR research has often been tuned to distortion (PSNR/SSIM) or learned perceptual metrics (LIPIS, MANIQA, CLIP-IQA, MUSIQ) that are largely insensitive to character-level errors. Furthermore, studies that do address text SR often focus on simplified benchmarks with isolated characters, overlooking the challenges of text within complex natural scenes. As a result, scene-text is effectively treated as generic texture. For SR to be effective in practical deployments, it is therefore essential to explicitly optimize for both text legibility and perceptual quality. We present GLYPH-SR, a vision-language-guided diffusion framework that aims to achieve both objectives jointly. GLYPH-SR utilizes a Text-SR Fusion ControlNet(TS-ControlNet) guided by OCR data, and a ping-pong scheduler that alternates between text- and scene-centric guidance. To enable targeted text restoration, we train these components on a synthetic corpus while keeping the main SR branch frozen. Across SVT, SCUT-CTW1500, and CUTE80 at x4, and x8, GLYPH-SR improves OCR F1 by up to +15.18 percentage points over diffusion/GAN baseline (SVT x8, OpenOCR) while maintaining competitive MANIQA, CLIP-IQA, and MUSIQ. GLYPH-SR is designed to satisfy both objectives simultaneously-high readability and high visual realism-delivering SR that looks right and reds right.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 21 of its 26 references that are in the map. First posted on arXiv 30 Oct 2025.

Builds on

21 of 26 references.

Closest ancestors · 5

Same direction, newest first

  1. 2024Arbitrary-steps Image Super-resolution via Diffusion Inversion12 Dec
  2. 2024Pixel-level and Semantic-level Adjustable Super-resolution: A Dual-LoRA Approach4 Dec
  3. 2023SeeSR: Towards Semantics-Aware Real-World Image Super-Resolution27 Nov
  4. 2023Scene Text Image Super-resolution based on Text-conditional Diffusion Models16 Nov
  5. 2023Exploiting Diffusion Prior for Real-World Image Super-Resolution11 May

Other references · 16

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
  4. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
  5. 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
  6. 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,256
  7. 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,218
  8. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
  9. 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
  10. 2021Designing a Practical Degradation Model for Deep Blind Image Super-Resolutioncited by 524
  11. 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 514
  12. 2024Scaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the Wildcited by 281
4 more
  1. 2019ICDAR2019 Robust Reading Challenge on Arbitrary-Shaped Text (RRC-ArT)cited by 147
  2. 2022A Text Attention Network for Spatial Deformation Robust Scene Text Image Super-resolutioncited by 35
  3. 2021Text Gestalt: Stroke-Aware Scene Text Image Super-Resolutioncited by 28
  4. 2016Extending Nunchaku to Dependent Type Theorycited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025TextSR: Diffusion Super-Resolution with Multilingual OCR Guidance
  2. 2023Recognition-Guided Diffusion Model for Scene Text Image Super-Resolution
  3. 2023Image Super-Resolution with Text Prompt Diffusion
  4. 2026DualTSR: Unified Dual-Diffusion Transformer for Scene Text Image Super-Resolution
  5. 2025Boosting Diffusion-Based Text Image Super-Resolution Model Towards Generalized Real-World Scenarios
  6. 2026TEXTS-Diff: TEXTS-Aware Diffusion Model for Real-World Text Image Super-Resolution
  7. 2025Text-Aware Real-World Image Super-Resolution via Diffusion Model with Joint Segmentation Decoders
  8. 2023TextDiff: Mask-Guided Residual Diffusion Models for Scene Text Image Super-Resolution