TOLA: Text-aware One-Step Latent Adaptation for Diffusion-based Text Image Super-Resolution
On the map: Diffusion models → Image generation, text-to-image and editing also fits: Inverse problems and image restoration
Abstract (arXiv)
Text image super-resolution (TSR) aims to recover visually faithful and readable text under unknown degradations. Existing diffusion-based methods typically rely on multi-step prediction of either the high-resolution image or its text prior, resulting in prohibitive computational cost and inference latency. More critically, an erroneous text prior may be repeatedly injected into the denoising process, causing image and text predictions to reinforce each other and progressively amplify an early recognition error into a sharp yet semantically incorrect character. To address these limitations, we propose TOLA, a Text-aware One-step Latent Adaptation framework without iterative image-text diffusion. TOLA consists of two key modules. First, a confidence-weighted text conditioning module constructs the semantic condition only once and suppresses unreliable OCR predictions before they contaminate image reconstruction. Second, a lightweight latent residual correction module explicitly estimates and corrects the structured residual errors to recover missing or distorted stroke details. Extensive experiments demonstrate our state-of-the-art performance across all evaluation metrics on both CTR-TSR-Test (× 4) and RealCE-200 benchmarks. It is worth noting that our TOLA consistently surpasses existing diffusion-based TSR methods by at least 2.72 dB in PSNR on CTR-TSR-Test.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 39 of its 52 references that are in the map. First posted on arXiv 24 Sep 2026.
Builds on
39 of 52 references.
References · 39
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2021Image Super-Resolution via Iterative Refinementcited by 1,511
- 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,224
- 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 970
- 2022Denoising Diffusion Restoration Modelscited by 963
- 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 811
- 2022Simple Baselines for Image Restorationcited by 708
- 2021Designing a Practical Degradation Model for Deep Blind Image Super-Resolutioncited by 529
- 2023Exploiting Diffusion Prior for Real-World Image Super-Resolutioncited by 489
27 more
- 2023ResShift: Efficient Diffusion Model for Image Super-resolution by Residual Shiftingcited by 365
- 2024One-Step Effective Diffusion Network for Real-World Image Super-Resolutioncited by 246
- 2023SinSR: Diffusion-Based Image Super-Resolution in a Single Stepcited by 238
- 2020PP-OCR: A Practical Ultra Lightweight OCR Systemcited by 151
- 2024TSD-SR: One-Step Diffusion with Target Score Distillation for Real-World Image Super-Resolutioncited by 87
- 2024AddSR: Accelerating Diffusion-based Blind Super-Resolution with Adversarial Diffusion Distillationcited by 66
- 2020Scene Text Image Super-Resolution in the Wildcited by 63
- 2021Text Prior Guided Scene Text Image Super-resolutioncited by 37
- 2022A Text Attention Network for Spatial Deformation Robust Scene Text Image Super-resolutioncited by 35
- 2021Text Gestalt: Stroke-Aware Scene Text Image Super-Resolutioncited by 28
- 2022C3-STISR: Scene Text Image Super-resolution with Triple Cluescited by 26
- 2023Diffusion-based Blind Text Image Super-Resolutioncited by 25
- 2023Learning Generative Structure Prior for Blind Text Image Super-resolutioncited by 24
- 2023A Benchmark for Chinese-English Scene Text Image Super-resolutioncited by 17
- 2023Improving Scene Text Image Super-resolution via Dual Prior Modulation Networkcited by 15
- 2023Scene Text Image Super-resolution based on Text-conditional Diffusion Modelscited by 15
- 2023Towards Robust Scene Text Image Super-resolution via Explicit Location Enhancementcited by 8
- 2025Text-Aware Real-World Image Super-Resolution via Diffusion Model with Joint Segmentation Decoderscited by 7
- 2023Recognition-Guided Diffusion Model for Scene Text Image Super-Resolutioncited by 6
- 2025Text-Aware Image Restoration with Diffusion Modelscited by 6
- 2025Boosting Diffusion-Based Text Image Super-Resolution Model Towards Generalized Real-World Scenarioscited by 4
- 2026TEXTS-Diff: TEXTS-Aware Diffusion Model for Real-World Text Image Super-Resolutioncited by 4
- 2026FiDeSR: High-Fidelity and Detail-Preserving One-Step Diffusion Super-Resolutioncited by 4
- 2024Efficient scene text image super-resolution with semantic guidancecited by 1
- 2025NCAP: Scene Text Image Super-Resolution with Non-CAtegorical Priorcited by 1
- 2026DualTSR: Unified Dual-Diffusion Transformer for Scene Text Image Super-Resolutioncited by 1
- 2026PRISM: Prior Rectification and Uncertainty-Aware Structure Modeling for Diffusion-Based Text Image Super-Resolutioncited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Unified Diffusion Transformer for High-fidelity Text-Aware Image Restoration
- 2023Image Super-Resolution with Text Prompt Diffusion
- 2024Text-guided Explorable Image Super-resolution
- 2024Improving Consistency in Diffusion Models for Image Super-Resolution
- 2026Coupled Continuous-Discrete Generation for Scene Text Image Super-Resolution
- 2025TextSR: Diffusion Super-Resolution with Multilingual OCR Guidance
- 2024DaLPSR: Leverage Degradation-Aligned Language Prompt for Real-World Image Super-Resolution
- 2023TextDiff: Mask-Guided Residual Diffusion Models for Scene Text Image Super-Resolution