mlsanityData to 14 Oct 2026

Disentangled Textual Priors for Diffusion-based Image Super-Resolution

arXiv 2603.07430 ↗First posted 8 Mar 2026cs.CVcited by 1

On the map: Diffusion models → Inverse problems and image restoration

Abstract (arXiv)

Image Super-Resolution (SR) aims to reconstruct high-resolution images from degraded low-resolution inputs. While diffusion-based SR methods offer powerful generative capabilities, their performance heavily depends on how semantic priors are structured and integrated into the generation process. Existing approaches often rely on entangled or coarse-grained priors that mix global layout with local details, or conflate structural and textural cues, thereby limiting semantic controllability and interpretability. In this work, we propose DTPSR, a novel diffusion-based SR framework that introduces disentangled textual priors along two complementary dimensions: spatial hierarchy (global vs. local) and frequency semantics (low- vs. high-frequency). By explicitly separating these priors, DTPSR enables the model to simultaneously capture scene-level structure and object-specific details with frequency-aware semantic guidance. The corresponding embeddings are injected via specialized cross-attention modules, forming a progressive generation pipeline that reflects the semantic granularity of visual content, from global layout to fine-grained textures. To support this paradigm, we construct DisText-SR, a large-scale dataset containing approximately 95,000 image-text pairs with carefully disentangled global, low-frequency, and high-frequency descriptions. To further enhance controllability and consistency, we adopt a multi-branch classifier-free guidance strategy with frequency-aware negative prompts to suppress hallucinations and semantic drift. Extensive experiments on synthetic and real-world benchmarks show that DTPSR achieves high perceptual quality, competitive fidelity, and strong generalization across diverse degradation scenarios.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 40 of its 47 references that are in the map. First posted on arXiv 8 Mar 2026.

Builds on

40 of 47 references.

Closest ancestors · 7

Same direction, newest first

  1. 2024HoliSDiP: Image Super-Resolution via Holistic Semantics and Diffusion Prior27 Nov
  2. 2024DreamClear: High-Capacity Real-World Image Restoration with Privacy-Safe Dataset Curation24 Oct
  3. 2023SeeSR: Towards Semantics-Aware Real-World Image Super-Resolution27 Nov
  4. 2023SinSR: Diffusion-Based Image Super-Resolution in a Single Step23 Nov
  5. 2023Pixel-Aware Stable Diffusion for Realistic Image Super-resolution and Personalized Stylization28 Aug
  6. 2023Exploiting Diffusion Prior for Real-World Image Super-Resolution11 May
  7. 2023Denoising Diffusion Probabilistic Models for Robust Image Super-Resolution in the Wild15 Feb

Other references · 33

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  6. 2023Visual Instruction Tuningcited by 7,869
  7. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  8. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  9. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  10. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  11. 2022Generative Adversarial Networkscited by 5,627
  12. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
21 more
  1. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  2. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  3. 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
  4. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,887
  5. 2017Decoupled Weight Decay Regularizationcited by 1,831
  6. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
  7. 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,264
  8. 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,254
  9. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,178
  10. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
  11. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
  12. 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 970
  13. 2020Pre-Trained Image Processing Transformercited by 893
  14. 2017The Perception-Distortion Tradeoffcited by 587
  15. 2021Designing a Practical Degradation Model for Deep Blind Image Super-Resolutioncited by 529
  16. 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 522
  17. 2022Activating More Pixels in Image Super-Resolution Transformercited by 438
  18. 2019Toward Real-World Single Image Super-Resolution: A New Benchmark and A New Modelcited by 403
  19. 2024Scaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the Wildcited by 286
  20. 2020Component Divide-and-Conquer for Real-World Image Super-Resolutioncited by 246
  21. 2022Efficient Long-Range Attention Network for Image Super-resolutioncited by 151

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026TGSR: Text-Grounded Diffusion for Faithful Image Super-Resolution
  2. 2025Local-Global Context-Aware and Structure-Preserving Image Super-Resolution
  3. 2026Preserve More Details: Mitigating Content Drift in Real-World Image Super-Resolution
  4. 2026Revisiting the Perception-Distortion Trade-off with Spatial-Semantic Guided Super-Resolution
  5. 2024XPSR: Cross-modal Priors for Diffusion-based Image Super-Resolution
  6. 2026GramSR: Visual Feature Conditioning for Diffusion-Based Super-Resolution
  7. 2024Improving Consistency in Diffusion Models for Image Super-Resolution
  8. 2024ControlSR: Taming Diffusion Models for Consistent Real-World Image Super Resolution