mlsanityData to 14 Oct 2026

Enhanced Semantic Extraction and Guidance for UGC Image Super Resolution

arXiv 2504.09887 ↗First posted 14 Apr 2025cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Due to the disparity between real-world degradations in user-generated content(UGC) images and synthetic degradations, traditional super-resolution methods struggle to generalize effectively, necessitating a more robust approach to model real-world distortions. In this paper, we propose a novel approach to UGC image super-resolution by integrating semantic guidance into a diffusion framework. Our method addresses the inconsistency between degradations in wild and synthetic datasets by separately simulating the degradation processes on the LSDIR dataset and combining them with the official paired training set. Furthermore, we enhance degradation removal and detail generation by incorporating a pretrained semantic extraction model (SAM2) and fine-tuning key hyperparameters for improved perceptual fidelity. Extensive experiments demonstrate the superiority of our approach against state-of-the-art methods. Additionally, the proposed model won second place in the CVPR NTIRE 2025 Short-form UGC Image Super-Resolution Challenge, further validating its effectiveness. The code is available at https://github.c10pom/Moonsofang/NTIRE-2025-SRlab.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 36 of its 47 references that are in the map. First posted on arXiv 14 Apr 2025.

Builds on

36 of 47 references.

References · 36

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  4. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  5. 2022Classifier-Free Diffusion Guidancecited by 5,847
  6. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  7. 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,908
  8. 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,552
  9. 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,264
  10. 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,254
  11. 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,224
  12. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
24 more
  1. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
  2. 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 970
  3. 2015Accurate Image Super-Resolution Using Very Deep Convolutional Networkscited by 903
  4. 2018Residual Dense Network for Image Super-Resolutioncited by 799
  5. 2021Designing a Practical Degradation Model for Deep Blind Image Super-Resolutioncited by 529
  6. 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 522
  7. 2023ResShift: Efficient Diffusion Model for Image Super-resolution by Residual Shiftingcited by 365
  8. 2015Deeply-Recursive Convolutional Network for Image Super-Resolutioncited by 317
  9. 2023SeeSR: Towards Semantics-Aware Real-World Image Super-Resolutioncited by 315
  10. 2024Scaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the Wildcited by 286
  11. 2023DiffIR: Efficient Diffusion Model for Image Restorationcited by 255
  12. 2023Pixel-Aware Stable Diffusion for Realistic Image Super-resolution and Personalized Stylizationcited by 254
  13. 2023Implicit Diffusion Models for Continuous Super-Resolutioncited by 218
  14. 2021Transformer for Single Image Super-Resolutioncited by 150
  15. 2023Efficient and Explicit Modelling of Image Hierarchies for Image Restorationcited by 145
  16. 2016Learning a No-Reference Quality Metric for Single-Image Super-Resolutioncited by 144
  17. 2022Details or Artifacts: A Locally Discriminative Learning Approach to Realistic Image Super-Resolutioncited by 114
  18. 2024Pixel-level and Semantic-level Adjustable Super-resolution: A Dual-LoRA Approachcited by 97
  19. 2024Arbitrary-steps Image Super-resolution via Diffusion Inversioncited by 86
  20. 2022Blueprint Separable Residual Network for Efficient Image Super-Resolutioncited by 44
  21. 2024XPSR: Cross-modal Priors for Diffusion-based Image Super-Resolutioncited by 41
  22. 2024FaithDiff: Unleashing Diffusion Priors for Faithful Image Super-resolutioncited by 32
  23. 2024NTIRE 2024 Challenge on Short-form UGC Video Quality Assessment: Methods and Resultscited by 29
  24. 2022HIPA: Hierarchical Patch Transformer for Single Image Super Resolutioncited by 11

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.