Enhanced Semantic Extraction and Guidance for UGC Image Super Resolution
Not on the map. Why?
Abstract (arXiv)
Due to the disparity between real-world degradations in user-generated content(UGC) images and synthetic degradations, traditional super-resolution methods struggle to generalize effectively, necessitating a more robust approach to model real-world distortions. In this paper, we propose a novel approach to UGC image super-resolution by integrating semantic guidance into a diffusion framework. Our method addresses the inconsistency between degradations in wild and synthetic datasets by separately simulating the degradation processes on the LSDIR dataset and combining them with the official paired training set. Furthermore, we enhance degradation removal and detail generation by incorporating a pretrained semantic extraction model (SAM2) and fine-tuning key hyperparameters for improved perceptual fidelity. Extensive experiments demonstrate the superiority of our approach against state-of-the-art methods. Additionally, the proposed model won second place in the CVPR NTIRE 2025 Short-form UGC Image Super-Resolution Challenge, further validating its effectiveness. The code is available at https://github.c10pom/Moonsofang/NTIRE-2025-SRlab.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 36 of its 47 references that are in the map. First posted on arXiv 14 Apr 2025.
Builds on
36 of 47 references.
References · 36
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,908
- 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,552
- 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,264
- 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,254
- 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,224
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
24 more
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
- 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 970
- 2015Accurate Image Super-Resolution Using Very Deep Convolutional Networkscited by 903
- 2018Residual Dense Network for Image Super-Resolutioncited by 799
- 2021Designing a Practical Degradation Model for Deep Blind Image Super-Resolutioncited by 529
- 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 522
- 2023ResShift: Efficient Diffusion Model for Image Super-resolution by Residual Shiftingcited by 365
- 2015Deeply-Recursive Convolutional Network for Image Super-Resolutioncited by 317
- 2023SeeSR: Towards Semantics-Aware Real-World Image Super-Resolutioncited by 315
- 2024Scaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the Wildcited by 286
- 2023DiffIR: Efficient Diffusion Model for Image Restorationcited by 255
- 2023Pixel-Aware Stable Diffusion for Realistic Image Super-resolution and Personalized Stylizationcited by 254
- 2023Implicit Diffusion Models for Continuous Super-Resolutioncited by 218
- 2021Transformer for Single Image Super-Resolutioncited by 150
- 2023Efficient and Explicit Modelling of Image Hierarchies for Image Restorationcited by 145
- 2016Learning a No-Reference Quality Metric for Single-Image Super-Resolutioncited by 144
- 2022Details or Artifacts: A Locally Discriminative Learning Approach to Realistic Image Super-Resolutioncited by 114
- 2024Pixel-level and Semantic-level Adjustable Super-resolution: A Dual-LoRA Approachcited by 97
- 2024Arbitrary-steps Image Super-resolution via Diffusion Inversioncited by 86
- 2022Blueprint Separable Residual Network for Efficient Image Super-Resolutioncited by 44
- 2024XPSR: Cross-modal Priors for Diffusion-based Image Super-Resolutioncited by 41
- 2024FaithDiff: Unleashing Diffusion Priors for Faithful Image Super-resolutioncited by 32
- 2024NTIRE 2024 Challenge on Short-form UGC Video Quality Assessment: Methods and Resultscited by 29
- 2022HIPA: Hierarchical Patch Transformer for Single Image Super Resolutioncited by 11
Built on by
Citing papers per year: 2025: 2.
2 papers.