MegaSR: Mining Customized Semantics and Expressive Guidance for Real-World Image Super-Resolution
Not on the map. Why?
Abstract (arXiv)
Text-to-image (T2I) models have ushered in a new era of real-world image super-resolution (Real-ISR) due to their rich internal implicit knowledge for multimodal learning. Although bringing high-level semantic priors and dense pixel guidance have led to advances in reconstruction, we identified several critical phenomena by analyzing the behavior of existing T2I-based Real-ISR methods: (1) Fine detail deficiency, which ultimately leads to incorrect reconstruction in local regions. (2) Block-wise semantic inconsistency, which results in distracted semantic interpretations across U-Net blocks. (3) Edge ambiguity, which causes noticeable structural degradation. Building upon these observations, we first introduce MegaSR, which enhances the T2I-based Real-ISR models with fine-grained customized semantics and expressive guidance to unlock semantically rich and structurally consistent reconstruction. Then, we propose the Customized Semantics Module (CSM) to supplement fine-grained semantics from the image modality and regulate the semantic fusion between multi-level knowledge to realize customization for different U-Net blocks. Besides the semantic adaptation, we identify expressive multimodal signals through pair-wise comparisons and introduce the Multimodal Signal Fusion Module (MSFM) to aggregate them for structurally consistent reconstruction. Extensive experiments on real-world and synthetic datasets demonstrate the superiority of the method. Notably, it not only achieves state-of-the-art performance on quality-driven metrics but also remains competitive on fidelity-focused metrics, striking a balance between perceptual realism and faithful content reconstruction.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 58 of its 72 references that are in the map. First posted on arXiv 11 Mar 2025.
Builds on
58 of 72 references.
References · 58
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2025Qwen2.5-VL Technical Reportcited by 5,418
38 more
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
- 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
- 2018Spectral Normalization for Generative Adversarial Networkscited by 1,618
- 2024Depth Anything V2cited by 1,385
- 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
- 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,256
- 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,218
- 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,215
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
- 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
- 2015Accurate Image Super-Resolution Using Very Deep Convolutional Networkscited by 902
- 2020Pre-Trained Image Processing Transformercited by 891
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
- 2015Holistically-Nested Edge Detectioncited by 590
- 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 514
- 2023Exploiting Diffusion Prior for Real-World Image Super-Resolutioncited by 486
- 2019Toward Real-World Single Image Super-Resolution: A New Benchmark and A New Modelcited by 400
- 2023Uni-ControlNet: All-in-One Control to Text-to-Image Diffusion Modelscited by 358
- 2022Mask DINO: Towards A Unified Transformer-based Framework for Object Detection and Segmentationcited by 341
- 2015Deeply-Recursive Convolutional Network for Image Super-Resolutioncited by 317
- 2023SeeSR: Towards Semantics-Aware Real-World Image Super-Resolutioncited by 311
- 2023Recognize Anything: A Strong Image Tagging Modelcited by 305
- 2023Pixel-Aware Stable Diffusion for Realistic Image Super-resolution and Personalized Stylizationcited by 251
- 2020Component Divide-and-Conquer for Real-World Image Super-Resolutioncited by 243
- 2024One-Step Effective Diffusion Network for Real-World Image Super-Resolutioncited by 243
- 2023SinSR: Diffusion-Based Image Super-Resolution in a Single Stepcited by 235
- 2014Recurrent Neural Network Regularizationcited by 189
- 2017DSLR-Quality Photos on Mobile Devices with Deep Convolutional Networkscited by 156
- 2017Fast and Accurate Image Super-Resolution with Deep Laplacian Pyramid Networkscited by 138
- 2023Dual Aggregation Transformer for Image Super-Resolutioncited by 124
- 2022Details or Artifacts: A Locally Discriminative Learning Approach to Realistic Image Super-Resolutioncited by 114
- 2022Real-World Blind Super-Resolution via Feature Matching with Implicit High-Resolution Priorscited by 98
- 2022Efficient and Degradation-Adaptive Network for Real-World Image Super-Resolutioncited by 96
50 most cited of 58 All 58 (JSON)
Built on by
Not cited yet.