mlsanityData to 7 Oct 2026

MegaSR: Mining Customized Semantics and Expressive Guidance for Real-World Image Super-Resolution

arXiv 2503.08096 ↗First posted 11 Mar 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Text-to-image (T2I) models have ushered in a new era of real-world image super-resolution (Real-ISR) due to their rich internal implicit knowledge for multimodal learning. Although bringing high-level semantic priors and dense pixel guidance have led to advances in reconstruction, we identified several critical phenomena by analyzing the behavior of existing T2I-based Real-ISR methods: (1) Fine detail deficiency, which ultimately leads to incorrect reconstruction in local regions. (2) Block-wise semantic inconsistency, which results in distracted semantic interpretations across U-Net blocks. (3) Edge ambiguity, which causes noticeable structural degradation. Building upon these observations, we first introduce MegaSR, which enhances the T2I-based Real-ISR models with fine-grained customized semantics and expressive guidance to unlock semantically rich and structurally consistent reconstruction. Then, we propose the Customized Semantics Module (CSM) to supplement fine-grained semantics from the image modality and regulate the semantic fusion between multi-level knowledge to realize customization for different U-Net blocks. Besides the semantic adaptation, we identify expressive multimodal signals through pair-wise comparisons and introduce the Multimodal Signal Fusion Module (MSFM) to aggregate them for structurally consistent reconstruction. Extensive experiments on real-world and synthetic datasets demonstrate the superiority of the method. Notably, it not only achieves state-of-the-art performance on quality-driven metrics but also remains competitive on fidelity-focused metrics, striking a balance between perceptual realism and faithful content reconstruction.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 58 of its 72 references that are in the map. First posted on arXiv 11 Mar 2025.

Builds on

58 of 72 references.

References · 58

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  6. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  7. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  8. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  9. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
  10. 2022Scalable Diffusion Models with Transformerscited by 5,931
  11. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  12. 2025Qwen2.5-VL Technical Reportcited by 5,418
38 more
  1. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  2. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  3. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
  4. 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
  5. 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
  6. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
  7. 2018Spectral Normalization for Generative Adversarial Networkscited by 1,618
  8. 2024Depth Anything V2cited by 1,385
  9. 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
  10. 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,256
  11. 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,218
  12. 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,215
  13. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
  14. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
  15. 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
  16. 2015Accurate Image Super-Resolution Using Very Deep Convolutional Networkscited by 902
  17. 2020Pre-Trained Image Processing Transformercited by 891
  18. 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
  19. 2015Holistically-Nested Edge Detectioncited by 590
  20. 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 514
  21. 2023Exploiting Diffusion Prior for Real-World Image Super-Resolutioncited by 486
  22. 2019Toward Real-World Single Image Super-Resolution: A New Benchmark and A New Modelcited by 400
  23. 2023Uni-ControlNet: All-in-One Control to Text-to-Image Diffusion Modelscited by 358
  24. 2022Mask DINO: Towards A Unified Transformer-based Framework for Object Detection and Segmentationcited by 341
  25. 2015Deeply-Recursive Convolutional Network for Image Super-Resolutioncited by 317
  26. 2023SeeSR: Towards Semantics-Aware Real-World Image Super-Resolutioncited by 311
  27. 2023Recognize Anything: A Strong Image Tagging Modelcited by 305
  28. 2023Pixel-Aware Stable Diffusion for Realistic Image Super-resolution and Personalized Stylizationcited by 251
  29. 2020Component Divide-and-Conquer for Real-World Image Super-Resolutioncited by 243
  30. 2024One-Step Effective Diffusion Network for Real-World Image Super-Resolutioncited by 243
  31. 2023SinSR: Diffusion-Based Image Super-Resolution in a Single Stepcited by 235
  32. 2014Recurrent Neural Network Regularizationcited by 189
  33. 2017DSLR-Quality Photos on Mobile Devices with Deep Convolutional Networkscited by 156
  34. 2017Fast and Accurate Image Super-Resolution with Deep Laplacian Pyramid Networkscited by 138
  35. 2023Dual Aggregation Transformer for Image Super-Resolutioncited by 124
  36. 2022Details or Artifacts: A Locally Discriminative Learning Approach to Realistic Image Super-Resolutioncited by 114
  37. 2022Real-World Blind Super-Resolution via Feature Matching with Implicit High-Resolution Priorscited by 98
  38. 2022Efficient and Degradation-Adaptive Network for Real-World Image Super-Resolutioncited by 96

50 most cited of 58 All 58 (JSON)

Built on by

Not cited yet.