mlsanityData to 7 Oct 2026

Simon-SR: Spatially Adaptive Modulation and Visual Prompt Adaptation for Text-Reinforced Super-Resolution

arXiv 2607.09351 ↗First posted 10 Jul 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Severe downsampling makes single image super-resolution (SISR) an ill-posed problem, in which the language-guided multi-modal methods are especially vulnerable to erroneous priors and require costly textual annotations. To address these issues, we propose Simon-SR, a multi-modal SISR framework leveraging learnable prompts for efficient semantic mining and robust text-image fusion. Simon-SR treats textual semantics as learnable latent variables. Specifically, the Contrastive Prompt Learning (CPL) mines instance-level semantics from unannotated images with frozen CLIP encoders, and Prompt-Guided Spatially Adaptive Refinement (PSAR) injects them through attention-gated multi-modal fusion. On CUB and COCO2017 at ×4 and ×16, Simon-SR gains up to 0.50 dB PSNR and 0.0133 SSIM over current SOTA. The project is available at https://github.com/CHT05017/ICAIS26-SimonSR

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 13 references that are in the map. First posted on arXiv 10 Jul 2026.

Builds on

11 of 13 references.

References · 11

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  4. 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
  5. 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
  6. 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,256
  7. 2023ResShift: Efficient Diffusion Model for Image Super-resolution by Residual Shiftingcited by 360
  8. 2017FSRNet: End-to-End Learning Face Super-Resolution with Facial Priorscited by 170
  9. 2021Discrete Cosine Transform Network for Guided Depth Map Super-Resolutioncited by 71
  10. 2024XPSR: Cross-modal Priors for Diffusion-based Image Super-Resolutioncited by 41
  11. 2024CLIP-SR: Collaborative Linguistic and Image Processing for Super-Resolutioncited by 3

Built on by

Not cited yet.