mlsanityData to 14 Oct 2026

CoSeR: Bridging Image and Language for Cognitive Super-Resolution

arXiv 2311.16512 ↗First posted 27 Nov 2023cs.CV cs.AIcited by 66

Not on the map. Why?

Cited by 35 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Existing super-resolution (SR) models primarily focus on restoring local texture details, often neglecting the global semantic information within the scene. This oversight can lead to the omission of crucial semantic details or the introduction of inaccurate textures during the recovery process. In our work, we introduce the Cognitive Super-Resolution (CoSeR) framework, empowering SR models with the capacity to comprehend low-resolution images. We achieve this by marrying image appearance and language understanding to generate a cognitive embedding, which not only activates prior information from large text-to-image diffusion models but also facilitates the generation of high-quality reference images to optimize the SR process. To further improve image fidelity, we propose a novel condition injection scheme called "All-in-Attention", consolidating all conditional information into a single module. Consequently, our method successfully restores semantically correct and photorealistic details, demonstrating state-of-the-art performance across multiple benchmarks. Code: https://github.com/VINHYU/CoSeR

Key facts. Cited by 66 papers in the map (data through 14 Oct 2026). Builds on 69 of its 85 references that are in the map. First posted on arXiv 27 Nov 2023.

Builds on

69 of 85 references.

References · 69

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  5. 2020Denoising Diffusion Implicit Modelscited by 9,781
  6. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  7. 2023Segment Anythingcited by 8,234
  8. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  9. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  10. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  11. 2022Classifier-Free Diffusion Guidancecited by 5,847
  12. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
38 more
  1. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  2. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
  3. 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,908
  4. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,887
  5. 2021Image Super-Resolution via Iterative Refinementcited by 1,511
  6. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
  7. 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,264
  8. 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,254
  9. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
  10. 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 970
  11. 2022Denoising Diffusion Restoration Modelscited by 963
  12. 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 811
  13. 2022Zero-Shot Image Restoration Using Denoising Diffusion Null-Space Modelcited by 583
  14. 2021Designing a Practical Degradation Model for Deep Blind Image Super-Resolutioncited by 529
  15. 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 522
  16. 2023Exploiting Diffusion Prior for Real-World Image Super-Resolutioncited by 489
  17. 2019Toward Real-World Single Image Super-Resolution: A New Benchmark and A New Modelcited by 403
  18. 2018Recovering Realistic Texture in Image Super-resolution by Deep Spatial Feature Transformcited by 371
  19. 2023Uni-ControlNet: All-in-One Control to Text-to-Image Diffusion Modelscited by 359
  20. 2020PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Modelscited by 358
  21. 2021Towards Real-World Blind Face Restoration with Generative Facial Priorcited by 349
  22. 2020Learning Texture Transformer Network for Image Super-Resolutioncited by 347
  23. 2015Sketch-based Manga Retrieval using Manga109 Datasetcited by 329
  24. 2023Composer: Creative and Controllable Image Synthesis with Composable Conditionscited by 304
  25. 2023DiffBIR: Towards Blind Image Restoration with Generative Diffusion Priorcited by 257
  26. 2023Pixel-Aware Stable Diffusion for Realistic Image Super-resolution and Personalized Stylizationcited by 254
  27. 2020Component Divide-and-Conquer for Real-World Image Super-Resolutioncited by 246
  28. 2020Exploiting Deep Generative Prior for Versatile Image Restoration and Manipulationcited by 225
  29. 2023Generative Diffusion Prior for Unified Image Restoration and Enhancementcited by 199
  30. 2021GAN Prior Embedded Network for Blind Face Restoration in the Wildcited by 197
  31. 2019Image Processing Using Multi-Code GAN Priorcited by 185
  32. 2019EdgeConnect: Generative Image Inpainting with Adversarial Edge Learningcited by 163
  33. 2020GLEAN: Generative Latent Bank for Large-Factor Image Super-Resolutioncited by 158
  34. 2018Unsupervised Image Super-Resolution using Cycle-in-Cycle Generative Adversarial Networkscited by 133
  35. 2019Image Super-Resolution by Neural Texture Transfercited by 120
  36. 2022Details or Artifacts: A Locally Discriminative Learning Approach to Realistic Image Super-Resolutioncited by 114
  37. 2023Controlling Vision-Language Models for Multi-Task Image Restorationcited by 110
  38. 2022Real-World Blind Super-Resolution via Feature Matching with Implicit High-Resolution Priorscited by 100

50 most cited of 69 All 69 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 31; 2025: 23; 2026: 11.

66 papers.

Sort:

By area:

  1. 2024Diffusion Model-Based Image Editing: A Surveycited by 212
  2. 2024Arbitrary-steps Image Super-resolution via Diffusion Inversioncited by 86
  3. 2024Diffusion Models in Low-Level Vision: A Surveycited by 74
  4. 2024Degradation-Guided One-Step Image Super-Resolution with Diffusion Priorscited by 69
  5. 2024Efficient Diffusion Model for Image Restoration by Residual Shiftingcited by 64
  6. 2024Towards Realistic Data Generation for Real-World Super-Resolutioncited by 56
  7. 2025DiT4SR: Taming Diffusion Transformer for Real-World Image Super-Resolutioncited by 53
  8. 2024RestoreAgent: Autonomous Image Restoration Agent via Multimodal Large Language Modelscited by 43
  9. 2025POSTA: A Go-to Framework for Customized Artistic Poster Generationcited by 36
  10. 2025JarvisIR: Elevating Autonomous Driving Perception with Intelligent Image Restorationcited by 34
  11. 2024Unveiling Hidden Details: A RAW Data-Enhanced Paradigm for Real-World Super-Resolutioncited by 26
  12. 2023SPIRE: Semantic Prompt-Driven Image Restorationcited by 24
38 more
  1. 2024Teaching Tailored to Talent: Adverse Weather Restoration via Prompt Pool and Depth-Anything Constraintcited by 24
  2. 2024ResMaster: Mastering High-Resolution Image Generation via Structural and Fine-Grained Guidancecited by 22
  3. 2024Low-Res Leads the Way: Improving Generalization for Super-Resolution by Self-Supervised Learningcited by 19
  4. 2024Photo-Realistic Image Restoration in the Wild with Controlled Vision-Language Modelscited by 19
  5. 2024Beyond Pixels: Text Enhances Generalization in Real-World Image Restorationcited by 17
  6. 2025Hybrid Agents for Image Restorationcited by 17
  7. 2024DiffRetouch: Using Diffusion to Retouch on the Shoulder of Expertscited by 14
  8. 2024Taming Diffusion Prior for Image Super-Resolution with Domain Shift SDEscited by 13
  9. 2024DaLPSR: Leverage Degradation-Aligned Language Prompt for Real-World Image Super-Resolutioncited by 9
  10. 2024UCIP: A Universal Framework for Compressed Image Super-Resolution using Dynamic Promptcited by 8
  11. 2025Acquire and then Adapt: Squeezing out Text-to-Image Model for Image Restorationcited by 8
  12. 2025Exploiting Diffusion Prior for Task-driven Image Restorationcited by 8
  13. 2025PocketSR: The Super-Resolution Expert in Your Pocket Mobilescited by 8
  14. 2024Low-dose CT Denoising with Language-engaged Dual-space Alignmentcited by 7
  15. 2024CasSR: Activating Image Power for Real-World Image Super-Resolutioncited by 7
  16. 2026Fast Image Super-Resolution via Consistency Rectified Flowcited by 7
  17. 2024HazeCLIP: Towards Language Guided Real-World Image Dehazingcited by 6
  18. 2025DragNeXt: Rethinking Drag-Based Image Editingcited by 6
  19. 2024TASR: Timestep-Aware Diffusion Model for Image Super-Resolutioncited by 4
  20. 2024RAP-SR: RestorAtion Prior Enhancement in Diffusion Models for Realistic Image Super-Resolutioncited by 4
  21. 2024SeeClear: Semantic Distillation Enhances Pixel Condensation for Video Super-Resolutioncited by 3
  22. 2024InstantIR: Blind Image Restoration with Instant Generative Referencecited by 3
  23. 2024ControlSR: Taming Diffusion Models for Consistent Real-World Image Super Resolutioncited by 3
  24. 2024CLIP-SR: Collaborative Linguistic and Image Processing for Super-Resolutioncited by 3
  25. 2025SeG-SR: Integrating Semantic Knowledge into Remote Sensing Image Super-Resolution via Vision-Language Modelcited by 3
  26. 2025LangMamba: A Language-driven Mamba Framework for Low-dose CT Denoising with Vision-language Modelscited by 3
  27. 2025SRSR: Enhancing Semantic Accuracy in Real-World Image Super-Resolution with Spatially Re-Focused Text-Conditioningcited by 3
  28. 2025SRSplat: Feed-Forward Super-Resolution Gaussian Splatting from Sparse Multi-View Imagescited by 3
  29. 2025FinPercep-RM: A Fine-grained Reward Model and Co-evolutionary Curriculum for RL-based Real-world Super-Resolutioncited by 3
  30. 2024Suppressing Uncertainties in Degradation Estimation for Blind Super-Resolutioncited by 2
  31. 2025Spatial Degradation-Aware and Temporal Consistent Diffusion Model for Compressed Video Super-Resolutioncited by 2
  32. 2025Anatomy-Aware Low-Dose CT Denoising via Pretrained Vision Models and Semantic-Guided Contrastive Learningcited by 2
  33. 2025RDDM: Practicing RAW Domain Diffusion Model for Real-world Image Restorationcited by 2
  34. 2025Enhancing Diffusion-based Restoration Models via Difficulty-Adaptive Reinforcement Learning with IQA Rewardcited by 2
  35. 2024DeeDSR: Towards Real-World Image Super-Resolution via Degradation-Aware Stable Diffusioncited by 1
  36. 2025DA2Diff: Exploring Degradation-aware Adaptive Diffusion Priors for All-in-One Weather Restorationcited by 1
  37. 2025Ultra-High-Definition Reference-Based Landmark Image Super-Resolution with Generative Diffusion Priorcited by 1
  38. 2025OmniScaleSR: Unleashing Scale-Controlled Diffusion Prior for Faithful and Realistic Arbitrary-Scale Image Super-Resolutioncited by 1

50 most cited of 66 All 66 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025Local-Global Context-Aware and Structure-Preserving Image Super-Resolution
  2. 2026Disentangled Textual Priors for Diffusion-based Image Super-Resolution
  3. 2026Preserve More Details: Mitigating Content Drift in Real-World Image Super-Resolution
  4. 2024Hero-SR: One-Step Diffusion for Super-Resolution with Human Perception Priors
  5. 2026Revisiting the Perception-Distortion Trade-off with Spatial-Semantic Guided Super-Resolution
  6. 2023SeeSR: Towards Semantics-Aware Real-World Image Super-Resolution
  7. 2025The Power of Context: How Multimodality Improves Image Super-Resolution
  8. 2026GramSR: Visual Feature Conditioning for Diffusion-Based Super-Resolution