mlsanityData to 14 Oct 2026

MagnifiQ: Patch-aware Text Guided Progressive Upscaling for High-Resolution Image Restoration

arXiv 2608.14543 ↗First posted 14 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

High-resolution image restoration from degraded inputs is challenging because it must preserve global structural consistency while recovering fine-grained local details, especially at 4K resolution where direct diffusion-based restoration is computationally expensive and prone to repeated or inconsistent textures. In this work, we introduce MagnifiQ, an image restoration framework that progressively upscales and restores images across resolutions, e.g., from 1024x1024 to 4096x4096. Our approach leverages a pre-trained text-to-image diffusion model such as SDXL and adapts it for more scalable high-resolution inference by replacing its original self-attention layers with convolutional operations whose computational cost grows linearly with image resolution. We further propose a progressive upscaling strategy that iteratively restores images over multiple resolution stages, refining each intermediate output rather than directly hallucinating the final 4K image, thereby improving global coherence and reducing high-resolution artifacts. To enhance local details while controlling content drift, MagnifiQ uses patch-specific text prompts that provide spatially localized semantic guidance during restoration. Extensive experiments on synthetic and real-world degraded images show that MagnifiQ outperforms prior diffusion-based restoration methods in perceptual quality and human preference, producing sharper textures and more coherent 4K results while offering practical speed--quality trade-offs through its scalable backbone and progressive design.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 39 of its 45 references that are in the map. First posted on arXiv 14 Aug 2026.

Builds on

39 of 45 references.

References · 39

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  4. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  5. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  6. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  7. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  8. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  9. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  10. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  11. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,887
  12. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
27 more
  1. 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 970
  2. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
  3. 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 536
  4. 2021Designing a Practical Degradation Model for Deep Blind Image Super-Resolutioncited by 529
  5. 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 522
  6. 2023Exploiting Diffusion Prior for Real-World Image Super-Resolutioncited by 489
  7. 2017Learning Deep CNN Denoiser Prior for Image Restorationcited by 408
  8. 2019Toward Real-World Single Image Super-Resolution: A New Benchmark and A New Modelcited by 403
  9. 2023Hyena Hierarchy: Towards Larger Convolutional Language Modelscited by 393
  10. 2023SeeSR: Towards Semantics-Aware Real-World Image Super-Resolutioncited by 315
  11. 2024Scaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the Wildcited by 286
  12. 2023Pixel-Aware Stable Diffusion for Realistic Image Super-resolution and Personalized Stylizationcited by 254
  13. 2019Residual Non-local Attention Networks for Image Restorationcited by 236
  14. 2020PIPAL: a Large-Scale Image Quality Assessment Dataset for Perceptual Image Restorationcited by 178
  15. 2018The 2018 PIRM Challenge on Perceptual Image Super-resolutioncited by 156
  16. 2023DemoFusion: Democratising High-Resolution Image Generation With No cited by 107
  17. 2022Accurate Image Restoration with Attention Retractable Transformercited by 85
  18. 2023Mixture of Diffusers for scene composition and high resolution image generationcited by 56
  19. 20254KAgent: Agentic Any Image to 4K Super-Resolutioncited by 36
  20. 2022SimA: Simple Softmax-free Attention for Vision Transformerscited by 32
  21. 2024FaithDiff: Unleashing Diffusion Priors for Faithful Image Super-resolutioncited by 32
  22. 2024FreeScale: Unleashing the Resolution of Diffusion Models via Tuning-Free Scale Fusioncited by 30
  23. 2023SPIRE: Semantic Prompt-Driven Image Restorationcited by 24
  24. 2020Neural Sparse Representation for Image Restorationcited by 22
  25. 2025The Power of Context: How Multimodality Improves Image Super-Resolutioncited by 15
  26. 2025Vivid-VR: Distilling Concepts from Text-to-Video Diffusion Transformer for Photorealistic Video Restorationcited by 10
  27. 2024PADRe: A Unifying Polynomial Attention Drop-in Replacement for Efficient Vision Transformercited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Text-Aware Image Restoration with Diffusion Models
  2. 2025Boosting Diffusion-Based Text Image Super-Resolution Model Towards Generalized Real-World Scenarios
  3. 2024DaLPSR: Leverage Degradation-Aligned Language Prompt for Real-World Image Super-Resolution
  4. 2025Local-Global Context-Aware and Structure-Preserving Image Super-Resolution
  5. 2025Creatively Upscaling Images with Global-Regional Priors
  6. 2024RAP-SR: RestorAtion Prior Enhancement in Diffusion Models for Realistic Image Super-Resolution
  7. 2026Efficient One-Step Diffusion Restoration Model with Compact Token Compression and Linear Attention
  8. 2023TextDiff: Mask-Guided Residual Diffusion Models for Scene Text Image Super-Resolution