mlsanityData to 7 Oct 2026

InstructIR: High-Quality Image Restoration Following Human Instructions

arXiv 2401.16468 ↗First posted 29 Jan 2024cs.CV cs.LG eess.IVcited by 139

Not on the map. Why?

Abstract (arXiv)

Image restoration is a fundamental problem that involves recovering a high-quality clean image from its degraded observation. All-In-One image restoration models can effectively restore images from various types and levels of degradation using degradation-specific information as prompts to guide the restoration model. In this work, we present the first approach that uses human-written instructions to guide the image restoration model. Given natural language prompts, our model can recover high-quality images from their degraded counterparts, considering multiple degradation types. Our method, InstructIR, achieves state-of-the-art results on several restoration tasks including image denoising, deraining, deblurring, dehazing, and (low-light) image enhancement. InstructIR improves +1dB over previous all-in-one restoration methods. Moreover, our dataset and results represent a novel benchmark for new research on text-guided image restoration and enhancement. Our code, datasets and models are available at: https://github.com/mv-lab/InstructIR

Key facts. Cited by 139 papers in the map (data through 7 Oct 2026). Builds on 68 of its 109 references that are in the map. First posted on arXiv 29 Jan 2024.

Builds on

68 of 109 references.

References · 68

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  4. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  5. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  6. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  7. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  8. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  9. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  10. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  11. 2017Non-local Neural Networkscited by 2,290
  12. 2019Searching for MobileNetV3cited by 1,984
38 more
  1. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  2. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
  3. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
  4. 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,352
  5. 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,250
  6. 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,218
  7. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,172
  8. 2020Pre-Trained Image Processing Transformercited by 891
  9. 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 864
  10. 2021Multi-Stage Progressive Image Restorationcited by 813
  11. 2016Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurringcited by 722
  12. 2018Deep Retinex Decomposition for Low-Light Enhancementcited by 720
  13. 2022Simple Baselines for Image Restorationcited by 701
  14. 2021Designing a Practical Degradation Model for Deep Blind Image Super-Resolutioncited by 524
  15. 2021MetaFormer Is Actually What You Need for Visioncited by 523
  16. 2017FFDNet: Toward a Fast and Flexible Solution for CNN based Image Denoisingcited by 509
  17. 2019EnlightenGAN: Deep Light Enhancement without Paired Supervisioncited by 466
  18. 2017Benchmarking Single Image Dehazing and Beyondcited by 445
  19. 2017Learning Deep CNN Denoiser Prior for Image Restorationcited by 407
  20. 2017DeblurGAN: Blind Motion Deblurring Using Conditional Adversarial Networkscited by 366
  21. 2019DeblurGAN-v2: Deblurring (Orders-of-Magnitude) Faster and Bettercited by 361
  22. 2019Kindling the Darkness: A Practical Low-light Image Enhancercited by 355
  23. 2020Learning Texture Transformer Network for Image Super-Resolutioncited by 346
  24. 2016DehazeNet: An End-to-End System for Single Image Haze Removalcited by 313
  25. 2020Learning Enriched Features for Real Image Restoration and Enhancementcited by 311
  26. 2020Retinex-inspired Unrolling with Cooperative Prior Architecture Search for Low-light Image Enhancementcited by 303
  27. 2022MAXIM: Multi-Axis MLP for Image Processingcited by 301
  28. 2021TransWeather: Transformer-based Restoration of Images Degraded by Adverse Weather Conditionscited by 243
  29. 2021HINet: Half Instance Normalization Network for Image Restorationcited by 236
  30. 2020Multi-Scale Boosted Dehazing Network with Dense Feature Fusioncited by 229
  31. 2017Deep Bilateral Learning for Real-Time Image Enhancementcited by 200
  32. 2020Deblurring by Realistic Blurringcited by 187
  33. 2020Learning Image-adaptive 3D Lookup Tables for High Performance Photo Enhancement in Real-timecited by 163
  34. 2018Gated Fusion Network for Single Image Dehazingcited by 133
  35. 2017Routing Networks: Adaptive Selection of Non-linear Functions for Multi-Task Learningcited by 125
  36. 2022Deep Generalized Unfolding Networks for Image Restorationcited by 119
  37. 2023PromptIR: Prompting for All-in-One Blind Image Restorationcited by 113
  38. 2020DeepLPF: Deep Local Parametric Filters for Image Enhancementcited by 107

50 most cited of 68 All 68 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 29; 2025: 51; 2026: 59.

139 papers.

Sort:

By area:

  1. 2024AdaIR: Adaptive All-in-One Image Restoration via Frequency Mining and Modulationcited by 108
  2. 2024Complexity Experts are Task-Discriminative Learners for Any Image Restorationcited by 72
  3. 2024Perceive-IR: Learning to Perceive Degradation Better for All-in-One Image Restorationcited by 60
  4. 2024A Survey on All-in-One Image Restoration: Taxonomy, Evaluation and Future Trendscited by 58
  5. 2024DarkIR: Robust Low-Light Image Restorationcited by 48
  6. 2024RestoreAgent: Autonomous Image Restoration Agent via Multimodal Large Language Modelscited by 41
  7. 2024An Intelligent Agentic System for Complex Image Restoration Problemscited by 41
  8. 2025Degradation-Aware Feature Perturbation for All-in-One Image Restorationcited by 39
  9. 2024FoundIR: Unleashing Million-scale Training Data to Advance Foundation Models for Image Restorationcited by 37
  10. 2025Vision-Language Gradient Descent-driven All-in-One Deep Unfolding Networkscited by 37
  11. 2025JarvisIR: Elevating Autonomous Driving Perception with Intelligent Image Restorationcited by 32
  12. 2024PixWizard: Versatile Image-to-Image Visual Assistant with Open-Language Instructionscited by 31
38 more
  1. 2024R-Bench: Are your Large Multimodal Model Robust to Real-world Corruptions?cited by 29
  2. 2024NTIRE 2024 Challenge on Low Light Image Enhancement: Methods and Resultscited by 26
  3. 2025Visual-Instructed Degradation Diffusion for All-in-One Image Restorationcited by 26
  4. 2024UniProcessor: A Text-induced Unified Low-level Image Processorcited by 22
  5. 2025Multi-Agent Image Restorationcited by 19
  6. 2024Multi-Expert Adaptive Selection: Task-Balancing for All-in-One Image Restorationcited by 18
  7. 2024IPAdapter-Instruct: Resolving Ambiguity in Image-based Conditioning using Instruct Promptscited by 18
  8. 2024LoRA-IR: Taming Low-Rank Experts for Efficient All-in-One Image Restorationcited by 18
  9. 2024Diff-Restorer: Unleashing Visual Prompts for Diffusion-based Universal Image Restorationcited by 15
  10. 2025RestoreVAR: Visual Autoregressive Generation for All-in-One Image Restorationcited by 15
  11. 2025Hybrid Agents for Image Restorationcited by 14
  12. 2026Learning Continuous Wasserstein Barycenter Space for Generalized All-in-One Image Restorationcited by 14
  13. 2024GenDeg: Diffusion-based Degradation Synthesis for Generalizable All-In-One Image Restorationcited by 13
  14. 2024HAIR: Hypernetworks-based All-in-One Image Restorationcited by 12
  15. 2024UniRestorer: Universal Image Restoration via Adaptively Estimating Image Degradation at Proper Granularitycited by 12
  16. 2024Instruct-IPT: All-in-One Image Processing Transformer via Weight Modulationcited by 9
  17. 2025FoundIR-v2: Optimizing Pre-Training Data Mixtures for Image Restoration Foundation Modelcited by 9
  18. 2025ControlFusion: A Controllable Image Fusion Framework with Language-Vision Degradation Promptscited by 8
  19. 2025Gradient as Conditions: Rethinking HOG for All-in-one Image Restorationcited by 8
  20. 2025Efficient Degradation-agnostic Image Restoration via Channel-Wise Functional Decomposition and Manifold Regularizationcited by 8
  21. 2025Self-Supervised Selective-Guided Diffusion Model for Old-Photo Face Restorationcited by 8
  22. 2024NamedCurves: Learned Image Enhancement via Color Namingcited by 7
  23. 2025DSwinIR: Rethinking Window-based Attention for Image Restorationcited by 7
  24. 2025EvoIR: Towards All-in-One Image Restoration via Evolutionary Frequency Modulationcited by 7
  25. 2024PromptHSI: Universal Hyperspectral Image Restoration with Vision-Language Modulated Frequency Adaptationcited by 6
  26. 2025MP-HSIR: A Multi-Prompt Framework for Universal Hyperspectral Image Restorationcited by 6
  27. 2025Beyond Degradation Redundancy: Contrastive Prompt Learning for All-in-One Image Restorationcited by 6
  28. 2026Learning Domain-Aware Task Prompt Representations for Multi-Domain All-in-One Image Restorationcited by 6
  29. 2024Learning Efficient and Effective Trajectories for Differential Equation-based Image Restorationcited by 5
  30. 2025Enhancing Image Restoration Transformer via Adaptive Translation Equivariancecited by 5
  31. 2025UARE: A Unified Vision-Language Model for Image Quality Assessment, Restoration, and Enhancementcited by 5
  32. 2024Chain-of-Restoration: Multi-Task Image Restoration Models are Zero-Shot Step-by-Step Universal Image Restorerscited by 4
  33. 2024Olympus: A Universal Task Router for Computer Vision Taskscited by 4
  34. 2025Prompt to Restore, Restore to Prompt: Cyclic Prompting for Universal Adverse Weather Removalcited by 4
  35. 2025Learning Where and What to Restore for Composite Image Restorationcited by 4
  36. 2025Devil is in the Uniformity: Exploring Diverse Learners within Transformer for Image Restorationcited by 4
  37. 2025Universal Image Restoration Pre-training via Masked Degradation Classificationcited by 4
  38. 2025ClusIR: Towards Cluster-Guided All-in-One Image Restorationcited by 4

50 most cited of 139 All 139 (JSON)