mlsanityData to 14 Oct 2026

AutoDIR: Automatic All-in-One Image Restoration with Latent Diffusion

arXiv 2310.10123 ↗First posted 16 Oct 2023cs.CVcited by 100

On the map: Diffusion models → Inverse problems and image restoration

Abstract (arXiv)

We present AutoDIR, an innovative all-in-one image restoration system incorporating latent diffusion. AutoDIR excels in its ability to automatically identify and restore images suffering from a range of unknown degradations. AutoDIR offers intuitive open-vocabulary image editing, empowering users to customize and enhance images according to their preferences. Specifically, AutoDIR consists of two key stages: a Blind Image Quality Assessment (BIQA) stage based on a semantic-agnostic vision-language model which automatically detects unknown image degradations for input images, an All-in-One Image Restoration (AIR) stage utilizes structural-corrected latent diffusion which handles multiple types of image degradations. Extensive experimental evaluation demonstrates that AutoDIR outperforms state-of-the-art approaches for a wider range of image restoration tasks. The design of AutoDIR also enables flexible user control (via text prompt) and generalization to new tasks as a foundation model of image restoration. Project is available at: urlhttps://jiangyitong.github.io/AutoDIRwebpage/.

Key facts. Cited by 100 papers in the map (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 86 of its 111 references that are in the map. First posted on arXiv 16 Oct 2023.

Builds on

86 of 111 references.

Closest ancestors · 9

Same direction, newest first

  1. 2023Denoising Diffusion Models for Plug-and-Play Image Restoration15 May
  2. 2023Exploiting Diffusion Prior for Real-World Image Super-Resolution11 May
  3. 2023Generative Diffusion Prior for Unified Image Restoration and Enhancement3 Apr
  4. 2023Implicit Diffusion Models for Continuous Super-Resolution29 Mar
  5. 2022ADIR: Adaptive Diffusion for Image Reconstruction6 Dec
  6. 2022Zero-Shot Image Restoration Using Denoising Diffusion Null-Space Model1 Dec
  7. 2022Restoring Vision in Adverse Weather Conditions with Patch-Based Denoising Diffusion Models29 Jul
  8. 2022Denoising Diffusion Restoration Models27 Jan
  9. 2021Deblurring via Stochastic Refinement5 Dec

Other references · 77

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  5. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  6. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  7. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  8. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  9. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  10. 2017Neural Discrete Representation Learningcited by 4,712
  11. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
  12. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
38 more
  1. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  2. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  3. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  4. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,887
  5. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,627
  6. 2019LXMERT: Learning Cross-Modality Encoder Representations from Transformerscited by 1,553
  7. 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,552
  8. 2021Image Super-Resolution via Iterative Refinementcited by 1,511
  9. 2021Palette: Image-to-Image Diffusion Modelscited by 1,300
  10. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,178
  11. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
  12. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
  13. 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 970
  14. 2020Pre-Trained Image Processing Transformercited by 893
  15. 2022OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Frameworkcited by 745
  16. 2016Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurringcited by 727
  17. 2018Deep Retinex Decomposition for Low-Light Enhancementcited by 723
  18. 2022Simple Baselines for Image Restorationcited by 708
  19. 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 702
  20. 2017AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networkscited by 664
  21. 2021FLAVA: A Foundational Language And Vision Alignment Modelcited by 649
  22. 2020NVAE: A Deep Hierarchical Variational Autoencodercited by 637
  23. 2017The Perception-Distortion Tradeoffcited by 587
  24. 2017Benchmarking Single Image Dehazing and Beyondcited by 447
  25. 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 395
  26. 2017NIMA: Neural Image Assessmentcited by 389
  27. 2020PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Modelscited by 358
  28. 2016Deep Joint Rain Detection and Removal from a Single Imagecited by 352
  29. 2019DM-GAN: Dynamic Memory Generative Adversarial Networks for Text-to-Image Synthesiscited by 308
  30. 2019FFA-Net: Feature Fusion Attention Network for Single Image Dehazingcited by 307
  31. 2019Blind Image Quality Assessment Using A Deep Bilinear Convolutional Neural Networkcited by 302
  32. 2019Progressive Image Deraining Networks: A Better and Simpler Baselinecited by 272
  33. 2020Multi-Scale Progressive Fusion Network for Single Image Derainingcited by 260
  34. 2022Vision Transformers for Single Image Dehazingcited by 260
  35. 2021Cross-Modal Contrastive Learning for Text-to-Image Generationcited by 259
  36. 2021TransWeather: Transformer-based Restoration of Images Degraded by Adverse Weather Conditionscited by 244
  37. 2022Towards Robust Blind Face Restoration with Codebook Lookup Transformercited by 231
  38. 2023TextDiffuser: Diffusion Models as Text Painterscited by 229

50 most cited of 77 All 77 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 4; 2024: 23; 2025: 34; 2026: 39.

100 papers.

Sort:

By area:

  1. 2024AdaIR: Adaptive All-in-One Image Restoration via Frequency Mining and Modulationcited by 111
  2. 2024Complexity Experts are Task-Discriminative Learners for Any Image Restorationcited by 77
  3. 2024Diffusion Models in Low-Level Vision: A Surveycited by 74
  4. 2024A Survey on All-in-One Image Restoration: Taxonomy, Evaluation and Future Trendscited by 60
  5. 2024RestoreAgent: Autonomous Image Restoration Agent via Multimodal Large Language Modelscited by 43
  6. 2024An Intelligent Agentic System for Complex Image Restoration Problemscited by 43
  7. 2024FoundIR: Unleashing Million-scale Training Data to Advance Foundation Models for Image Restorationcited by 39
  8. 2025JarvisIR: Elevating Autonomous Driving Perception with Intelligent Image Restorationcited by 34
  9. 2023LEGO: Learning EGOcentric Action Frame Generation via Visual Instruction Tuningcited by 28
  10. 2025Visual-Instructed Degradation Diffusion for All-in-One Image Restorationcited by 26
  11. 2023SPIRE: Semantic Prompt-Driven Image Restorationcited by 24
  12. 2025Multi-Agent Image Restorationcited by 21
38 more
  1. 2024Multi-Expert Adaptive Selection: Task-Balancing for All-in-One Image Restorationcited by 18
  2. 2023Test-Time Degradation Adaptation for Open-Set Image Restorationcited by 17
  3. 2024Diff-Restorer: Unleashing Visual Prompts for Diffusion-based Universal Image Restorationcited by 15
  4. 2024MoE-DiffIR: Task-customized Diffusion Priors for Universal Compressed Image Restorationcited by 15
  5. 2025RestoreVAR: Visual Autoregressive Generation for All-in-One Image Restorationcited by 15
  6. 2025Residual Diffusion Bridge Model for Image Restorationcited by 15
  7. 2024DiffRetouch: Using Diffusion to Retouch on the Shoulder of Expertscited by 14
  8. 2025Lumina-OmniLV: A Unified Multimodal Framework for General Low-Level Visioncited by 14
  9. 2024GenDeg: Diffusion-based Degradation Synthesis for Generalizable All-In-One Image Restorationcited by 13
  10. 2025Compression-Aware One-Step Diffusion Model for JPEG Artifact Removalcited by 13
  11. 2024HAIR: Hypernetworks-based All-in-One Image Restorationcited by 12
  12. 2024Efficient Degradation-aware Any Image Restorationcited by 11
  13. 2024Towards Real-World Adverse Weather Image Restoration: Enhancing Clearness and Semantics with Vision-Language Modelscited by 10
  14. 2025Theoretical Guarantees for High Order Trajectory Refinement in Generative Flowscited by 10
  15. 2025Gradient as Conditions: Rethinking HOG for All-in-one Image Restorationcited by 10
  16. 2025ControlFusion: A Controllable Image Fusion Framework with Language-Vision Degradation Promptscited by 9
  17. 2025FoundIR-v2: Optimizing Pre-Training Data Mixtures for Image Restoration Foundation Modelcited by 9
  18. 2025M2Restore: Mixture-of-Experts-based Mamba-CNN Fusion Framework for All-in-One Image Restorationcited by 7
  19. 2025UniCoRN: Latent Diffusion-based Unified Controllable Image Restoration Network across Multiple Degradationscited by 6
  20. 2025Restore-R1: Efficient Image Restoration Agents via Reinforcement Learning with Multimodal LLM Perceptual Feedbackcited by 6
  21. 2024Learning Efficient and Effective Trajectories for Differential Equation-based Image Restorationcited by 5
  22. 2025DGSolver: Diffusion Generalist Solver with Universal Posterior Sampling for Image Restorationcited by 5
  23. 2025UniRes: Universal Image Restoration for Complex Degradationscited by 5
  24. 2025UniSER: A Foundation Model for Unified Soft Effects Removalcited by 5
  25. 2025UARE: A Unified Vision-Language Model for Image Quality Assessment, Restoration, and Enhancementcited by 5
  26. 2026TIR-Agent: Training an Explorative and Efficient Agent for Image Restorationcited by 5
  27. 2024Efficient Diffusion-Driven Corruption Editor for Test-Time Adaptationcited by 4
  28. 2025UniLDiff: Unlocking the Power of Diffusion Priors for All-in-One Image Restorationcited by 4
  29. 2025Vision-Language Model Guided Image Restorationcited by 4
  30. 2026Edit2Restore:Few-Shot Image Restoration via Parameter-Efficient Adaptation of Pre-trained Editing Modelscited by 4
  31. 2026TPGDiff: Hierarchical Triple-Prior Guided Diffusion for Image Restorationcited by 4
  32. 2026OPERA: An Agent for Image Restoration with End-to-End Joint Planning-Execution Optimizationcited by 4
  33. 2026Self-Evolving Agentic Image Restoration via Deliberate Planning and Intuitive Executioncited by 4
  34. 2024Adaptive Blind All-in-One Image Restorationcited by 3
  35. 2025Elucidating and Endowing the Diffusion Training Paradigm for General Image Restorationcited by 3
  36. 2025Enhancing Infrared Vision: Progressive Prompt Fusion Network and Benchmarkcited by 3
  37. 2026V-Bridge: Bridging Video Generative Priors to Versatile Few-shot Image Restorationcited by 3
  38. 2026Restore, Assess, Repeat: A Unified Framework for Iterative Image Restorationcited by 3

50 most cited of 100 All 100 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025AdaQual-Diff: Diffusion-Based Image Restoration via Adaptive Quality Prompting
  2. 2025BIR-Adapter: A parameter-efficient diffusion adapter for blind image restoration
  3. 2024Chain-of-Restoration: Multi-Task Image Restoration Models are Zero-Shot Step-by-Step Universal Image Restorers
  4. 2024CasSR: Activating Image Power for Real-World Image Super-Resolution
  5. 2025ClusIR: Towards Cluster-Guided All-in-One Image Restoration
  6. 2025Text-Aware Image Restoration with Diffusion Models
  7. 2023Diffusion Models for Image Restoration and Enhancement: A Comprehensive Survey
  8. 2025Restoring Real-World Images with an Internal Detail Enhancement Diffusion Model