mlsanityData to 14 Oct 2026

Multi-Step Guided Diffusion for Image Restoration on Edge Devices: Toward Lightweight Perception in Embodied AI

arXiv 2506.07286 ↗First posted 8 Jun 2025cs.CV cs.LG cs.ROcited by 0

On the map: Diffusion models → Inverse problems and image restoration

Abstract (arXiv)

Diffusion models have shown remarkable flexibility for solving inverse problems without task-specific retraining. However, existing approaches such as Manifold Preserving Guided Diffusion (MPGD) apply only a single gradient update per denoising step, limiting restoration fidelity and robustness, especially in embedded or out-of-distribution settings. In this work, we introduce a multistep optimization strategy within each denoising timestep, significantly enhancing image quality, perceptual accuracy, and generalization. Our experiments on super-resolution and Gaussian deblurring demonstrate that increasing the number of gradient updates per step improves LPIPS and PSNR with minimal latency overhead. Notably, we validate this approach on a Jetson Orin Nano using degraded ImageNet and a UAV dataset, showing that MPGD, originally trained on face datasets, generalizes effectively to natural and aerial scenes. Our findings highlight MPGD's potential as a lightweight, plug-and-play restoration module for real-time visual perception in embodied AI agents such as drones and mobile robots.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 11 of its 18 references that are in the map. First posted on arXiv 8 Jun 2025.

Builds on

11 of 18 references.

Closest ancestors · 2

Same direction, newest first

  1. 2022Zero-Shot Image Restoration Using Denoising Diffusion Null-Space Model1 Dec
  2. 2022Diffusion Posterior Sampling for General Noisy Inverse Problems29 Sep

Other references · 9

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  2. 2020Denoising Diffusion Implicit Modelscited by 9,781
  3. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
  4. 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 866
  5. 2022Simple Baselines for Image Restorationcited by 708
  6. 2021Designing an Encoder for StyleGAN Image Manipulationcited by 544
  7. 2023FreeDoM: Training-Free Energy-Guided Conditional Diffusion Modelcited by 294
  8. 2023Manifold Preserving Guided Diffusioncited by 157
  9. 2023Towards Accurate Guided Diffusion Sampling through Symplectic Adjoint Methodcited by 8

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Solving General Noisy Inverse Problem via Posterior Sampling: A Policy Gradient Viewpoint
  2. 2023Refusion: Enabling Large-Size Realistic Image Restoration with Latent-Space Diffusion Models
  3. 2026TEASR: Training-Efficient Any-Step Diffusion Transformer for Real-World Image Super-Resolution
  4. 2026Degradation-Aware and Structure-Preserving Diffusion for Real-World Image Super-Resolution
  5. 2023Selective Guidance: Are All the Denoising Steps of Guided Diffusion Important?
  6. 2025One-Step Diffusion Model for Image Motion-Deblurring
  7. 2026D2-VR: Degradation-Robust and Distilled Video Restoration with Synergistic Optimization Strategy
  8. 2026Bridging Restoration and Generation in One-step Diffusion for Real-World Image Super-Resolution