Deep Stacked Hierarchical Multi-patch Network for Image Deblurring
Not on the map. Why?
Abstract (arXiv)
Despite deep end-to-end learning methods have shown their superiority in removing non-uniform motion blur, there still exist major challenges with the current multi-scale and scale-recurrent models: 1) Deconvolution/upsampling operations in the coarse-to-fine scheme result in expensive runtime; 2) Simply increasing the model depth with finer-scale levels cannot improve the quality of deblurring. To tackle the above problems, we present a deep hierarchical multi-patch network inspired by Spatial Pyramid Matching to deal with blurry images via a fine-to-coarse hierarchical representation. To deal with the performance saturation w.r.t. depth, we propose a stacked version of our multi-patch model. Our proposed basic multi-patch model achieves the state-of-the-art performance on the GoPro dataset while enjoying a 40x faster runtime compared to current multi-scale methods. With 30ms to process an image at 1280x720 resolution, it is the first real-time deep motion deblurring model for 720p images at 30fps. For stacked networks, significant improvements (over 1.2dB) are achieved on the GoPro dataset by increasing the network depth. Moreover, by varying the depth of the stacked model, one can adapt the performance and runtime of the same network for different application scenarios.
Key facts. Cited by 205 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Apr 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 43; 2022: 56; 2023: 32; 2024: 47; 2025: 18; 2026: 9.
205 papers.
Sort:
By area:
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
- 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 864
- 2021Multi-Stage Progressive Image Restorationcited by 813
- 2021Rethinking Coarse-to-Fine Approach in Single Image Deblurringcited by 324
- 2022MAXIM: Multi-Axis MLP for Image Processingcited by 301
- 2021Ensemble deep learning: A reviewcited by 283
- 2023DiffIR: Efficient Diffusion Model for Image Restorationcited by 253
- 2021Deblurring via Stochastic Refinementcited by 248
- 2021HINet: Half Instance Normalization Network for Image Restorationcited by 236
- 2022VRT: A Video Restoration Transformercited by 219
- 2022Recurrent Video Restoration Transformer with Guided Deformable Attentioncited by 168
- 2022Efficient Frequency Domain-based Transformers for High-Quality Image Deblurringcited by 164
38 more
- 2023Inversion by Direct Iteration: An Alternative to Denoising Diffusion for Image Restorationcited by 164
- 2023Efficient and Explicit Modelling of Image Hierarchies for Image Restorationcited by 145
- 2022Stripformer: Strip Transformer for Fast Image Deblurringcited by 139
- 2022Deep Generalized Unfolding Networks for Image Restorationcited by 119
- 2021Event-Based Fusion for Motion Deblurring with Cross-modal Attentioncited by 112
- 2022LEDNet: Joint Low-light Enhancement and Deblurring in the Darkcited by 95
- 2022Deep Image Deblurring: A Surveycited by 94
- 2023Hierarchical Integration Diffusion Model for Realistic Image Deblurringcited by 87
- 2021Intriguing Findings of Frequency Selection for Image Deblurringcited by 80
- 2021Spatially-Adaptive Image Restoration using Distortion-Guided Networkscited by 77
- 2022Multiscale Structure Guided Diffusion for Image Deblurringcited by 76
- 2022DP-NeRF: Deblurred Neural Radiance Field with Physical Scene Priorscited by 70
- 2023Residual Denoising Diffusion Modelscited by 68
- 2024Deblurring 3D Gaussian Splattingcited by 66
- 2021Improving Image Restoration by Revisiting Global Information Aggregationcited by 60
- 2022Realistic Blur Synthesis for Learning Image Deblurringcited by 51
- 2021NTIRE 2021 Challenge on Image Deblurringcited by 49
- 2021BANet: Blur-aware Attention Networks for Dynamic Scene Deblurringcited by 44
- 2024MaIR: A Locality- and Continuity-Preserving Mamba for Image Restorationcited by 43
- 2022Learning Dual Memory Dictionaries for Blind Face Restorationcited by 40
- 2024Correlation Matching Transformation Transformers for UHD Image Restorationcited by 39
- 2021DWDN: Deep Wiener Deconvolution Network for Non-Blind Image Deblurringcited by 36
- 2023Improving Image Restoration through Removing Degradations in Textual Representationscited by 36
- 2025MB-TaylorFormer V2: Improved Multi-branch Linear Transformer Expanded by Taylor Formula for Image Restorationcited by 36
- 2022Learning Degradation Representations for Image Deblurringcited by 35
- 2022MSSNet: Multi-Scale-Stage Network for Single Image Deblurringcited by 31
- 2022Towards Efficient and Scale-Robust Ultra-High-Definition Image Demoireingcited by 30
- 2021MC-Blur: A Comprehensive Benchmark for Image Deblurringcited by 27
- 2024Efficient Visual State Space Model for Image Deblurringcited by 27
- 2021SDWNet: A Straight Dilated Network with Wavelet Transformation for Image Deblurringcited by 26
- 2021Deep Recurrent Neural Network with Multi-scale Bi-directional Propagation for Video Deblurringcited by 25
- 2021Event-guided Deblurring of Unknown Exposure Time Videoscited by 25
- 2024AdaRevD: Adaptive Patch Exiting Reversible Decoder Pushes the Limit of Image Deblurringcited by 25
- 2023DiffI2I: Efficient Diffusion Model for Image-to-Image Translationcited by 24
- 2023Efficient Multi-scale Network with Learnable Discrete Wavelet Transform for Blind Motion Deblurringcited by 24
- 2024CU-Mamba: Selective State Space Models with Channel Learning for Image Restorationcited by 24
- 2023Image Super-Resolution with Text Prompt Diffusioncited by 22
- 2024UniProcessor: A Text-induced Unified Low-level Image Processorcited by 22
50 most cited of 205 All 205 (JSON)
- 2026PickMoment: Continuous-Time Single-Image-to-Video via Learning Deblurring and Blur-to-Video1 Oct 2026
- 2026Ultra-High-Definition Restoration Transformers with Correlation Matching Transformation18 Aug 2026
- 2026Leveraging Phase Information to Boost Unrolled Network Learning for Image Deblurring30 Jun 2026
- 2026RCL-Mamba: A Dual-domain State Space Model for Measurement-oriented Image Restoration in Rotational Sparse-View Scanning Computed Laminography30 Jun 2026
- 2026Edge-Efficient Image Restoration: Transformer Distillation into State-Space Models4 May 2026
- 2026Neural Discrimination-Prompted Transformers for Efficient UHD Image Restoration and Enhancement1 Mar 2026
- 2026Subtle Motion Blur Detection and Segmentation from Static Image Artworks21 Feb 2026
- 2026Towards Efficient Image Deblurring for Edge Deployment16 Jan 2026
- 2026Motion Blur Robust Wheat Pest Damage Detection with Dynamic Fuzzy Feature Fusion6 Jan 2026
- 2025BlurDM: A Blur Diffusion Model for Image Deblurring3 Dec 2025
- 2025DeepRFTv2: Kernel-level Learning for Image Deblurring26 Nov 2025
- 2025Physics-Informed Image Restoration via Progressive PDE Integration9 Nov 2025
38 more
- 2025Blur2seq: Blind Deblurring and Camera Trajectory Estimation from a Single Camera Motion-blurred Image23 Oct 2025
- 2025EVDI++: Event-based Video Deblurring and Interpolation via Self-Supervised Learning10 Sep 2025
- 2025Learning to See Through Flare19 Aug 2025
- 2025Towards Unified Image Deblurring using a Mixture-of-Experts Decoder8 Aug 2025
- 2025Efficient Depth- and Spatially-Varying Image Simulation for Defocus Deblur1 Jul 2025
- 2025EAMamba: Efficient All-Around Vision State Space Model for Image Restoration27 Jun 2025
- 2025SloMoDeblur: A Large-Scale Smartphone Image Deblurring Dataset24 Jun 2025
- 2025Frequency-domain Learning with Kernel Prior for Blind Image Deblurring20 Apr 2025
- 2025Multiscale Tensor Summation Factorization as a New Neural Network Layer (MTS Layer) for Multidimensional Data Processing17 Apr 2025
- 2025BARD-GS: Blur-Aware Reconstruction of Dynamic Scenes via Gaussian Splatting20 Mar 2025
- 2025One-Step Diffusion Model for Image Motion-Deblurring9 Mar 2025
- 2025CDI: Blind Image Restoration Fidelity Evaluation based on Consistency with Degraded Image24 Jan 2025
- 2025Soft Knowledge Distillation with Multi-Dimensional Cross-Net Attention for Image Restoration Models Compression16 Jan 2025
- 2025Knowledge Distillation for Image Restoration : Simultaneous Learning from Degraded and Clean Images16 Jan 2025
- 2025MB-TaylorFormer V2: Improved Multi-branch Linear Transformer Expanded by Taylor Formula for Image Restoration8 Jan 2025
- 2024MaIR: A Locality- and Continuity-Preserving Mamba for Image Restoration28 Dec 2024
- 2024Towards Context-aware Convolutional Network for Image Restoration15 Dec 2024
- 2024XYScanNet: A State Space Model for Single Image Deblurring13 Dec 2024
- 2024Modeling Dual-Exposure Quad-Bayer Patterns for Joint Denoising and Deblurring10 Dec 2024
- 2024Joint multi-dimensional dynamic attention and transformer for general image restoration12 Nov 2024
- 2024Multi-scale Frequency Enhancement Network for Blind Image Deblurring11 Nov 2024
- 2024SEM-Net: Efficient Pixel Modelling for image inpainting with Spatially Enhanced SSM10 Nov 2024
- 2024EnsIR: An Ensemble Algorithm for Image Restoration via Gaussian Mixture Models30 Oct 2024
- 2024Reblurring-Guided Single Image Defocus Deblurring: A Learning Framework with Misaligned Training Pairs26 Sep 2024
- 2024DAP-LED: Learning Degradation-Aware Priors with CLIP for Joint Low-light Enhancement and Deblurring20 Sep 2024
- 2024F2former: When Fractional Fourier Meets Deep Wiener Deconvolution and Selective Frequency Transformer for Image Deblurring3 Sep 2024
- 2024VDPI: Video Deblurring with Pseudo-inverse Modeling1 Sep 2024
- 2024SMAFormer: Synergistic Multi-Attention Transformer for Medical Image Segmentation31 Aug 2024
- 2024Towards Real-world Event-guided Low-light Video Enhancement and Deblurring27 Aug 2024
- 2024UniProcessor: A Text-induced Unified Low-level Image Processor30 Jul 2024
- 2024Restoring Real-World Degraded Events Improves Deblurring Quality30 Jul 2024
- 2024Dilated Strip Attention Network for Image Restoration26 Jul 2024
- 2024LoFormer: Local Frequency Transformer for Image Deblurring24 Jul 2024
- 2024Domain-adaptive Video Deblurring via Test-time Blurring12 Jul 2024
- 2024Denoising as Adaptation: Noise-Space Domain Adaptation for Image Restoration26 Jun 2024
- 2024Restorer: Removing Multi-Degradation with All-Axis Attention and Prompt Guidance18 Jun 2024
- 2024AdaRevD: Adaptive Patch Exiting Reversible Decoder Pushes the Limit of Image Deblurring13 Jun 2024
- 2024AMSA-UNet: An Asymmetric Multiple Scales U-net Based on Self-attention for Deblurring13 Jun 2024
50 newest of 205 All 205 (JSON)
- 2023DiffIR: Efficient Diffusion Model for Image Restorationcited by 253
- 2021Deblurring via Stochastic Refinementcited by 248
- 2023Inversion by Direct Iteration: An Alternative to Denoising Diffusion for Image Restorationcited by 164
- 2023Hierarchical Integration Diffusion Model for Realistic Image Deblurringcited by 87
- 2022Multiscale Structure Guided Diffusion for Image Deblurringcited by 76
- 2023Residual Denoising Diffusion Modelscited by 68
- 2023DiffI2I: Efficient Diffusion Model for Image-to-Image Translationcited by 24
- 2024Denoising as Adaptation: Noise-Space Domain Adaptation for Image Restorationcited by 9
- 2025One-Step Diffusion Model for Image Motion-Deblurringcited by 9
- 2025BlurDM: A Blur Diffusion Model for Image Deblurringcited by 5
- 2023Learning A Coarse-to-Fine Diffusion Transformer for Image Restorationcited by 1
- 2025CDI: Blind Image Restoration Fidelity Evaluation based on Consistency with Degraded Imagecited by 0
- 2025BlurDM: A Blur Diffusion Model for Image Deblurring3 Dec 2025
- 2025One-Step Diffusion Model for Image Motion-Deblurring9 Mar 2025
- 2025CDI: Blind Image Restoration Fidelity Evaluation based on Consistency with Degraded Image24 Jan 2025
- 2024Denoising as Adaptation: Noise-Space Domain Adaptation for Image Restoration26 Jun 2024
- 2023DiffI2I: Efficient Diffusion Model for Image-to-Image Translation26 Aug 2023
- 2023Residual Denoising Diffusion Models25 Aug 2023
- 2023Learning A Coarse-to-Fine Diffusion Transformer for Image Restoration17 Aug 2023
- 2023Hierarchical Integration Diffusion Model for Realistic Image Deblurring22 May 2023
- 2023Inversion by Direct Iteration: An Alternative to Denoising Diffusion for Image Restoration20 Mar 2023
- 2023DiffIR: Efficient Diffusion Model for Image Restoration16 Mar 2023
- 2022Multiscale Structure Guided Diffusion for Image Deblurring4 Dec 2022
- 2021Deblurring via Stochastic Refinement5 Dec 2021
- 2024MaIR: A Locality- and Continuity-Preserving Mamba for Image Restorationcited by 43
- 2024CU-Mamba: Selective State Space Models with Channel Learning for Image Restorationcited by 24
- 2025EAMamba: Efficient All-Around Vision State Space Model for Image Restorationcited by 10
- 2024XYScanNet: A State Space Model for Single Image Deblurringcited by 4
- 2026RCL-Mamba: A Dual-domain State Space Model for Measurement-oriented Image Restoration in Rotational Sparse-View Scanning Computed Laminographycited by 0
- 2026RCL-Mamba: A Dual-domain State Space Model for Measurement-oriented Image Restoration in Rotational Sparse-View Scanning Computed Laminography30 Jun 2026
- 2025EAMamba: Efficient All-Around Vision State Space Model for Image Restoration27 Jun 2025
- 2024MaIR: A Locality- and Continuity-Preserving Mamba for Image Restoration28 Dec 2024
- 2024XYScanNet: A State Space Model for Single Image Deblurring13 Dec 2024
- 2024CU-Mamba: Selective State Space Models with Channel Learning for Image Restoration17 Apr 2024
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
- 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 864
- 2021Multi-Stage Progressive Image Restorationcited by 813
- 2021Rethinking Coarse-to-Fine Approach in Single Image Deblurringcited by 324
- 2022MAXIM: Multi-Axis MLP for Image Processingcited by 301
- 2021Ensemble deep learning: A reviewcited by 283
- 2021HINet: Half Instance Normalization Network for Image Restorationcited by 236
- 2022VRT: A Video Restoration Transformercited by 219
- 2022Recurrent Video Restoration Transformer with Guided Deformable Attentioncited by 168
- 2022Efficient Frequency Domain-based Transformers for High-Quality Image Deblurringcited by 164
- 2023Efficient and Explicit Modelling of Image Hierarchies for Image Restorationcited by 145
- 2022Stripformer: Strip Transformer for Fast Image Deblurringcited by 139
12 most cited of 187 All 187 (JSON)
- 2026PickMoment: Continuous-Time Single-Image-to-Video via Learning Deblurring and Blur-to-Video1 Oct 2026
- 2026Ultra-High-Definition Restoration Transformers with Correlation Matching Transformation18 Aug 2026
- 2026Leveraging Phase Information to Boost Unrolled Network Learning for Image Deblurring30 Jun 2026
- 2026Edge-Efficient Image Restoration: Transformer Distillation into State-Space Models4 May 2026
- 2026Neural Discrimination-Prompted Transformers for Efficient UHD Image Restoration and Enhancement1 Mar 2026
- 2026Subtle Motion Blur Detection and Segmentation from Static Image Artworks21 Feb 2026
- 2026Towards Efficient Image Deblurring for Edge Deployment16 Jan 2026
- 2026Motion Blur Robust Wheat Pest Damage Detection with Dynamic Fuzzy Feature Fusion6 Jan 2026
- 2025DeepRFTv2: Kernel-level Learning for Image Deblurring26 Nov 2025
- 2025Physics-Informed Image Restoration via Progressive PDE Integration9 Nov 2025
- 2025Blur2seq: Blind Deblurring and Camera Trajectory Estimation from a Single Camera Motion-blurred Image23 Oct 2025
- 2025EVDI++: Event-based Video Deblurring and Interpolation via Self-Supervised Learning10 Sep 2025
12 newest of 187 All 187 (JSON)