Exploring and Evaluating Image Restoration Potential in Dynamic Scenes
Not on the map. Why?
Abstract (arXiv)
In dynamic scenes, images often suffer from dynamic blur due to superposition of motions or low signal-noise ratio resulted from quick shutter speed when avoiding motions. Recovering sharp and clean results from the captured images heavily depends on the ability of restoration methods and the quality of the input. Although existing research on image restoration focuses on developing models for obtaining better restored results, fewer have studied to evaluate how and which input image leads to superior restored quality. In this paper, to better study an image's potential value that can be explored for restoration, we propose a novel concept, referring to image restoration potential (IRP). Specifically, We first establish a dynamic scene imaging dataset containing composite distortions and applied image restoration processes to validate the rationality of the existence to IRP. Based on this dataset, we investigate several properties of IRP and propose a novel deep model to accurately predict IRP values. By gradually distilling and selective fusing the degradation features, the proposed model shows its superiority in IRP prediction. Thanks to the proposed model, we are then able to validate how various image restoration related applications are benefited from IRP prediction. We show the potential usages of IRP as a filtering principle to select valuable frames, an auxiliary guidance to improve restoration models, and even an indicator to optimize camera settings for capturing better images under dynamic scenarios.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 27 of its 48 references that are in the map. First posted on arXiv 22 Mar 2022.
Builds on
27 of 48 references.
References · 27
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,239
- 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,352
- 2021Multi-Stage Progressive Image Restorationcited by 813
- 2016Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurringcited by 722
- 2017Video Enhancement with Task-Oriented Flowcited by 612
- 2017The Perception-Distortion Tradeoffcited by 582
- 2018Learning to See in the Darkcited by 459
- 2017DeblurGAN: Blind Motion Deblurring Using Conditional Adversarial Networkscited by 366
- 2019KonIQ-10k: An ecologically valid database for deep learning of blind image quality assessmentcited by 351
15 more
- 2020Learning Enriched Features for Real Image Restoration and Enhancementcited by 311
- 2019Blind Image Quality Assessment Using A Deep Bilinear Convolutional Neural Networkcited by 301
- 2018Toward Convolutional Blind Denoising of Real Photographscited by 274
- 2021HINet: Half Instance Normalization Network for Image Restorationcited by 236
- 2019Deep Stacked Hierarchical Multi-patch Network for Image Deblurringcited by 205
- 2019Real Image Denoising with Feature Attentioncited by 176
- 2020MetaIQA: Deep Meta-learning for No-Reference Image Quality Assessmentcited by 144
- 2020A Physics-based Noise Formation Model for Extreme Low-light Raw Denoisingcited by 138
- 2020Learning by Analogy: Reliable Supervision from Transformations for Unsupervised Optical Flow Estimationcited by 120
- 2016From Motion Blur to Motion Flow: a Deep Learning Solution for Removing Heterogeneous Motion Blurcited by 81
- 2017Multi-channel Weighted Nuclear Norm Minimization for Real Color Image Denoisingcited by 41
- 2020Low-light Image Restoration with Short- and Long-exposure Raw Pairscited by 18
- 2020Attention-based network for low-light image enhancementcited by 7
- 2020Digital Gimbal: End-to-end Deep Image Stabilization with Learnable Exposure Timescited by 4
- 2021Non-uniform Motion Deblurring with Blurry Component Divided Guidancecited by 2
Built on by
Citing papers per year: 2023: 2; 2024: 4; 2025: 1; 2026: 1.
8 papers.
- 2023Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Visioncited by 247
- 2024Towards Open-ended Visual Quality Comparisoncited by 85
- 2023All-in-one Multi-degradation Image Restoration Network via Hierarchical Degradation Representationcited by 21
- 2024Q-Bench+: A Benchmark for Multi-modal Foundation Models on Low-level Vision from Single Images to Pairscited by 7
- 2025Mitigating Low-Level Visual Hallucinations Requires Self-Awareness: Database, Model and Training Strategycited by 1
- 2024Non-Uniform Exposure Imaging via Neuromorphic Shutter Controlcited by 0
- 2024Scale Contrastive Learning with Selective Attentions for Blind Image Quality Assessmentcited by 0
- 2026Dual-Exposure Imaging with Eventscited by 0
- 2026Dual-Exposure Imaging with Events11 Apr 2026
- 2025Mitigating Low-Level Visual Hallucinations Requires Self-Awareness: Database, Model and Training Strategy26 Mar 2025
- 2024Scale Contrastive Learning with Selective Attentions for Blind Image Quality Assessment13 Nov 2024
- 2024Non-Uniform Exposure Imaging via Neuromorphic Shutter Control22 Apr 2024
- 2024Towards Open-ended Visual Quality Comparison26 Feb 2024
- 2024Q-Bench+: A Benchmark for Multi-modal Foundation Models on Low-level Vision from Single Images to Pairs11 Feb 2024
- 2023Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Vision25 Sep 2023
- 2023All-in-one Multi-degradation Image Restoration Network via Hierarchical Degradation Representation6 Aug 2023