Unfolding a blurred image
Not on the map. Why?
Abstract (arXiv)
We present a solution for the goal of extracting a video from a single motion blurred image to sequentially reconstruct the clear views of a scene as beheld by the camera during the time of exposure. We first learn motion representation from sharp videos in an unsupervised manner through training of a convolutional recurrent video autoencoder network that performs a surrogate task of video reconstruction. Once trained, it is employed for guided training of a motion encoder for blurred images. This network extracts embedded motion information from the blurred image to generate a sharp video in conjunction with the trained recurrent video decoder. As an intermediate step, we also design an efficient architecture that enables real-time single image deblurring and outperforms competing methods across all factors: accuracy, speed, and compactness. Experiments on real scenes and standard datasets demonstrate the superiority of our framework over the state-of-the-art and its ability to generate a plausible sequence of temporally consistent sharp frames.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 51 references that are in the map. First posted on arXiv 28 Jan 2022.
Builds on
19 of 51 references.
References · 19
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
- 2016Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurringcited by 722
- 2016Generating Videos with Scene Dynamicscited by 376
- 2017DeblurGAN: Blind Motion Deblurring Using Conditional Adversarial Networkscited by 366
- 2018Scale-recurrent Network for Deep Image Deblurringcited by 332
- 2017Video Frame Synthesis using Deep Voxel Flowcited by 209
- 2015DeepStereo: Learning to Predict New Views from the World's Imagerycited by 185
- 2018Residual Dense Network for Image Restorationcited by 181
- 2016View Synthesis by Appearance Flowcited by 172
- 2015Learning a Convolutional Neural Network for Non-uniform Motion Blur Removalcited by 148
7 more
- 2016The One Hundred Layers Tiramisu: Fully Convolutional DenseNets for Semantic Segmentationcited by 122
- 2016From Motion Blur to Motion Flow: a Deep Learning Solution for Removing Heterogeneous Motion Blurcited by 81
- 2016A Neural Approach to Blind Motion Deblurringcited by 69
- 2014Learning to Deblurcited by 66
- 2016Examining the Impact of Blur on Recognition by Convolutional Networkscited by 58
- 2018Learning to Extract a Video Sequence from a Single Motion-Blurred Imagecited by 56
- 2018Bringing Alive Blurred Momentscited by 44
Built on by
Not cited yet.