Multi-View Motion Synthesis via Applying Rotated Dual-Pixel Blur Kernels
Not on the map. Why?
Abstract (arXiv)
Portrait mode is widely available on smartphone cameras to provide an enhanced photographic experience. One of the primary effects applied to images captured in portrait mode is a synthetic shallow depth of field (DoF). The synthetic DoF (or bokeh effect) selectively blurs regions in the image to emulate the effect of using a large lens with a wide aperture. In addition, many applications now incorporate a new image motion attribute (NIMAT) to emulate background motion, where the motion is correlated with estimated depth at each pixel. In this work, we follow the trend of rendering the NIMAT effect by introducing a modification on the blur synthesis procedure in portrait mode. In particular, our modification enables a high-quality synthesis of multi-view bokeh from a single image by applying rotated blurring kernels. Given the synthesized multiple views, we can generate aesthetically realistic image motion similar to the NIMAT effect. We validate our approach qualitatively compared to the original NIMAT effect and other similar image motions, like Facebook 3D image. Our image motion demonstrates a smooth image view transition with fewer artifacts around the object boundary.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 13 of its 30 references that are in the map. First posted on arXiv 15 Nov 2021.
Builds on
13 of 30 references.
References · 13
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
- 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 820
- 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 782
- 2016Unsupervised CNN for Single View Depth Estimation: Geometry to the Rescuecited by 368
- 2015Learning Depth from Single Monocular Images Using Deep Convolutional Neural Fieldscited by 169
- 2020Defocus Deblurring Using Dual-Pixel Datacited by 139
- 2016Deep3D: Fully Automatic 2D-to-3D Video Conversion with Deep Convolutional Neural Networkscited by 73
- 2018Synthetic Depth-of-Field with a Single-Camera Mobile Phonecited by 71
- 2020Rendering Natural Camera Bokeh Effect with Deep Learningcited by 57
- 2019Learning Single Camera Depth Estimation using Dual-Pixelscited by 49
- 2020Learning to Reduce Defocus Blur by Realistically Modeling Dual-Pixel Datacited by 42
- 2020Du2Net: Learning Depth Estimation from Dual-Cameras and Dual-Pixelscited by 23
Built on by
Citing papers per year: 2022: 1; 2023: 2.
3 papers.
- 2023Learning Lens Blur Fieldscited by 6
- 2023Continuous Cost Aggregation for Dual-Pixel Disparity Extractioncited by 3
- 2022Learnable Blur Kernel for Single-Image Defocus Deblurring in the Wildcited by 1
- 2023Learning Lens Blur Fields17 Oct 2023
- 2023Continuous Cost Aggregation for Dual-Pixel Disparity Extraction13 Jun 2023
- 2022Learnable Blur Kernel for Single-Image Defocus Deblurring in the Wild25 Nov 2022