Seeing Far in the Dark with Patterned Flash
Not on the map. Why?
Abstract (arXiv)
Flash illumination is widely used in imaging under low-light environments. However, illumination intensity falls off with propagation distance quadratically, which poses significant challenges for flash imaging at a long distance. We propose a new flash technique, named ``patterned flash'', for flash imaging at a long distance. Patterned flash concentrates optical power into a dot array. Compared with the conventional uniform flash where the signal is overwhelmed by the noise everywhere, patterned flash provides stronger signals at sparsely distributed points across the field of view to ensure the signals at those points stand out from the sensor noise. This enables post-processing to resolve important objects and details. Additionally, the patterned flash projects texture onto the scene, which can be treated as a structured light system for depth perception. Given the novel system, we develop a joint image reconstruction and depth estimation algorithm with a convolutional neural network. We build a hardware prototype and test the proposed flash technique on various scenes. The experimental results demonstrate that our patterned flash has significantly better performance at long distances in low-light environments.
Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Builds on 24 of its 75 references that are in the map. First posted on arXiv 25 Jul 2022.
Builds on
24 of 75 references.
References · 24
- 2015Deep Residual Learning for Image Recognitioncited by 51,950
- 2014Adam: A Method for Stochastic Optimizationcited by 37,093
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,656
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,364
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,240
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,687
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,876
- 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 879
- 2019CenterNet: Keypoint Triplets for Object Detectioncited by 654
- 2018Learning to See in the Darkcited by 459
- 2018Unprocessing Images for Learned Raw Denoisingcited by 250
- 2017Burst Denoising with Kernel Prediction Networkscited by 157
12 more
- 2021Physics-based Noise Modeling for Extreme Low-light Photographycited by 67
- 2019Handheld Mobile Photography in Very Low Lightcited by 56
- 2019Basis Prediction Networks for Effective Burst Denoising with Large Kernelscited by 46
- 2018ActiveStereoNet: End-to-End Self-Supervised Learning for Active Stereo Systemscited by 35
- 2021Robust Reflection Removal with Reflection-free Flash-only Cuescited by 34
- 2021ReconfigISP: Reconfigurable Camera Image Processing Pipelinecited by 30
- 2020Quanta Burst Photographycited by 25
- 2020Polka Lines: Learning Structured Illumination and Reconstruction for Active Stereocited by 21
- 2020DenoiSeg: Joint Denoising and Segmentationcited by 20
- 2020Deep Denoising of Flash and No-Flash Pairs for Photography in Low-Light Environmentscited by 12
- 2019Stereoscopic Dark Flash for Low-light Photographycited by 7
- 2022Structured Light with Redundancy Codescited by 1
Built on by
Citing papers per year: 2024: 1.
1 paper.