Untrained networks for compressive lensless photography
Not on the map. Why?
Abstract (arXiv)
Compressive lensless imagers enable novel applications in an extremely compact device, requiring only a phase or amplitude mask placed close to the sensor. They have been demonstrated for 2D and 3D microscopy, single-shot video, and single-shot hyperspectral imaging; in each of these cases, a compressive-sensing-based inverse problem is solved in order to recover a 3D data-cube from a 2D measurement. Typically, this is accomplished using convex optimization and hand-picked priors. Alternatively, deep learning-based reconstruction methods offer the promise of better priors, but require many thousands of ground truth training pairs, which can be difficult or impossible to acquire. In this work, we propose the use of untrained networks for compressive image recovery. Our approach does not require any labeled training data, but instead uses the measurement itself to update the network weights. We demonstrate our untrained approach on lensless compressive 2D imaging as well as single-shot high-speed video recovery using the camera's rolling shutter, and single-shot hyperspectral imaging. We provide simulation and experimental verification, showing that our method results in improved image quality over existing methods.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 25 of its 59 references that are in the map. First posted on arXiv 13 Mar 2021.
Builds on
25 of 59 references.
References · 25
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2017Deep Image Priorcited by 1,097
- 2020Plug-and-Play Image Restoration with Deep Denoiser Priorcited by 467
- 2016Deep Convolutional Neural Network for Inverse Problems in Imagingcited by 431
- 2016The Little Engine that Could: Regularization by Denoising (RED)cited by 303
- 2019Plug-and-Play Methods Provably Converge with Properly Trained Denoiserscited by 197
- 2018Deep Decoder: Concise Image Representations from Untrained Non-convolutional Networkscited by 120
- 2019Zoom To Learn, Learn To Zoomcited by 114
- 2019DeepRED: Deep Image Prior Powered by REDcited by 84
- 2017A Review of Convolutional Neural Networks for Inverse Problems in Imagingcited by 81
- 2019Time-Dependent Deep Image Prior for Dynamic MRIcited by 70
- 2018Image Restoration using Total Variation Regularized Deep Image Priorcited by 65
13 more
- 2013Coded aperture compressive temporal imagingcited by 57
- 2017DiffuserCam: Lensless Single-exposure 3D Imagingcited by 51
- 2018Compressed Sensing with Deep Image Prior and Learned Regularizationcited by 47
- 2017Lensless computational imaging through deep learningcited by 44
- 2019Learned reconstructions for practical mask-based lensless imagingcited by 31
- 2020FlatNet: Towards Photorealistic Scene Reconstruction from Lensless Measurementscited by 26
- 2020Deep Phase Decoder: Self-calibrating phase microscopy with an untrained deep neural networkcited by 24
- 2020Spectral DiffuserCam: lensless snapshot hyperspectral imaging with a spectral filter arraycited by 24
- 2020Miniscope3D: optimized single-shot miniature 3D fluorescence microscopycited by 17
- 2019Diffraction tomography with a deep image priorcited by 15
- 2019Video from Stills: Lensless Imaging with Rolling Shuttercited by 13
- 2013Lensless Imaging by Compressive Sensingcited by 10
- 2020Fourier DiffuserScope: Single-shot 3D Fourier light field microscopy with a diffusercited by 7
Built on by
Citing papers per year: 2021: 1; 2022: 1; 2023: 0; 2024: 5; 2025: 3; 2026: 3.
13 papers.
Sort:
By area:
- 2025Towards Robust and Generalizable Lensless Imaging with Modular Learned Reconstructioncited by 4
- 2024Learning to See Through Dazzlecited by 3
- 2021Coded Illumination for Improved Lensless Imagingcited by 1
- 2022Untrained, physics-informed neural networks for structured illumination microscopycited by 1
- 2024Res-U2Net: Untrained Deep Learning for Phase Retrieval and Image Reconstructioncited by 0
- 2024Imaging Signal Recovery Using Neural Network Priors Under Uncertain Forward Model Parameterscited by 0
- 2024Towards Physics-informed Cyclic Adversarial Multi-PSF Lensless Imagingcited by 0
- 2024Towards Lensless Image Deblurring with Prior-Embedded Implicit Neural Representations in the Low-Data Regimecited by 0
- 2025Single-Image Depth from Defocus with Coded Aperture and Diffusion Posterior Samplingcited by 0
- 2025Null-Space Diffusion Distillation Unlocks Speed, Fidelity and Realism in Lensless Imagingcited by 0
- 2026A Lensless Polarization Cameracited by 0
- 2026Color-Encoded Illumination for High-Speed Volumetric Scene Reconstructioncited by 0
1 more
- 2026Integrated Forward-Inverse Network for Lensless Image Reconstruction6 Jul 2026
- 2026Color-Encoded Illumination for High-Speed Volumetric Scene Reconstruction29 Apr 2026
- 2026A Lensless Polarization Camera17 Mar 2026
- 2025Null-Space Diffusion Distillation Unlocks Speed, Fidelity and Realism in Lensless Imaging15 Nov 2025
- 2025Single-Image Depth from Defocus with Coded Aperture and Diffusion Posterior Sampling22 Sep 2025
- 2025Towards Robust and Generalizable Lensless Imaging with Modular Learned Reconstruction3 Feb 2025
- 2024Towards Lensless Image Deblurring with Prior-Embedded Implicit Neural Representations in the Low-Data Regime27 Nov 2024
- 2024Towards Physics-informed Cyclic Adversarial Multi-PSF Lensless Imaging9 Jul 2024
- 2024Imaging Signal Recovery Using Neural Network Priors Under Uncertain Forward Model Parameters5 May 2024
- 2024Res-U2Net: Untrained Deep Learning for Phase Retrieval and Image Reconstruction9 Apr 2024
- 2024Learning to See Through Dazzle24 Feb 2024
- 2022Untrained, physics-informed neural networks for structured illumination microscopy15 Jul 2022
1 more
- 2021Coded Illumination for Improved Lensless Imaging25 Nov 2021
- 2025Towards Robust and Generalizable Lensless Imaging with Modular Learned Reconstructioncited by 4
- 2024Learning to See Through Dazzlecited by 3
- 2021Coded Illumination for Improved Lensless Imagingcited by 1
- 2022Untrained, physics-informed neural networks for structured illumination microscopycited by 1
- 2024Res-U2Net: Untrained Deep Learning for Phase Retrieval and Image Reconstructioncited by 0
- 2024Imaging Signal Recovery Using Neural Network Priors Under Uncertain Forward Model Parameterscited by 0
- 2024Towards Physics-informed Cyclic Adversarial Multi-PSF Lensless Imagingcited by 0
- 2024Towards Lensless Image Deblurring with Prior-Embedded Implicit Neural Representations in the Low-Data Regimecited by 0
- 2026A Lensless Polarization Cameracited by 0
- 2026Color-Encoded Illumination for High-Speed Volumetric Scene Reconstructioncited by 0
- 2026Integrated Forward-Inverse Network for Lensless Image Reconstructioncited by 0
- 2026Integrated Forward-Inverse Network for Lensless Image Reconstruction6 Jul 2026
- 2026Color-Encoded Illumination for High-Speed Volumetric Scene Reconstruction29 Apr 2026
- 2026A Lensless Polarization Camera17 Mar 2026
- 2025Towards Robust and Generalizable Lensless Imaging with Modular Learned Reconstruction3 Feb 2025
- 2024Towards Lensless Image Deblurring with Prior-Embedded Implicit Neural Representations in the Low-Data Regime27 Nov 2024
- 2024Towards Physics-informed Cyclic Adversarial Multi-PSF Lensless Imaging9 Jul 2024
- 2024Imaging Signal Recovery Using Neural Network Priors Under Uncertain Forward Model Parameters5 May 2024
- 2024Res-U2Net: Untrained Deep Learning for Phase Retrieval and Image Reconstruction9 Apr 2024
- 2024Learning to See Through Dazzle24 Feb 2024
- 2022Untrained, physics-informed neural networks for structured illumination microscopy15 Jul 2022
- 2021Coded Illumination for Improved Lensless Imaging25 Nov 2021