Integrated Forward-Inverse Network for Lensless Image Reconstruction
Not on the map. Why?
Abstract (arXiv)
Lensless imaging enables compact and versatile computational cameras by replacing bulky optics with thin coded elements. However, reconstruction from the resulting measurements is challenging: large-footprint point-spread functions (PSFs) produce highly multiplexed observations, making inversion severely ill-conditioned and sensitive to calibration errors and model mismatch. While deep learning approaches, including hybrid models that incorporate physics priors, have shown promise, explicitly maintaining data fidelity throughout the network hierarchy remains difficult. Here, we propose the Integrated Forward-Inverse Network (IFIN), a physics-guided architecture that interleaves differentiable forward projections with learnable inverse updates at every scale, enabling complementary cues to be exploited jointly in the measurement and image domains. This bidirectional coupling supports progressive, physics-consistent refinement and permits system-constrained PSF kernel adaptation under model uncertainty. On challenging lensless benchmarks, including a newly introduced dataset, IFIN achieves state-of-the-art reconstruction quality. We further observe competitive performance on Gaussian deblurring and simulated inline holography reconstruction, suggesting that the same interleaving principle can extend beyond lensless cameras.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 26 of its 56 references that are in the map. First posted on arXiv 6 Jul 2026.
Builds on
26 of 56 references.
References · 26
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,256
- 2017Deep Image Priorcited by 1,097
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 974
- 2022Simple Baselines for Image Restorationcited by 701
- 2017Understanding the Effective Receptive Field in Deep Convolutional Neural Networkscited by 549
- 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 514
- 2017DiffuserCam: Lensless Single-exposure 3D Imagingcited by 51
- 2020Non-line-of-sight Imagingcited by 41
14 more
- 2021DWDN: Deep Wiener Deconvolution Network for Non-Blind Image Deblurringcited by 36
- 2019Learned reconstructions for practical mask-based lensless imagingcited by 31
- 2020FlatNet: Towards Photorealistic Scene Reconstruction from Lensless Measurementscited by 26
- 2019Deep Decomposition Learning for Inverse Imaging Problemscited by 25
- 2020Spectral DiffuserCam: lensless snapshot hyperspectral imaging with a spectral filter arraycited by 24
- 2020Miniscope3D: optimized single-shot miniature 3D fluorescence microscopycited by 17
- 2019Video from Stills: Lensless Imaging with Rolling Shuttercited by 13
- 2021Untrained networks for compressive lensless photographycited by 13
- 2024PhoCoLens: Photorealistic and Consistent Reconstruction in Lensless Imagingcited by 13
- 2022Unrolled Primal-Dual Networks for Lensless Camerascited by 8
- 2025LensNet: An End-to-End Learning Framework for Empirical Point Spread Function Modeling and Lensless Imaging Reconstructioncited by 6
- 2025Towards Robust and Generalizable Lensless Imaging with Modular Learned Reconstructioncited by 4
- 2024LPSNet: End-to-End Human Pose and Shape Estimation with Lensless Imagingcited by 3
- 2017Single-shot multispectral imaging with a monochromatic cameracited by 2
Built on by
Not cited yet.