Deep speckle correlation: a deep learning approach towards scalable imaging through scattering media
Not on the map. Why?
Abstract (arXiv)
Imaging through scattering is an important, yet challenging problem. Tremendous progress has been made by exploiting the deterministic input-output "transmission matrix" for a fixed medium. However, this "one-to-one" mapping is highly susceptible to speckle decorrelations - small perturbations to the scattering medium lead to model errors and severe degradation of the imaging performance. Our goal here is to develop a new framework that is highly scalable to both medium perturbations and measurement requirement. To do so, we propose a statistical "one-to-all" deep learning technique that encapsulates a wide range of statistical variations for the model to be resilient to speckle decorrelations. Specifically, we develop a convolutional neural network (CNN) that is able to learn the statistical information contained in the speckle intensity patterns captured on a set of diffusers having the same macroscopic parameter. We then show for the first time, to the best of our knowledge, that the trained CNN is able to generalize and make high-quality object predictions through an entirely different set of diffusers of the same class. Our work paves the way to a highly scalable deep learning approach for imaging through scattering media.
Key facts. Cited by 23 papers in the map (data through 7 Oct 2026). First posted on arXiv 11 Jun 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 5; 2023: 1; 2024: 4; 2025: 3; 2026: 1.
23 papers.
Sort:
By area:
- 2025InverseBench: Benchmarking Plug-and-Play Diffusion Priors for Inverse Problems in Physical Sciencescited by 67
- 2021Recovery of Continuous 3D Refractive Index Maps from Discrete Intensity-Only Measurements using Neural Fieldscited by 48
- 2022All-optical image classification through unknown random diffusers using a single-pixel diffractive networkcited by 5
- 2022Analysis of Diffractive Neural Networks for Seeing Through Random Diffuserscited by 4
- 2021Physical model simulator-trained neural network for computational 3D phase imaging of multiple-scattering samplescited by 3
- 2021SPI-GAN: Towards Single-Pixel Imaging through Generative Adversarial Networkcited by 3
- 2022Block Modulating Video Compression: An Ultra Low Complexity Image Compression Encoder for Resource Limited Platformscited by 3
- 2024WaveMo: Learning Wavefront Modulations to See Through Scatteringcited by 3
- 2025Fisher information flow in artificial neural networkscited by 3
- 2021Deep-learning-driven Reliable Single-pixel Imaging with Uncertainty Approximationcited by 2
- 2021MetaPix: Domain Transfer for Semantic Segmentation by Meta Pixel Weightingcited by 2
- 2023Local Conditional Neural Fields for Versatile and Generalizable Large-Scale Reconstructions in Computational Imagingcited by 2
11 more
- 2024What is Wrong with End-to-End Learning for Phase Retrieval?cited by 2
- 2021Imaging dynamics beneath turbid media via parallelized single-photon detectioncited by 1
- 2021Deep Camera Obscura: An Image Restoration Pipeline for Lensless Pinhole Photographycited by 1
- 2022Text detection and recognition based on a lensless imaging systemcited by 1
- 2024Joint Segmentation and Image Reconstruction with Error Prediction in Photoacoustic Imaging using Deep Learningcited by 1
- 2021Fast Computational Ghost Imaging using Unpaired Deep Learning and a Constrained Generative Adversarial Networkcited by 0
- 2021Reconstructing Images of Two Adjacent Objects through Scattering Medium Using Generative Adversarial Networkcited by 0
- 2022Hand Gestures Recognition in Videos Taken with Lensless Cameracited by 0
- 2024General Intelligent Imaging and Uncertainty Quantification by Deterministic Diffusion Modelcited by 0
- 2025Generalizable Holographic Reconstruction via Amplitude-Only Diffusion Priorscited by 0
- 2026AI-interpreted Optical Scattering for Robust and Focal Depth-Aware Imagingcited by 0
- 2026AI-interpreted Optical Scattering for Robust and Focal Depth-Aware Imaging24 Jul 2026
- 2025Generalizable Holographic Reconstruction via Amplitude-Only Diffusion Priors16 Sep 2025
- 2025Fisher information flow in artificial neural networks2 Sep 2025
- 2025InverseBench: Benchmarking Plug-and-Play Diffusion Priors for Inverse Problems in Physical Sciences14 Mar 2025
- 2024General Intelligent Imaging and Uncertainty Quantification by Deterministic Diffusion Model23 Aug 2024
- 2024Joint Segmentation and Image Reconstruction with Error Prediction in Photoacoustic Imaging using Deep Learning2 Jul 2024
- 2024WaveMo: Learning Wavefront Modulations to See Through Scattering11 Apr 2024
- 2024What is Wrong with End-to-End Learning for Phase Retrieval?18 Mar 2024
- 2023Local Conditional Neural Fields for Versatile and Generalizable Large-Scale Reconstructions in Computational Imaging12 Jul 2023
- 2022Hand Gestures Recognition in Videos Taken with Lensless Camera15 Oct 2022
- 2022Text detection and recognition based on a lensless imaging system9 Oct 2022
- 2022All-optical image classification through unknown random diffusers using a single-pixel diffractive network8 Aug 2022
11 more
- 2022Block Modulating Video Compression: An Ultra Low Complexity Image Compression Encoder for Resource Limited Platforms7 May 2022
- 2022Analysis of Diffractive Neural Networks for Seeing Through Random Diffusers1 May 2022
- 2021Recovery of Continuous 3D Refractive Index Maps from Discrete Intensity-Only Measurements using Neural Fields27 Nov 2021
- 2021MetaPix: Domain Transfer for Semantic Segmentation by Meta Pixel Weighting5 Oct 2021
- 2021Deep Camera Obscura: An Image Restoration Pipeline for Lensless Pinhole Photography12 Aug 2021
- 2021Deep-learning-driven Reliable Single-pixel Imaging with Uncertainty Approximation24 Jul 2021
- 2021Reconstructing Images of Two Adjacent Objects through Scattering Medium Using Generative Adversarial Network24 Jul 2021
- 2021Imaging dynamics beneath turbid media via parallelized single-photon detection3 Jul 2021
- 2021SPI-GAN: Towards Single-Pixel Imaging through Generative Adversarial Network3 Jul 2021
- 2021Fast Computational Ghost Imaging using Unpaired Deep Learning and a Constrained Generative Adversarial Network9 Jun 2021
- 2021Physical model simulator-trained neural network for computational 3D phase imaging of multiple-scattering samples29 Mar 2021
- 2025InverseBench: Benchmarking Plug-and-Play Diffusion Priors for Inverse Problems in Physical Sciencescited by 67
- 2024General Intelligent Imaging and Uncertainty Quantification by Deterministic Diffusion Modelcited by 0
- 2025Generalizable Holographic Reconstruction via Amplitude-Only Diffusion Priorscited by 0
- 2025Generalizable Holographic Reconstruction via Amplitude-Only Diffusion Priors16 Sep 2025
- 2025InverseBench: Benchmarking Plug-and-Play Diffusion Priors for Inverse Problems in Physical Sciences14 Mar 2025
- 2024General Intelligent Imaging and Uncertainty Quantification by Deterministic Diffusion Model23 Aug 2024
- 2021Recovery of Continuous 3D Refractive Index Maps from Discrete Intensity-Only Measurements using Neural Fieldscited by 48
- 2022All-optical image classification through unknown random diffusers using a single-pixel diffractive networkcited by 5
- 2022Analysis of Diffractive Neural Networks for Seeing Through Random Diffuserscited by 4
- 2021Physical model simulator-trained neural network for computational 3D phase imaging of multiple-scattering samplescited by 3
- 2021SPI-GAN: Towards Single-Pixel Imaging through Generative Adversarial Networkcited by 3
- 2022Block Modulating Video Compression: An Ultra Low Complexity Image Compression Encoder for Resource Limited Platformscited by 3
- 2024WaveMo: Learning Wavefront Modulations to See Through Scatteringcited by 3
- 2025Fisher information flow in artificial neural networkscited by 3
- 2021Deep-learning-driven Reliable Single-pixel Imaging with Uncertainty Approximationcited by 2
- 2021MetaPix: Domain Transfer for Semantic Segmentation by Meta Pixel Weightingcited by 2
- 2023Local Conditional Neural Fields for Versatile and Generalizable Large-Scale Reconstructions in Computational Imagingcited by 2
- 2024What is Wrong with End-to-End Learning for Phase Retrieval?cited by 2
12 most cited of 20 All 20 (JSON)
- 2026AI-interpreted Optical Scattering for Robust and Focal Depth-Aware Imaging24 Jul 2026
- 2025Fisher information flow in artificial neural networks2 Sep 2025
- 2024Joint Segmentation and Image Reconstruction with Error Prediction in Photoacoustic Imaging using Deep Learning2 Jul 2024
- 2024WaveMo: Learning Wavefront Modulations to See Through Scattering11 Apr 2024
- 2024What is Wrong with End-to-End Learning for Phase Retrieval?18 Mar 2024
- 2023Local Conditional Neural Fields for Versatile and Generalizable Large-Scale Reconstructions in Computational Imaging12 Jul 2023
- 2022Hand Gestures Recognition in Videos Taken with Lensless Camera15 Oct 2022
- 2022Text detection and recognition based on a lensless imaging system9 Oct 2022
- 2022All-optical image classification through unknown random diffusers using a single-pixel diffractive network8 Aug 2022
- 2022Block Modulating Video Compression: An Ultra Low Complexity Image Compression Encoder for Resource Limited Platforms7 May 2022
- 2022Analysis of Diffractive Neural Networks for Seeing Through Random Diffusers1 May 2022
- 2021Recovery of Continuous 3D Refractive Index Maps from Discrete Intensity-Only Measurements using Neural Fields27 Nov 2021
12 newest of 20 All 20 (JSON)