# Deep speckle correlation: a deep learning approach towards scalable imaging through scattering media

arXiv: https://arxiv.org/abs/1806.04139 · HTML: https://mlsanity.com/paper/1806.04139/

## Key facts

- Cited by 23 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 11 Jun 2018.

## Built on by (most cited first, 23 of 23)

- [InverseBench: Benchmarking Plug-and-Play Diffusion Priors for Inverse Problems in Physical Sciences](https://mlsanity.com/paper/2503.11043/) (2025)
- [Recovery of Continuous 3D Refractive Index Maps from Discrete Intensity-Only Measurements using Neural Fields](https://mlsanity.com/paper/2112.00002/) (2021)
- [All-optical image classification through unknown random diffusers using a single-pixel diffractive network](https://mlsanity.com/paper/2208.03968/) (2022)
- [Analysis of Diffractive Neural Networks for Seeing Through Random Diffusers](https://mlsanity.com/paper/2205.00428/) (2022)
- [Physical model simulator-trained neural network for computational 3D phase imaging of multiple-scattering samples](https://mlsanity.com/paper/2103.15795/) (2021)
- [SPI-GAN: Towards Single-Pixel Imaging through Generative Adversarial Network](https://mlsanity.com/paper/2107.01330/) (2021)
- [Block Modulating Video Compression: An Ultra Low Complexity Image Compression Encoder for Resource Limited Platforms](https://mlsanity.com/paper/2205.03677/) (2022)
- [WaveMo: Learning Wavefront Modulations to See Through Scattering](https://mlsanity.com/paper/2404.07985/) (2024)
- [Fisher information flow in artificial neural networks](https://mlsanity.com/paper/2509.02407/) (2025)
- [Deep-learning-driven Reliable Single-pixel Imaging with Uncertainty Approximation](https://mlsanity.com/paper/2107.11678/) (2021)
- [MetaPix: Domain Transfer for Semantic Segmentation by Meta Pixel Weighting](https://mlsanity.com/paper/2110.01777/) (2021)
- [Local Conditional Neural Fields for Versatile and Generalizable Large-Scale Reconstructions in Computational Imaging](https://mlsanity.com/paper/2307.06207/) (2023)
- [What is Wrong with End-to-End Learning for Phase Retrieval?](https://mlsanity.com/paper/2403.15448/) (2024)
- [Imaging dynamics beneath turbid media via parallelized single-photon detection](https://mlsanity.com/paper/2107.01422/) (2021)
- [Deep Camera Obscura: An Image Restoration Pipeline for Lensless Pinhole Photography](https://mlsanity.com/paper/2108.05563/) (2021)
- [Text detection and recognition based on a lensless imaging system](https://mlsanity.com/paper/2210.04244/) (2022)
- [Joint Segmentation and Image Reconstruction with Error Prediction in Photoacoustic Imaging using Deep Learning](https://mlsanity.com/paper/2407.02653/) (2024)
- [Fast Computational Ghost Imaging using Unpaired Deep Learning and a Constrained Generative Adversarial Network](https://mlsanity.com/paper/2106.04822/) (2021)
- [Reconstructing Images of Two Adjacent Objects through Scattering Medium Using Generative Adversarial Network](https://mlsanity.com/paper/2107.11574/) (2021)
- [Hand Gestures Recognition in Videos Taken with Lensless Camera](https://mlsanity.com/paper/2210.08233/) (2022)
- [General Intelligent Imaging and Uncertainty Quantification by Deterministic Diffusion Model](https://mlsanity.com/paper/2408.13061/) (2024)
- [Generalizable Holographic Reconstruction via Amplitude-Only Diffusion Priors](https://mlsanity.com/paper/2509.12728/) (2025)
- [AI-interpreted Optical Scattering for Robust and Focal Depth-Aware Imaging](https://mlsanity.com/paper/2607.22867/) (2026)

## Abstract (arXiv)

Imaging through scattering is an important, yet challenging problem. Tremendous progress has been made by exploiting the deterministic input-output "transmission matrix" for a fixed medium. However, this "one-to-one" mapping is highly susceptible to speckle decorrelations - small perturbations to the scattering medium lead to model errors and severe degradation of the imaging performance. Our goal here is to develop a new framework that is highly scalable to both medium perturbations and measurement requirement. To do so, we propose a statistical "one-to-all" deep learning technique that encapsulates a wide range of statistical variations for the model to be resilient to speckle decorrelations. Specifically, we develop a convolutional neural network (CNN) that is able to learn the statistical information contained in the speckle intensity patterns captured on a set of diffusers having the same macroscopic parameter. We then show for the first time, to the best of our knowledge, that the trained CNN is able to generalize and make high-quality object predictions through an entirely different set of diffusers of the same class. Our work paves the way to a highly scalable deep learning approach for imaging through scattering media.