WaveMo: Learning Wavefront Modulations to See Through Scattering
Not on the map. Why?
Abstract (arXiv)
Imaging through scattering media is a fundamental and pervasive challenge in fields ranging from medical diagnostics to astronomy. A promising strategy to overcome this challenge is wavefront modulation, which induces measurement diversity during image acquisition. Despite its importance, designing optimal wavefront modulations to image through scattering remains under-explored. This paper introduces a novel learning-based framework to address the gap. Our approach jointly optimizes wavefront modulations and a computationally lightweight feedforward "proxy" reconstruction network. This network is trained to recover scenes obscured by scattering, using measurements that are modified by these modulations. The learned modulations produced by our framework generalize effectively to unseen scattering scenarios and exhibit remarkable versatility. During deployment, the learned modulations can be decoupled from the proxy network to augment other more computationally expensive restoration algorithms. Through extensive experiments, we demonstrate our approach significantly advances the state of the art in imaging through scattering media. Our project webpage is at https://wavemo-2024.github.io/.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 16 of its 52 references that are in the map. First posted on arXiv 11 Apr 2024.
Builds on
16 of 52 references.
References · 16
- 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,420
- 2014Phase Retrieval via Wirtinger Flow: Theory and Algorithmscited by 123
- 2020NH-HAZE: An Image Dehazing Benchmark with Non-Homogeneous Hazy and Haze-Free Imagescited by 108
- 2019Deep Optics for Monocular Depth Estimation and 3D Object Detectioncited by 65
- 2019Deep Optics for Single-shot High-dynamic-range Imagingcited by 62
- 2022Towards Robust Rain Removal Against Adversarial Attacks: A Comprehensive Benchmark Analysis and Beyondcited by 48
- 2022Imaging with Equivariant Deep Learningcited by 35
- 2018Deep speckle correlation: a deep learning approach towards scalable imaging through scattering mediacited by 23
- 2018Efficient and accurate inversion of multiple scattering with deep learningcited by 10
- 2023Coordinate-based neural representations for computational adaptive optics in widefield microscopycited by 10
- 2023TiDy-PSFs: Computational Imaging with Time-Averaged Dynamic Point-Spread-Functionscited by 5
- 2021Adaptive 3D descattering with a dynamic synthesis networkcited by 4
4 more
- 2020Guidestar-free image-guided wavefront-shapingcited by 3
- 2022Enhancing Speckle Statistics for Imaging inside Scattering Mediacited by 2
- 2023Phase Diverse Phase Retrieval for Microscopy: Comparison of Gaussian and Poisson Approachescited by 2
- 2021Adaptive Inverse Mapping: A Model-free Semi-supervised Learning Approach towards Robust Imaging through Dynamic Scattering Mediacited by 1
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Pupil Design for Computational Wavefront Estimation31 Mar 2026
- 2026High-speed Imaging through Turbulence with Event-based Light Fields14 Mar 2026
- 2026Guidestar-Free Adaptive Optics with Asymmetric Apertures2 Feb 2026