Snapshot Multispectral Imaging Using a Diffractive Optical Network
Not on the map. Why?
Abstract (arXiv)
Multispectral imaging has been used for numerous applications in e.g., environmental monitoring, aerospace, defense, and biomedicine. Here, we present a diffractive optical network-based multispectral imaging system trained using deep learning to create a virtual spectral filter array at the output image field-of-view. This diffractive multispectral imager performs spatially-coherent imaging over a large spectrum, and at the same time, routes a pre-determined set of spectral channels onto an array of pixels at the output plane, converting a monochrome focal plane array or image sensor into a multispectral imaging device without any spectral filters or image recovery algorithms. Furthermore, the spectral responsivity of this diffractive multispectral imager is not sensitive to input polarization states. Through numerical simulations, we present different diffractive network designs that achieve snapshot multispectral imaging with 4, 9 and 16 unique spectral bands within the visible spectrum, based on passive spatially-structured diffractive surfaces, with a compact design that axially spans ~72 times the mean wavelength of the spectral band of interest. Moreover, we experimentally demonstrate a diffractive multispectral imager based on a 3D-printed diffractive network that creates at its output image plane a spatially-repeating virtual spectral filter array with 2x2=4 unique bands at terahertz spectrum. Due to their compact form factor and computation-free, power-efficient and polarization-insensitive forward operation, diffractive multispectral imagers can be transformative for various imaging and sensing applications and be used at different parts of the electromagnetic spectrum where high-density and wide-area multispectral pixel arrays are not widely available.
Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 11 of its 73 references that are in the map. First posted on arXiv 10 Dec 2022.
Builds on
11 of 73 references.
References · 11
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2018All-Optical Machine Learning Using Diffractive Deep Neural Networkscited by 175
- 2020Misalignment Resilient Diffractive Optical Networkscited by 33
- 2018Analysis of Diffractive Optical Neural Networks and Their Integration with Electronic Neural Networkscited by 30
- 2021All-Optical Synthesis of an Arbitrary Linear Transformation Using Diffractive Surfacescited by 24
- 2022Diffractive all-optical computing for quantitative phase imagingcited by 22
- 2022To image, or not to image: Class-specific diffractive cameras with all-optical erasure of undesired objectscited by 21
- 2021Computational Imaging Without a Computer: Seeing Through Random Diffusers at the Speed of Lightcited by 19
- 2022Polarization Multiplexed Diffractive Computing: All-Optical Implementation of a Group of Linear Transformations Through a Polarization-Encoded Diffractive Networkcited by 10
- 2022Massively Parallel Universal Linear Transformations using a Wavelength-Multiplexed Diffractive Optical Networkcited by 9
- 2022Diffractive Interconnects: All-Optical Permutation Operation Using Diffractive Networkscited by 6
Built on by
Citing papers per year: 2023: 6; 2024: 4; 2025: 4; 2026: 2.
16 papers.
Sort:
- 2023Multispectral Quantitative Phase Imaging Using a Diffractive Optical Networkcited by 10
- 2023All-Optical Phase Conjugation Using Diffractive Wavefront Processingcited by 8
- 2023All-optical image denoising using a diffractive visual processorcited by 6
- 2025Hyperspectral Sensors and Autonomous Driving: Technologies, Limitations, and Opportunitiescited by 6
- 2023Rubik's Optical Neural Networks: Multi-task Learning with Physics-aware Rotation Architecturecited by 3
- 2023Pyramid diffractive optical networks for unidirectional image magnification and demagnificationcited by 3
- 2024Multiplexed all-optical permutation operations using a reconfigurable diffractive optical networkcited by 2
- 2024Multiplane Quantitative Phase Imaging Using a Wavelength-Multiplexed Diffractive Optical Processorcited by 2
- 2024Integration of Programmable Diffraction with Digital Neural Networkscited by 1
- 2025SP2RINT: Spatially-Decoupled Physics-Inspired Progressive Inverse Optimization for Scalable, PDE-Constrained Meta-Optical Neural Network Trainingcited by 1
- 2023Artificial intelligence optical hardware empowers high-resolution hyperspectral video understanding at 1.2 Tb/scited by 0
- 2024Surveying You Only Look Once (YOLO) Multispectral Object Detection Advancements, Applications And Challengescited by 0
4 more
- 2025Snapshot multi-spectral imaging through defocusing and a Fourier imager networkcited by 0
- 2025Hyperspectral image segmentation with a machine learning model trained using quantum annealercited by 0
- 2026Wavelength-multiplexed massively parallel diffractive optical information storage and image projectioncited by 0
- 2026Beyond the Thin-Layer Limit: Differentiable Volumetric Training for Visible-Range Diffractive Neural Networkscited by 0
- 2026Beyond the Thin-Layer Limit: Differentiable Volumetric Training for Visible-Range Diffractive Neural Networks5 Jun 2026
- 2026Wavelength-multiplexed massively parallel diffractive optical information storage and image projection3 Apr 2026
- 2025Hyperspectral Sensors and Autonomous Driving: Technologies, Limitations, and Opportunities27 Aug 2025
- 2025SP2RINT: Spatially-Decoupled Physics-Inspired Progressive Inverse Optimization for Scalable, PDE-Constrained Meta-Optical Neural Network Training23 May 2025
- 2025Hyperspectral image segmentation with a machine learning model trained using quantum annealer3 Mar 2025
- 2025Snapshot multi-spectral imaging through defocusing and a Fourier imager network24 Jan 2025
- 2024Surveying You Only Look Once (YOLO) Multispectral Object Detection Advancements, Applications And Challenges3 Sep 2024
- 2024Integration of Programmable Diffraction with Digital Neural Networks15 Jun 2024
- 2024Multiplane Quantitative Phase Imaging Using a Wavelength-Multiplexed Diffractive Optical Processor16 Mar 2024
- 2024Multiplexed all-optical permutation operations using a reconfigurable diffractive optical network4 Feb 2024
- 2023Artificial intelligence optical hardware empowers high-resolution hyperspectral video understanding at 1.2 Tb/s17 Dec 2023
- 2023All-Optical Phase Conjugation Using Diffractive Wavefront Processing8 Nov 2023
4 more
- 2023All-optical image denoising using a diffractive visual processor17 Sep 2023
- 2023Pyramid diffractive optical networks for unidirectional image magnification and demagnification29 Aug 2023
- 2023Multispectral Quantitative Phase Imaging Using a Diffractive Optical Network5 Aug 2023
- 2023Rubik's Optical Neural Networks: Multi-task Learning with Physics-aware Rotation Architecture25 Apr 2023
- 2023Multispectral Quantitative Phase Imaging Using a Diffractive Optical Networkcited by 10
- 2023All-Optical Phase Conjugation Using Diffractive Wavefront Processingcited by 8
- 2023All-optical image denoising using a diffractive visual processorcited by 6
- 2025Hyperspectral Sensors and Autonomous Driving: Technologies, Limitations, and Opportunitiescited by 6
- 2023Rubik's Optical Neural Networks: Multi-task Learning with Physics-aware Rotation Architecturecited by 3
- 2023Pyramid diffractive optical networks for unidirectional image magnification and demagnificationcited by 3
- 2024Multiplexed all-optical permutation operations using a reconfigurable diffractive optical networkcited by 2
- 2024Multiplane Quantitative Phase Imaging Using a Wavelength-Multiplexed Diffractive Optical Processorcited by 2
- 2024Integration of Programmable Diffraction with Digital Neural Networkscited by 1
- 2025SP2RINT: Spatially-Decoupled Physics-Inspired Progressive Inverse Optimization for Scalable, PDE-Constrained Meta-Optical Neural Network Trainingcited by 1
- 2023Artificial intelligence optical hardware empowers high-resolution hyperspectral video understanding at 1.2 Tb/scited by 0
- 2024Surveying You Only Look Once (YOLO) Multispectral Object Detection Advancements, Applications And Challengescited by 0
12 most cited of 16 All 16 (JSON)
- 2026Beyond the Thin-Layer Limit: Differentiable Volumetric Training for Visible-Range Diffractive Neural Networks5 Jun 2026
- 2026Wavelength-multiplexed massively parallel diffractive optical information storage and image projection3 Apr 2026
- 2025Hyperspectral Sensors and Autonomous Driving: Technologies, Limitations, and Opportunities27 Aug 2025
- 2025SP2RINT: Spatially-Decoupled Physics-Inspired Progressive Inverse Optimization for Scalable, PDE-Constrained Meta-Optical Neural Network Training23 May 2025
- 2025Hyperspectral image segmentation with a machine learning model trained using quantum annealer3 Mar 2025
- 2025Snapshot multi-spectral imaging through defocusing and a Fourier imager network24 Jan 2025
- 2024Surveying You Only Look Once (YOLO) Multispectral Object Detection Advancements, Applications And Challenges3 Sep 2024
- 2024Integration of Programmable Diffraction with Digital Neural Networks15 Jun 2024
- 2024Multiplane Quantitative Phase Imaging Using a Wavelength-Multiplexed Diffractive Optical Processor16 Mar 2024
- 2024Multiplexed all-optical permutation operations using a reconfigurable diffractive optical network4 Feb 2024
- 2023Artificial intelligence optical hardware empowers high-resolution hyperspectral video understanding at 1.2 Tb/s17 Dec 2023
- 2023All-Optical Phase Conjugation Using Diffractive Wavefront Processing8 Nov 2023
12 newest of 16 All 16 (JSON)