# Analysis of Diffractive Optical Neural Networks and Their Integration with Electronic Neural Networks

arXiv: https://arxiv.org/abs/1810.01916 · HTML: https://mlsanity.com/paper/1810.01916/

## Key facts

- Cited by 30 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 3 Oct 2018.

## Built on by (most cited first, 30 of 30)

- [Diffractive all-optical computing for quantitative phase imaging](https://mlsanity.com/paper/2201.08964/) (2022)
- [Snapshot Multispectral Imaging Using a Diffractive Optical Network](https://mlsanity.com/paper/2212.05217/) (2022)
- [Super-resolution image display using diffractive decoders](https://mlsanity.com/paper/2206.07281/) (2022)
- [Unidirectional Imaging using Deep Learning-Designed Materials](https://mlsanity.com/paper/2212.02025/) (2022)
- [Spatially Varying Nanophotonic Neural Networks](https://mlsanity.com/paper/2308.03407/) (2023)
- [Polarization Multiplexed Diffractive Computing: All-Optical Implementation of a Group of Linear Transformations Through a Polarization-Encoded Diffractive Network](https://mlsanity.com/paper/2203.13482/) (2022)
- [Photonic Advantage of Optical Encoders](https://mlsanity.com/paper/2305.01743/) (2023)
- [Optical Generative Models](https://mlsanity.com/paper/2410.17970/) (2024)
- [All-optical image denoising using a diffractive visual processor](https://mlsanity.com/paper/2309.09215/) (2023)
- [Classification and reconstruction of spatially overlapping phase images using diffractive optical networks](https://mlsanity.com/paper/2108.07977/) (2021)
- [All-optical image classification through unknown random diffusers using a single-pixel diffractive network](https://mlsanity.com/paper/2208.03968/) (2022)
- [Physics-aware Differentiable Discrete Codesign for Diffractive Optical Neural Networks](https://mlsanity.com/paper/2209.14252/) (2022)
- [Analysis of Diffractive Neural Networks for Seeing Through Random Diffusers](https://mlsanity.com/paper/2205.00428/) (2022)
- [Time-lapse image classification using a diffractive neural network](https://mlsanity.com/paper/2208.10802/) (2022)
- [Pyramid diffractive optical networks for unidirectional image magnification and demagnification](https://mlsanity.com/paper/2308.15019/) (2023)
- [Subwavelength Imaging using a Solid-Immersion Diffractive Optical Processor](https://mlsanity.com/paper/2401.08923/) (2024)
- [All-optical complex field imaging using diffractive processors](https://mlsanity.com/paper/2401.16779/) (2024)
- [Multiplane Quantitative Phase Imaging Using a Wavelength-Multiplexed Diffractive Optical Processor](https://mlsanity.com/paper/2403.11035/) (2024)
- [Neural Tangent Knowledge Distillation for Optical Convolutional Networks](https://mlsanity.com/paper/2508.08421/) (2025)
- [Integration of Programmable Diffraction with Digital Neural Networks](https://mlsanity.com/paper/2406.10688/) (2024)
- [Unidirectional imaging with partially coherent light](https://mlsanity.com/paper/2408.05449/) (2024)
- [Adversarial attacks on an optical neural network](https://mlsanity.com/paper/2205.01226/) (2022)
- [Misaligned orientations of 4f optical neural network for image classification accuracy on various datasets](https://mlsanity.com/paper/2210.08004/) (2022)
- [Snapshot multi-spectral imaging through defocusing and a Fourier imager network](https://mlsanity.com/paper/2501.14287/) (2025)
- [Onboard Terrain Classification via Stacked Intelligent Metasurface-Diffractive Deep Neural Networks from SAR Level-0 Raw Data](https://mlsanity.com/paper/2503.13488/) (2025)
- [Super-resolution image projection over an extended depth of field using a diffractive decoder](https://mlsanity.com/paper/2510.03938/) (2025)
- [Snapshot 3D image projection using a diffractive decoder](https://mlsanity.com/paper/2512.20464/) (2025)
- [All-Optical Segmentation via Diffractive Neural Networks for Autonomous Driving](https://mlsanity.com/paper/2602.07717/) (2026)
- [Scalable, Energy-Efficient Optical-Neural Architecture for Multiplexed Deepfake Video Detection](https://mlsanity.com/paper/2605.19360/) (2026)
- [Beyond the Thin-Layer Limit: Differentiable Volumetric Training for Visible-Range Diffractive Neural Networks](https://mlsanity.com/paper/2606.07896/) (2026)

## Abstract (arXiv)

Optical machine learning offers advantages in terms of power efficiency, scalability and computation speed. Recently, an optical machine learning method based on Diffractive Deep Neural Networks (D2NNs) has been introduced to execute a function as the input light diffracts through passive layers, designed by deep learning using a computer. Here we introduce improvements to D2NNs by changing the training loss function and reducing the impact of vanishing gradients in the error back-propagation step. Using five phase-only diffractive layers, we numerically achieved a classification accuracy of 97.18% and 89.13% for optical recognition of handwritten digits and fashion products, respectively; using both phase and amplitude modulation (complex-valued) at each layer, our inference performance improved to 97.81% and 89.32%, respectively. Furthermore, we report the integration of D2NNs with electronic neural networks to create hybrid-classifiers that significantly reduce the number of input pixels into an electronic network using an ultra-compact front-end D2NN with a layer-to-layer distance of a few wavelengths, also reducing the complexity of the successive electronic network. Using a 5-layer phase-only D2NN jointly-optimized with a single fully-connected electronic layer, we achieved a classification accuracy of 98.71% and 90.04% for the recognition of handwritten digits and fashion products, respectively. Moreover, the input to the electronic network was compressed by >7.8 times down to 10x10 pixels. Beyond creating low-power and high-frame rate machine learning platforms, D2NN-based hybrid neural networks will find applications in smart optical imager and sensor design.
