All-Optical Machine Learning Using Diffractive Deep Neural Networks
Not on the map. Why?
Abstract (arXiv)
We introduce an all-optical Diffractive Deep Neural Network (D2NN) architecture that can learn to implement various functions after deep learning-based design of passive diffractive layers that work collectively. We experimentally demonstrated the success of this framework by creating 3D-printed D2NNs that learned to implement handwritten digit classification and the function of an imaging lens at terahertz spectrum. With the existing plethora of 3D-printing and other lithographic fabrication methods as well as spatial-light-modulators, this all-optical deep learning framework can perform, at the speed of light, various complex functions that computer-based neural networks can implement, and will find applications in all-optical image analysis, feature detection and object classification, also enabling new camera designs and optical components that can learn to perform unique tasks using D2NNs.
Key facts. Cited by 177 papers in the map (data through 14 Oct 2026). First posted on arXiv 14 Apr 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 17; 2022: 46; 2023: 27; 2024: 32; 2025: 24; 2026: 31.
177 papers.
Sort:
By area:
- 2022Socratic Models: Composing Zero-Shot Multimodal Reasoning with Languagecited by 513
- 2021Deep physical neural networks enabled by a backpropagation algorithm for arbitrary physical systemscited by 128
- 2024Training of Physical Neural Networkscited by 49
- 2023Backpropagation-free Training of Deep Physical Neural Networkscited by 42
- 2021Vector Symbolic Architectures as a Computing Framework for Emerging Hardwarecited by 35
- 2021Applications and Techniques for Fast Machine Learning in Sciencecited by 32
- 2021An optical neural network using less than 1 photon per multiplicationcited by 30
- 2022Image sensing with multilayer, nonlinear optical neural networkscited by 25
- 2021All-Optical Synthesis of an Arbitrary Linear Transformation Using Diffractive Surfacescited by 24
- 2022Diffractive all-optical computing for quantitative phase imagingcited by 22
- 2022To image, or not to image: Class-specific diffractive cameras with all-optical erasure of undesired objectscited by 21
- 2023Nonlinear Processing with Linear Opticscited by 20
38 more
- 2023On the use of deep learning for phase recoverycited by 20
- 2023Forward-Forward Training of an Optical Neural Networkcited by 19
- 2021An extended physics informed neural network for preliminary analysis of parametric optimal control problemscited by 16
- 2022Snapshot Multispectral Imaging Using a Diffractive Optical Networkcited by 16
- 2022Hybrid training of optical neural networkscited by 15
- 2023Nonlinear optical encoding enabled by recurrent linear scatteringcited by 15
- 2025A multi-agentic framework for real-time, autonomous freeform metasurface designcited by 14
- 2021A compact butterfly-style silicon photonic-electronic neural chip for hardware-efficient deep learningcited by 13
- 2022Super-resolution image display using diffractive decoderscited by 13
- 2022Unidirectional Imaging using Deep Learning-Designed Materialscited by 13
- 2022Single-Shot Optical Neural Networkcited by 12
- 2023Spatially Varying Nanophotonic Neural Networkscited by 12
- 2022Polarization Multiplexed Diffractive Computing: All-Optical Implementation of a Group of Linear Transformations Through a Polarization-Encoded Diffractive Networkcited by 10
- 2023Optical Transformerscited by 10
- 2023Multispectral Quantitative Phase Imaging Using a Diffractive Optical Networkcited by 10
- 2022Dual adaptive training of photonic neural networkscited by 9
- 2023Photonic Advantage of Optical Encoderscited by 8
- 2023Quantum-limited stochastic optical neural networks operating at a few quanta per activationcited by 8
- 2023All-Optical Phase Conjugation Using Diffractive Wavefront Processingcited by 8
- 2024Optical Generative Modelscited by 8
- 2023Training neural networks with end-to-end optical backpropagationcited by 7
- 2025Over-the-Air Edge Inference via End-to-End Metasurfaces-Integrated Artificial Neural Networkscited by 7
- 2021Knowledge Distillation Circumvents Nonlinearity for Optical Convolutional Neural Networkscited by 6
- 2021Wave-based extreme deep learning based on non-linear time-Floquet entanglementcited by 6
- 2022All-optical graph representation learning using integrated diffractive photonic computing unitscited by 6
- 2022Diffractive Interconnects: All-Optical Permutation Operation Using Diffractive Networkscited by 6
- 2022Intelligent Computing: The Latest Advances, Challenges and Futurecited by 6
- 2023All-optical image denoising using a diffractive visual processorcited by 6
- 2024Information hiding cameras: optical concealment of object information into ordinary imagescited by 6
- 2021Classification and reconstruction of spatially overlapping phase images using diffractive optical networkscited by 5
- 2022Deep Optical Coding Design in Computational Imagingcited by 5
- 2022Photonic Reconfigurable Accelerators for Efficient Inference of CNNs with Mixed-Sized Tensorscited by 5
- 2022All-optical image classification through unknown random diffusers using a single-pixel diffractive networkcited by 5
- 2022Physics-aware Differentiable Discrete Codesign for Diffractive Optical Neural Networkscited by 5
- 2022Optical multi-task learning using multi-wavelength diffractive deep neural networkscited by 5
- 2024Training all-mechanical neural networks for task learning through in situ backpropagationcited by 5
- 2024Minimalist Vision with Freeform Pixelscited by 5
- 2025Universal Approximation with XL MIMO Systems: OTA Classification via Trainable Analog Combiningcited by 5
50 most cited of 177 All 177 (JSON)
- 2026RAOA: Alternating-Operator Neural Computation with Programmable Radio Propagation2 Oct 2026
- 2026Beyond Noise: Understanding and Overcoming Temperature Effects in Analog DNN Inference14 Sep 2026
- 2026Physical policy gradient theorem for in situ stochastic-adjoint training5 Sep 2026
- 2026Over-The-Air Extreme Learning Machines with Nonlinear Stacked Intelligent Metasurfaces27 Aug 2026
- 2026Program-Synthesis-Driven Autodesign of Universal Unitary Operators11 Jul 2026
- 2026Inverse-designed meta processing units for multi-task near-field photonic computing9 Jul 2026
- 2026VLM-Aware Meta-Optic Front-End Design for Frozen Vision-Language Models26 Jun 2026
- 2026An Integrated Hardware-Software Design for Low-Data Spatial Defect Detection in Robotic Visual Inspection with Hybrid Optoelectronic Neural Networks24 Jun 2026
- 2026Trainable Photonic Measurement for Physics-Informed PDE Learning17 Jun 2026
- 2026HAMON: Passive Optical Sequence Mixing for Long-Horizon Forecasting15 Jun 2026
- 2026Wavelength-Multiplexed 2D Beam Steering via a Passive Diffractive Network15 Jun 2026
- 2026End-to-End Optimization of Incoherent Imaging for Classification Under Detector-Limited Readout8 Jun 2026
38 more
- 2026Optimizing Energy-based Neural Network Training with Coherent Ising Machine8 Jun 2026
- 2026Hybridizing Equilibrium Propagation with Ising Machines for Efficient Energy-Based Learning8 Jun 2026
- 2026Scalable, Energy-Efficient Optical-Neural Architecture for Multiplexed Deepfake Video Detection19 May 2026
- 2026Pre-training Enables Extraordinary All-optical Image Denoising8 May 2026
- 2026Physical Foundation Models: Fixed hardware implementations of large-scale neural networks30 Apr 2026
- 2026End-to-end autonomous scientific discovery on a real optical platform29 Apr 2026
- 2026Fully Analog Resonant Recurrent Neural Network via Metacircuit19 Apr 2026
- 2026Photonic AI: A Hybrid Diffractive Holographic Neural System for Passive Optical Real-Time Image Classification14 Apr 2026
- 2026Wavelength-multiplexed massively parallel diffractive optical information storage and image projection3 Apr 2026
- 2026Photonic convolutional neural network with pre-trained in situ training2 Apr 2026
- 20263D aperture-engineered diffractive neural networks for super-resolution electromagnetic wave computing1 Mar 2026
- 2026ReDON: Recurrent Diffractive Optical Neural Processor with Reconfigurable Self-Modulated Nonlinearity27 Feb 2026
- 2026Metasurfaces-Integrated Wireless Neural Networks for Lightweight Over-The-Air Edge Inference22 Feb 2026
- 2026All-Optical Segmentation via Diffractive Neural Networks for Autonomous Driving7 Feb 2026
- 2026Securing SIM-Assisted Wireless Networks via Quantum Reinforcement Learning29 Jan 2026
- 2026Toward all-optical unsupervised Hebbian learning in deep photonic neuromorphic networks29 Jan 2026
- 2026Automated HER2 scoring with uncertainty quantification using lensfree holography and deep learning26 Jan 2026
- 2026Over-The-Air Extreme Learning Machines with XL Reception via Nonlinear Cascaded Metasurfaces25 Jan 2026
- 2026Illumination Angular Spectrum Encoding for Controlling the Functionality of Diffractive Networks8 Jan 2026
- 2025Over-the-Air Goal-Oriented Communications23 Dec 2025
- 2025Photonics-Enhanced Graph Convolutional Networks17 Dec 2025
- 2025Optical diffraction neural networks assisted computational ghost imaging through dynamic scattering media28 Nov 2025
- 2025Direct Kernel Optimization: Efficient Design for Opto-Electronic Convolutional Neural Networks3 Nov 2025
- 2025Super-resolution image projection over an extended depth of field using a diffractive decoder4 Oct 2025
- 2025Spatially Parallel All-optical Neural Networks28 Sep 2025
- 2025Integrating Stacked Intelligent Metasurfaces and Power Control for Dynamic Edge Inference via Over-The-Air Neural Networks23 Sep 2025
- 2025Toward Lifelong-Sustainable Electronic-Photonic AI Systems via Extreme Efficiency, Reconfigurability, and Robustness9 Sep 2025
- 2025Meta-training of diffractive meta-neural networks for super-resolution direction of arrival estimation7 Sep 2025
- 2025Universality of physical neural networks with multivariate nonlinearity6 Sep 2025
- 2025Modeling and benchmarking quantum optical neurons for efficient neural computation1 Sep 2025
- 2025Designing across domains with declarative thinking: Insights from the 96-Eyes ptychographic imager project25 Aug 2025
- 2025Neural Tangent Knowledge Distillation for Optical Convolutional Networks11 Aug 2025
- 2025Model-free Optical Processors using In Situ Reinforcement Learning with Proximal Policy Optimization8 Jul 2025
- 2025Evolutionary chemical learning in dimerization networks16 Jun 2025
- 2025Machine Intelligence on Wireless Edge Networks13 Jun 2025
- 2025Structural Vibration Monitoring with Diffractive Optical Processors3 Jun 2025
- 2025SP2RINT: Spatially-Decoupled Physics-Inspired Progressive Inverse Optimization for Scalable, PDE-Constrained Meta-Optical Neural Network Training23 May 2025
- 2025Programmable metasurfaces for future photonic artificial intelligence16 May 2025
50 newest of 177 All 177 (JSON)
- 2024Optical Diffusion Models for Image Generationcited by 4
- 2024Optical Diffusion Models for Image Generation15 Jul 2024
- 2021Deep physical neural networks enabled by a backpropagation algorithm for arbitrary physical systemscited by 128
- 2024Training of Physical Neural Networkscited by 49
- 2023Backpropagation-free Training of Deep Physical Neural Networkscited by 42
- 2021Vector Symbolic Architectures as a Computing Framework for Emerging Hardwarecited by 35
- 2021Applications and Techniques for Fast Machine Learning in Sciencecited by 32
- 2021An optical neural network using less than 1 photon per multiplicationcited by 30
- 2022Image sensing with multilayer, nonlinear optical neural networkscited by 25
- 2021All-Optical Synthesis of an Arbitrary Linear Transformation Using Diffractive Surfacescited by 24
- 2022Diffractive all-optical computing for quantitative phase imagingcited by 22
- 2022To image, or not to image: Class-specific diffractive cameras with all-optical erasure of undesired objectscited by 21
- 2023Nonlinear Processing with Linear Opticscited by 20
- 2023On the use of deep learning for phase recoverycited by 20
12 most cited of 170 All 170 (JSON)
- 2026RAOA: Alternating-Operator Neural Computation with Programmable Radio Propagation2 Oct 2026
- 2026Beyond Noise: Understanding and Overcoming Temperature Effects in Analog DNN Inference14 Sep 2026
- 2026Over-The-Air Extreme Learning Machines with Nonlinear Stacked Intelligent Metasurfaces27 Aug 2026
- 2026Program-Synthesis-Driven Autodesign of Universal Unitary Operators11 Jul 2026
- 2026Inverse-designed meta processing units for multi-task near-field photonic computing9 Jul 2026
- 2026An Integrated Hardware-Software Design for Low-Data Spatial Defect Detection in Robotic Visual Inspection with Hybrid Optoelectronic Neural Networks24 Jun 2026
- 2026Trainable Photonic Measurement for Physics-Informed PDE Learning17 Jun 2026
- 2026HAMON: Passive Optical Sequence Mixing for Long-Horizon Forecasting15 Jun 2026
- 2026Wavelength-Multiplexed 2D Beam Steering via a Passive Diffractive Network15 Jun 2026
- 2026End-to-End Optimization of Incoherent Imaging for Classification Under Detector-Limited Readout8 Jun 2026
- 2026Optimizing Energy-based Neural Network Training with Coherent Ising Machine8 Jun 2026
- 2026Hybridizing Equilibrium Propagation with Ising Machines for Efficient Energy-Based Learning8 Jun 2026
12 newest of 170 All 170 (JSON)