Photonic Advantage of Optical Encoders
Not on the map. Why?
Abstract (arXiv)
Light's ability to perform massive linear operations parallelly has recently inspired numerous demonstrations of optics-assisted artificial neural networks (ANN). However, a clear advantage of optics over purely digital ANN in a system-level has not yet been established. While linear operations can indeed be optically performed very efficiently, the lack of nonlinearity and signal regeneration require high-power, low-latency signal transduction between optics and electronics. Additionally, a large power is needed for the lasers and photodetectors, which are often neglected in the calculation of energy consumption. Here, instead of mapping traditional digital operations to optics, we co-optimized a hybrid optical-digital ANN, that operates on incoherent light, and thus amenable to operations under ambient light. Keeping the latency and power constant between purely digital ANN and hybrid optical-digital ANN, we identified a low-power/ latency regime, where an optical encoder provides higher classification accuracy than a purely digital ANN. However, in that regime, the overall classification accuracy is lower than what is achievable with higher power and latency. Our results indicate that optics can be advantageous over digital ANN in applications, where the overall performance of the ANN can be relaxed to prioritize lower power and latency.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 10 of its 37 references that are in the map. First posted on arXiv 2 May 2023.
Builds on
10 of 37 references.
References · 10
- 2016XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networkscited by 849
- 2020The Computational Limits of Deep Learningcited by 193
- 2018All-Optical Machine Learning Using Diffractive Deep Neural Networkscited by 177
- 2018Analysis of Diffractive Optical Neural Networks and Their Integration with Electronic Neural Networkscited by 30
- 2021An optical neural network using less than 1 photon per multiplicationcited by 30
- 2022Image sensing with multilayer, nonlinear optical neural networkscited by 25
- 2018An Optical Frontend for a Convolutional Neural Networkcited by 18
- 2022Hybrid training of optical neural networkscited by 15
- 2022Meta-optic Accelerators for Object Classifierscited by 13
- 2022Foveated Thermal Computational Imaging in the Wild Using All-Silicon Meta-Opticscited by 1
Built on by
Citing papers per year: 2023: 1; 2024: 5; 2025: 2.
8 papers.
- 2024Compressed Meta-Optical Encoder for Image Classificationcited by 6
- 2024Transferable polychromatic optical encoder for neural networkscited by 3
- 2023Neural Network Methods for Radiation Detectors and Imagingcited by 2
- 2025Neural Tangent Knowledge Distillation for Optical Convolutional Networkscited by 2
- 2024Integration of Programmable Diffraction with Digital Neural Networkscited by 1
- 2024Metasurface-generated large and arbitrary analog convolution kernels for accelerated machine visioncited by 0
- 2024Computational metaoptics for imagingcited by 0
- 2025Programmable metasurfaces for future photonic artificial intelligencecited by 0
- 2025Neural Tangent Knowledge Distillation for Optical Convolutional Networks11 Aug 2025
- 2025Programmable metasurfaces for future photonic artificial intelligence16 May 2025
- 2024Computational metaoptics for imaging14 Nov 2024
- 2024Transferable polychromatic optical encoder for neural networks5 Nov 2024
- 2024Metasurface-generated large and arbitrary analog convolution kernels for accelerated machine vision27 Sep 2024
- 2024Integration of Programmable Diffraction with Digital Neural Networks15 Jun 2024
- 2024Compressed Meta-Optical Encoder for Image Classification23 Apr 2024
- 2023Neural Network Methods for Radiation Detectors and Imaging9 Nov 2023