mlsanityData to 14 Oct 2026

Photonic Advantage of Optical Encoders

arXiv 2305.01743 ↗First posted 2 May 2023physics.optics cs.CVcited by 8

Not on the map. Why?

Abstract (arXiv)

Light's ability to perform massive linear operations parallelly has recently inspired numerous demonstrations of optics-assisted artificial neural networks (ANN). However, a clear advantage of optics over purely digital ANN in a system-level has not yet been established. While linear operations can indeed be optically performed very efficiently, the lack of nonlinearity and signal regeneration require high-power, low-latency signal transduction between optics and electronics. Additionally, a large power is needed for the lasers and photodetectors, which are often neglected in the calculation of energy consumption. Here, instead of mapping traditional digital operations to optics, we co-optimized a hybrid optical-digital ANN, that operates on incoherent light, and thus amenable to operations under ambient light. Keeping the latency and power constant between purely digital ANN and hybrid optical-digital ANN, we identified a low-power/ latency regime, where an optical encoder provides higher classification accuracy than a purely digital ANN. However, in that regime, the overall classification accuracy is lower than what is achievable with higher power and latency. Our results indicate that optics can be advantageous over digital ANN in applications, where the overall performance of the ANN can be relaxed to prioritize lower power and latency.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 10 of its 37 references that are in the map. First posted on arXiv 2 May 2023.

Builds on

10 of 37 references.

References · 10

  1. 2016XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networkscited by 849
  2. 2020The Computational Limits of Deep Learningcited by 193
  3. 2018All-Optical Machine Learning Using Diffractive Deep Neural Networkscited by 177
  4. 2018Analysis of Diffractive Optical Neural Networks and Their Integration with Electronic Neural Networkscited by 30
  5. 2021An optical neural network using less than 1 photon per multiplicationcited by 30
  6. 2022Image sensing with multilayer, nonlinear optical neural networkscited by 25
  7. 2018An Optical Frontend for a Convolutional Neural Networkcited by 18
  8. 2022Hybrid training of optical neural networkscited by 15
  9. 2022Meta-optic Accelerators for Object Classifierscited by 13
  10. 2022Foveated Thermal Computational Imaging in the Wild Using All-Silicon Meta-Opticscited by 1

Built on by

Cited by year

Citing papers per year: 2023: 1; 2024: 5; 2025: 2.

8 papers.