mlsanityData to 7 Oct 2026

Optical Computing for Deep Neural Network Acceleration: Foundations, Recent Developments, and Emerging Directions

arXiv 2407.21184 ↗First posted 30 Jul 2024cs.AR cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Emerging artificial intelligence applications across the domains of computer vision, natural language processing, graph processing, and sequence prediction increasingly rely on deep neural networks (DNNs). These DNNs require significant compute and memory resources for training and inference. Traditional computing platforms such as CPUs, GPUs, and TPUs are struggling to keep up with the demands of the increasingly complex and diverse DNNs. Optical computing represents an exciting new paradigm for light-speed acceleration of DNN workloads. In this article, we discuss the fundamentals and state-of-the-art developments in optical computing, with an emphasis on DNN acceleration. Various promising approaches are described for engineering optical devices, enhancing optical circuits, and designing architectures that can adapt optical computing to a variety of DNN workloads. Novel techniques for hardware/software co-design that can intelligently tune and map DNN models to improve performance and energy-efficiency on optical computing platforms across high performance and resource constrained embedded, edge, and IoT platforms are also discussed. Lastly, several open problems and future directions for research in this domain are highlighted.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 28 of its 139 references that are in the map. First posted on arXiv 30 Jul 2024.

Builds on

28 of 139 references.

References · 28

  1. 2017Attention Is All You Needcited by 59,932
  2. 2017In-Datacenter Performance Analysis of a Tensor Processing Unitcited by 610
  3. 2015Deep Learning with Limited Numerical Precisioncited by 368
  4. 2016Equilibrium Propagation: Bridging the Gap Between Energy-Based Models and Backpropagationcited by 251
  5. 2020Photonics for artificial intelligence and neuromorphic computingcited by 111
  6. 2016Neuromorphic Silicon Photonic Networkscited by 66
  7. 2018Training of photonic neural networks through in situ backpropagationcited by 45
  8. 2017Reinforcement Learning in a large scale photonic Recurrent Neural Networkcited by 30
  9. 2021CrossLight: A Cross-Layer Optimized Silicon Photonic Neural Network Acceleratorcited by 29
  10. 2021A Survey on Silicon Photonics for Deep Learningcited by 23
  11. 2022AI and ML Accelerator Survey and Trendscited by 23
  12. 2019Digital Electronics and Analog Photonics for Convolutional Neural Networks (DEAP-CNNs)cited by 22
16 more
  1. 2021ROBIN: A Robust Optical Binary Neural Network Acceleratorcited by 15
  2. 2022RecLight: A Recurrent Neural Network Accelerator with Integrated Silicon Photonicscited by 12
  3. 2023TRON: Transformer Neural Network Acceleration with Non-Coherent Silicon Photonicscited by 12
  4. 2021SONIC: A Sparse Neural Network Inference Accelerator with Silicon Photonics for Energy-Efficient Deep Learningcited by 10
  5. 2021LATTE: LSTM Self-Attention based Anomaly Detection in Embedded Automotive Platformscited by 9
  6. 2022A Silicon Photonic Accelerator for Convolutional Neural Networks with Heterogeneous Quantizationcited by 9
  7. 2020Bayesian optimisation of large-scale photonic reservoir computerscited by 7
  8. 2023Machine Learning Accelerators in 2.5D Chiplet Platforms with Silicon Photonicscited by 5
  9. 2022LoCI: An Analysis of the Impact of Optical Loss and Crosstalk Noise in Integrated Silicon-Photonic Neural Networkscited by 4
  10. 2022Robust Perception Architecture Design for Automotive Cyber-Physical Systemscited by 4
  11. 2023R-TOSS: A Framework for Real-Time Object Detection using Semi-Structured Pruningcited by 4
  12. 2020Exploiting Process Variations to Secure Photonic NoC Architectures from Snooping Attackscited by 3
  13. 2019Electronic Bottleneck Suppression in Next-generation Networks with Integrated Photonic Digital-to-analog Converterscited by 2
  14. 2023Design Space Exploration for PCM-based Photonic Memorycited by 2
  15. 2023COMET: A Cross-Layer Optimized Optical Phase Change Main Memory Architecturecited by 2
  16. 2023Corona: System Implications of Emerging Nanophotonic Technologycited by 1

Built on by

Not cited yet.