mlsanityData to 14 Oct 2026

Silicon Photonic Architecture for Training Deep Neural Networks with Direct Feedback Alignment

arXiv 2111.06862 ↗First posted 12 Nov 2021cs.LG physics.app-ph physics.opticscited by 17

Not on the map. Why?

Abstract (arXiv)

There has been growing interest in using photonic processors for performing neural network inference operations; however, these networks are currently trained using standard digital electronics. Here, we propose on-chip training of neural networks enabled by a CMOS-compatible silicon photonic architecture to harness the potential for massively parallel, efficient, and fast data operations. Our scheme employs the direct feedback alignment training algorithm, which trains neural networks using error feedback rather than error backpropagation, and can operate at speeds of trillions of multiply-accumulate (MAC) operations per second while consuming less than one picojoule per MAC operation. The photonic architecture exploits parallelized matrix-vector multiplications using arrays of microring resonators for processing multi-channel analog signals along single waveguide buses to calculate the gradient vector for each neural network layer in situ. We also experimentally demonstrate training deep neural networks with the MNIST dataset using on-chip MAC operation results. Our novel approach for efficient, ultra-fast neural network training showcases photonics as a promising platform for executing AI applications.

Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). Builds on 15 of its 65 references that are in the map. First posted on arXiv 12 Nov 2021.

Builds on

15 of 65 references.

References · 15

  1. 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,254
  2. 2016Direct Feedback Alignment Provides Learning in Deep Neural Networkscited by 240
  3. 2015Adding Gradient Noise Improves Learning for Very Deep Networkscited by 145
  4. 2016An Analysis of Deep Neural Network Models for Practical Applicationscited by 116
  5. 2020Photonics for artificial intelligence and neuromorphic computingcited by 112
  6. 2017A Survey of Neuromorphic Computing and Neural Networks in Hardwarecited by 85
  7. 2016Convolutional Networks for Fast, Energy-Efficient Neuromorphic Computingcited by 70
  8. 2016Neuromorphic Silicon Photonic Networkscited by 68
  9. 2020Direct Feedback Alignment Scales to Modern Deep Learning Tasks and Architecturescited by 56
  10. 2021Brain-inspired computing: We need a master plancited by 51
  11. 2018Training of photonic neural networks through in situ backpropagationcited by 45
  12. 2019Digital Electronics and Analog Photonics for Convolutional Neural Networks (DEAP-CNNs)cited by 22
3 more
  1. 2016Deep neural networks are robust to weight binarization and other non-linear distortionscited by 13
  2. 2020Hardware Beyond Backpropagation: a Photonic Co-Processor for Direct Feedback Alignmentcited by 10
  3. 2021Silicon microring synapses enable photonic deep learning beyond 9-bit precisioncited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 3; 2023: 4; 2024: 5; 2025: 2; 2026: 3.

17 papers.

Sort:

By area:

  1. 2022Experimentally realized in situ backpropagation for deep learning in nanophotonic neural networkscited by 44
  2. 2023Brain-inspired Computational Intelligence via Predictive Codingcited by 30
  3. 2024Self-Contrastive Forward-Forward Algorithmcited by 17
  4. 2022Dual adaptive training of photonic neural networkscited by 9
  5. 2023Training neural networks with end-to-end optical backpropagationcited by 7
  6. 2024A Review of Neuroscience-Inspired Machine Learningcited by 6
  7. 2022Scaling Laws Beyond Backpropagationcited by 4
  8. 2023Real-Time FJ/MAC PDE Solvers via Tensorized, Back-Propagation-Free Optical PINN Trainingcited by 4
  9. 2024Asymmetrical estimator for training encapsulated deep photonic neural networkscited by 3
  10. 2023Mirage: An RNS-Based Photonic Accelerator for DNN Trainingcited by 2
  11. 2025Scalable Back-Propagation-Free Training of Optical Physics-Informed Neural Networkscited by 2
  12. 2024Seamless Optical Cloud Computing across Edge-Metro Network for Generative AIcited by 1
5 more
  1. 2026Training deep physical neural networks with local physical information bottleneckcited by 1
  2. 2026Diffusing Blame: Task-Dependent Credit Assignment in Biologically Plausible Dual-Stream Networkscited by 1
  3. 2024Thermal Crosstalk Modelling and Compensation Methods for Programmable Photonic Integrated Circuitscited by 0
  4. 2025LuxIA: A Lightweight Unitary matriX-based Framework Built on an Iterative Algorithm for Photonic Neural Network Trainingcited by 0
  5. 2026Toward all-optical unsupervised Hebbian learning in deep photonic neuromorphic networkscited by 0