Silicon Photonic Architecture for Training Deep Neural Networks with Direct Feedback Alignment
Not on the map. Why?
Abstract (arXiv)
There has been growing interest in using photonic processors for performing neural network inference operations; however, these networks are currently trained using standard digital electronics. Here, we propose on-chip training of neural networks enabled by a CMOS-compatible silicon photonic architecture to harness the potential for massively parallel, efficient, and fast data operations. Our scheme employs the direct feedback alignment training algorithm, which trains neural networks using error feedback rather than error backpropagation, and can operate at speeds of trillions of multiply-accumulate (MAC) operations per second while consuming less than one picojoule per MAC operation. The photonic architecture exploits parallelized matrix-vector multiplications using arrays of microring resonators for processing multi-channel analog signals along single waveguide buses to calculate the gradient vector for each neural network layer in situ. We also experimentally demonstrate training deep neural networks with the MNIST dataset using on-chip MAC operation results. Our novel approach for efficient, ultra-fast neural network training showcases photonics as a promising platform for executing AI applications.
Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). Builds on 15 of its 65 references that are in the map. First posted on arXiv 12 Nov 2021.
Builds on
15 of 65 references.
References · 15
- 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,254
- 2016Direct Feedback Alignment Provides Learning in Deep Neural Networkscited by 240
- 2015Adding Gradient Noise Improves Learning for Very Deep Networkscited by 145
- 2016An Analysis of Deep Neural Network Models for Practical Applicationscited by 116
- 2020Photonics for artificial intelligence and neuromorphic computingcited by 112
- 2017A Survey of Neuromorphic Computing and Neural Networks in Hardwarecited by 85
- 2016Convolutional Networks for Fast, Energy-Efficient Neuromorphic Computingcited by 70
- 2016Neuromorphic Silicon Photonic Networkscited by 68
- 2020Direct Feedback Alignment Scales to Modern Deep Learning Tasks and Architecturescited by 56
- 2021Brain-inspired computing: We need a master plancited by 51
- 2018Training of photonic neural networks through in situ backpropagationcited by 45
- 2019Digital Electronics and Analog Photonics for Convolutional Neural Networks (DEAP-CNNs)cited by 22
3 more
Built on by
Citing papers per year: 2022: 3; 2023: 4; 2024: 5; 2025: 2; 2026: 3.
17 papers.
Sort:
By area:
- 2022Experimentally realized in situ backpropagation for deep learning in nanophotonic neural networkscited by 44
- 2023Brain-inspired Computational Intelligence via Predictive Codingcited by 30
- 2024Self-Contrastive Forward-Forward Algorithmcited by 17
- 2022Dual adaptive training of photonic neural networkscited by 9
- 2023Training neural networks with end-to-end optical backpropagationcited by 7
- 2024A Review of Neuroscience-Inspired Machine Learningcited by 6
- 2022Scaling Laws Beyond Backpropagationcited by 4
- 2023Real-Time FJ/MAC PDE Solvers via Tensorized, Back-Propagation-Free Optical PINN Trainingcited by 4
- 2024Asymmetrical estimator for training encapsulated deep photonic neural networkscited by 3
- 2023Mirage: An RNS-Based Photonic Accelerator for DNN Trainingcited by 2
- 2025Scalable Back-Propagation-Free Training of Optical Physics-Informed Neural Networkscited by 2
- 2024Seamless Optical Cloud Computing across Edge-Metro Network for Generative AIcited by 1
5 more
- 2026Training deep physical neural networks with local physical information bottleneckcited by 1
- 2026Diffusing Blame: Task-Dependent Credit Assignment in Biologically Plausible Dual-Stream Networkscited by 1
- 2024Thermal Crosstalk Modelling and Compensation Methods for Programmable Photonic Integrated Circuitscited by 0
- 2025LuxIA: A Lightweight Unitary matriX-based Framework Built on an Iterative Algorithm for Photonic Neural Network Trainingcited by 0
- 2026Toward all-optical unsupervised Hebbian learning in deep photonic neuromorphic networkscited by 0
- 2026Diffusing Blame: Task-Dependent Credit Assignment in Biologically Plausible Dual-Stream Networks30 Jun 2026
- 2026Training deep physical neural networks with local physical information bottleneck10 Feb 2026
- 2026Toward all-optical unsupervised Hebbian learning in deep photonic neuromorphic networks29 Jan 2026
- 2025LuxIA: A Lightweight Unitary matriX-based Framework Built on an Iterative Algorithm for Photonic Neural Network Training24 Dec 2025
- 2025Scalable Back-Propagation-Free Training of Optical Physics-Informed Neural Networks17 Feb 2025
- 2024Seamless Optical Cloud Computing across Edge-Metro Network for Generative AI4 Dec 2024
- 2024Self-Contrastive Forward-Forward Algorithm17 Sep 2024
- 2024Asymmetrical estimator for training encapsulated deep photonic neural networks28 May 2024
- 2024Thermal Crosstalk Modelling and Compensation Methods for Programmable Photonic Integrated Circuits19 Mar 2024
- 2024A Review of Neuroscience-Inspired Machine Learning16 Feb 2024
- 2023Real-Time FJ/MAC PDE Solvers via Tensorized, Back-Propagation-Free Optical PINN Training31 Dec 2023
- 2023Mirage: An RNS-Based Photonic Accelerator for DNN Training29 Nov 2023
5 more
- 2023Brain-inspired Computational Intelligence via Predictive Coding15 Aug 2023
- 2023Training neural networks with end-to-end optical backpropagation9 Aug 2023
- 2022Dual adaptive training of photonic neural networks9 Dec 2022
- 2022Scaling Laws Beyond Backpropagation26 Oct 2022
- 2022Experimentally realized in situ backpropagation for deep learning in nanophotonic neural networks17 May 2022
- 2022Experimentally realized in situ backpropagation for deep learning in nanophotonic neural networkscited by 44
- 2023Brain-inspired Computational Intelligence via Predictive Codingcited by 30
- 2024Self-Contrastive Forward-Forward Algorithmcited by 17
- 2022Dual adaptive training of photonic neural networkscited by 9
- 2023Training neural networks with end-to-end optical backpropagationcited by 7
- 2024A Review of Neuroscience-Inspired Machine Learningcited by 6
- 2022Scaling Laws Beyond Backpropagationcited by 4
- 2023Real-Time FJ/MAC PDE Solvers via Tensorized, Back-Propagation-Free Optical PINN Trainingcited by 4
- 2024Asymmetrical estimator for training encapsulated deep photonic neural networkscited by 3
- 2023Mirage: An RNS-Based Photonic Accelerator for DNN Trainingcited by 2
- 2025Scalable Back-Propagation-Free Training of Optical Physics-Informed Neural Networkscited by 2
- 2024Seamless Optical Cloud Computing across Edge-Metro Network for Generative AIcited by 1
12 most cited of 16 All 16 (JSON)
- 2026Training deep physical neural networks with local physical information bottleneck10 Feb 2026
- 2026Toward all-optical unsupervised Hebbian learning in deep photonic neuromorphic networks29 Jan 2026
- 2025LuxIA: A Lightweight Unitary matriX-based Framework Built on an Iterative Algorithm for Photonic Neural Network Training24 Dec 2025
- 2025Scalable Back-Propagation-Free Training of Optical Physics-Informed Neural Networks17 Feb 2025
- 2024Seamless Optical Cloud Computing across Edge-Metro Network for Generative AI4 Dec 2024
- 2024Self-Contrastive Forward-Forward Algorithm17 Sep 2024
- 2024Asymmetrical estimator for training encapsulated deep photonic neural networks28 May 2024
- 2024Thermal Crosstalk Modelling and Compensation Methods for Programmable Photonic Integrated Circuits19 Mar 2024
- 2024A Review of Neuroscience-Inspired Machine Learning16 Feb 2024
- 2023Real-Time FJ/MAC PDE Solvers via Tensorized, Back-Propagation-Free Optical PINN Training31 Dec 2023
- 2023Mirage: An RNS-Based Photonic Accelerator for DNN Training29 Nov 2023
- 2023Brain-inspired Computational Intelligence via Predictive Coding15 Aug 2023
12 newest of 16 All 16 (JSON)