Training Large-Scale Optical Neural Networks with Two-Pass Forward Propagation
Not on the map. Why?
Abstract (arXiv)
This paper addresses the limitations in Optical Neural Networks (ONNs) related to training efficiency, nonlinear function implementation, and large input data processing. We introduce Two-Pass Forward Propagation, a novel training method that avoids specific nonlinear activation functions by modulating and re-entering error with random noise. Additionally, we propose a new way to implement convolutional neural networks using simple neural networks in integrated optical systems. Theoretical foundations and numerical results demonstrate significant improvements in training speed, energy efficiency, and scalability, advancing the potential of optical computing for complex data tasks.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 8 of its 16 references that are in the map. First posted on arXiv 15 Aug 2024.
Builds on
8 of 16 references.
References · 8
- 2023A Survey on Evaluation of Large Language Modelscited by 1,227
- 2022The Forward-Forward Algorithm: Some Preliminary Investigationscited by 262
- 2022Error-driven Input Modulation: Solving the Credit Assignment Problem without a Backward Passcited by 63
- 2018Training of photonic neural networks through in situ backpropagationcited by 45
- 2023Forward-Forward Training of an Optical Neural Networkcited by 19
- 2019Backpropagation through nonlinear units for all-optical training of neural networkscited by 2
- 2023TACNET: Temporal Audio Source Counting Networkcited by 2
- 2023Free-Space Optical Spiking Neural Networkcited by 1
Built on by
Not cited yet.