Nonlinear Processing with Linear Optics
Not on the map. Why?
Abstract (arXiv)
Deep neural networks have achieved remarkable breakthroughs by leveraging multiple layers of data processing to extract hidden representations, albeit at the cost of large electronic computing power. To enhance energy efficiency and speed, the optical implementation of neural networks aims to harness the advantages of optical bandwidth and the energy efficiency of optical interconnections. In the absence of low-power optical nonlinearities, the challenge in the implementation of multilayer optical networks lies in realizing multiple optical layers without resorting to electronic components. In this study, we present a novel framework that uses multiple scattering that is capable of synthesizing programmable linear and nonlinear transformations concurrently at low optical power by leveraging the nonlinear relationship between the scattering potential, represented by data, and the scattered field. Theoretical and experimental investigations show that repeating the data by multiple scattering enables non-linear optical computing at low power continuous wave light. Moreover, we empirically found that scaling of this optical framework follows the power law as in state-of-the-art deep digital networks.
Key facts. Cited by 20 papers in the map (data through 14 Oct 2026). Builds on 14 of its 48 references that are in the map. First posted on arXiv 17 Jul 2023.
Builds on
14 of 48 references.
References · 14
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,349
- 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,446
- 2020Scaling Laws for Autoregressive Generative Modelingcited by 522
- 2020fastai: A Layered API for Deep Learningcited by 183
- 2018All-Optical Machine Learning Using Diffractive Deep Neural Networkscited by 177
- 2021Deep physical neural networks enabled by a backpropagation algorithm for arbitrary physical systemscited by 128
- 2016Neuromorphic Silicon Photonic Networkscited by 68
- 2020Large-scale neuromorphic optoelectronic computing with a reconfigurable diffractive processing unitcited by 65
- 2021All-Optical Synthesis of an Arbitrary Linear Transformation Using Diffractive Surfacescited by 24
- 2019Theory of neuromorphic computing by waves: machine learning by rogue waves, dispersive shocks, and solitonscited by 19
- 2020Scalable Optical Learning Operatorcited by 19
Built on by
Citing papers per year: 2023: 1; 2024: 5; 2025: 10; 2026: 4.
20 papers.
Sort:
By area:
- 2024Training of Physical Neural Networkscited by 49
- 2024Quantum Equilibrium Propagation for efficient training of quantum systems based on Onsager reciprocitycited by 9
- 2024Optical Generative Modelscited by 8
- 2023A universal approximation theorem for nonlinear resistive networkscited by 6
- 2025Local Learning Rules for Out-of-Equilibrium Physical Generative Modelscited by 4
- 2025Nonlinear Computation with Linear Optics via Source-Position Encodingcited by 2
- 2025Model-free Optical Processors using In Situ Reinforcement Learning with Proximal Policy Optimizationcited by 2
- 2025Programmable k-local Ising interactions and shallow optical Kolmogorov--Arnold networks through repeated data encounterscited by 2
- 2025Low-rank surrogate modeling and stochastic zero-order optimization for training of neural networks with black-box layerscited by 1
- 2026Physical Foundation Models: Fixed hardware implementations of large-scale neural networkscited by 1
- 2024Metasurface-generated large and arbitrary analog convolution kernels for accelerated machine visioncited by 0
- 2024Exploring Structural Nonlinearity in Binary Polariton-Based Neuromorphic Architecturescited by 0
8 more
- 2025Programmable metasurfaces for future photonic artificial intelligencecited by 0
- 2025Machine Intelligence on Wireless Edge Networkscited by 0
- 2025Universality of physical neural networks with multivariate nonlinearitycited by 0
- 2025Meta-training of diffractive meta-neural networks for super-resolution direction of arrival estimationcited by 0
- 2025Spatially Parallel All-optical Neural Networkscited by 0
- 2026Laser interferometry as a robust neuromorphic platform for machine learningcited by 0
- 2026Pre-training Enables Extraordinary All-optical Image Denoisingcited by 0
- 2026RAOA: Alternating-Operator Neural Computation with Programmable Radio Propagationcited by 0
- 2026RAOA: Alternating-Operator Neural Computation with Programmable Radio Propagation2 Oct 2026
- 2026Pre-training Enables Extraordinary All-optical Image Denoising8 May 2026
- 2026Physical Foundation Models: Fixed hardware implementations of large-scale neural networks30 Apr 2026
- 2026Laser interferometry as a robust neuromorphic platform for machine learning26 Jan 2026
- 2025Spatially Parallel All-optical Neural Networks28 Sep 2025
- 2025Low-rank surrogate modeling and stochastic zero-order optimization for training of neural networks with black-box layers18 Sep 2025
- 2025Meta-training of diffractive meta-neural networks for super-resolution direction of arrival estimation7 Sep 2025
- 2025Universality of physical neural networks with multivariate nonlinearity6 Sep 2025
- 2025Programmable k-local Ising interactions and shallow optical Kolmogorov--Arnold networks through repeated data encounters24 Aug 2025
- 2025Model-free Optical Processors using In Situ Reinforcement Learning with Proximal Policy Optimization8 Jul 2025
- 2025Local Learning Rules for Out-of-Equilibrium Physical Generative Models23 Jun 2025
- 2025Machine Intelligence on Wireless Edge Networks13 Jun 2025
8 more
- 2025Programmable metasurfaces for future photonic artificial intelligence16 May 2025
- 2025Nonlinear Computation with Linear Optics via Source-Position Encoding29 Apr 2025
- 2024Exploring Structural Nonlinearity in Binary Polariton-Based Neuromorphic Architectures9 Nov 2024
- 2024Optical Generative Models23 Oct 2024
- 2024Metasurface-generated large and arbitrary analog convolution kernels for accelerated machine vision27 Sep 2024
- 2024Quantum Equilibrium Propagation for efficient training of quantum systems based on Onsager reciprocity10 Jun 2024
- 2024Training of Physical Neural Networks5 Jun 2024
- 2023A universal approximation theorem for nonlinear resistive networks22 Dec 2023
- 2024Training of Physical Neural Networkscited by 49
- 2024Quantum Equilibrium Propagation for efficient training of quantum systems based on Onsager reciprocitycited by 9
- 2024Optical Generative Modelscited by 8
- 2023A universal approximation theorem for nonlinear resistive networkscited by 6
- 2025Nonlinear Computation with Linear Optics via Source-Position Encodingcited by 2
- 2025Programmable k-local Ising interactions and shallow optical Kolmogorov--Arnold networks through repeated data encounterscited by 2
- 2025Low-rank surrogate modeling and stochastic zero-order optimization for training of neural networks with black-box layerscited by 1
- 2026Physical Foundation Models: Fixed hardware implementations of large-scale neural networkscited by 1
- 2024Metasurface-generated large and arbitrary analog convolution kernels for accelerated machine visioncited by 0
- 2024Exploring Structural Nonlinearity in Binary Polariton-Based Neuromorphic Architecturescited by 0
- 2025Programmable metasurfaces for future photonic artificial intelligencecited by 0
- 2025Machine Intelligence on Wireless Edge Networkscited by 0
12 most cited of 18 All 18 (JSON)
- 2026RAOA: Alternating-Operator Neural Computation with Programmable Radio Propagation2 Oct 2026
- 2026Pre-training Enables Extraordinary All-optical Image Denoising8 May 2026
- 2026Physical Foundation Models: Fixed hardware implementations of large-scale neural networks30 Apr 2026
- 2026Laser interferometry as a robust neuromorphic platform for machine learning26 Jan 2026
- 2025Spatially Parallel All-optical Neural Networks28 Sep 2025
- 2025Low-rank surrogate modeling and stochastic zero-order optimization for training of neural networks with black-box layers18 Sep 2025
- 2025Meta-training of diffractive meta-neural networks for super-resolution direction of arrival estimation7 Sep 2025
- 2025Universality of physical neural networks with multivariate nonlinearity6 Sep 2025
- 2025Programmable k-local Ising interactions and shallow optical Kolmogorov--Arnold networks through repeated data encounters24 Aug 2025
- 2025Machine Intelligence on Wireless Edge Networks13 Jun 2025
- 2025Programmable metasurfaces for future photonic artificial intelligence16 May 2025
- 2025Nonlinear Computation with Linear Optics via Source-Position Encoding29 Apr 2025
12 newest of 18 All 18 (JSON)