mlsanityData to 14 Oct 2026

Nonlinear Processing with Linear Optics

arXiv 2307.08533 ↗First posted 17 Jul 2023physics.optics cs.AI cs.ETcited by 20

Not on the map. Why?

Abstract (arXiv)

Deep neural networks have achieved remarkable breakthroughs by leveraging multiple layers of data processing to extract hidden representations, albeit at the cost of large electronic computing power. To enhance energy efficiency and speed, the optical implementation of neural networks aims to harness the advantages of optical bandwidth and the energy efficiency of optical interconnections. In the absence of low-power optical nonlinearities, the challenge in the implementation of multilayer optical networks lies in realizing multiple optical layers without resorting to electronic components. In this study, we present a novel framework that uses multiple scattering that is capable of synthesizing programmable linear and nonlinear transformations concurrently at low optical power by leveraging the nonlinear relationship between the scattering potential, represented by data, and the scattered field. Theoretical and experimental investigations show that repeating the data by multiple scattering enables non-linear optical computing at low power continuous wave light. Moreover, we empirically found that scaling of this optical framework follows the power law as in state-of-the-art deep digital networks.

Key facts. Cited by 20 papers in the map (data through 14 Oct 2026). Builds on 14 of its 48 references that are in the map. First posted on arXiv 17 Jul 2023.

Builds on

14 of 48 references.

References · 14

  1. 2020Scaling Laws for Neural Language Modelscited by 6,586
  2. 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,349
  3. 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,446
  4. 2020Scaling Laws for Autoregressive Generative Modelingcited by 522
  5. 2020fastai: A Layered API for Deep Learningcited by 183
  6. 2018All-Optical Machine Learning Using Diffractive Deep Neural Networkscited by 177
  7. 2021Deep physical neural networks enabled by a backpropagation algorithm for arbitrary physical systemscited by 128
  8. 2016Neuromorphic Silicon Photonic Networkscited by 68
  9. 2020Large-scale neuromorphic optoelectronic computing with a reconfigurable diffractive processing unitcited by 65
  10. 2021All-Optical Synthesis of an Arbitrary Linear Transformation Using Diffractive Surfacescited by 24
  11. 2019Theory of neuromorphic computing by waves: machine learning by rogue waves, dispersive shocks, and solitonscited by 19
  12. 2020Scalable Optical Learning Operatorcited by 19
2 more
  1. 2020A complete, parallel and autonomous photonic neural network in a semiconductor multimode lasercited by 6
  2. 2022Nonlinear Optical Data Transformer for Machine Learningcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 5; 2025: 10; 2026: 4.

20 papers.

Sort:

By area:

  1. 2024Training of Physical Neural Networkscited by 49
  2. 2024Quantum Equilibrium Propagation for efficient training of quantum systems based on Onsager reciprocitycited by 9
  3. 2024Optical Generative Modelscited by 8
  4. 2023A universal approximation theorem for nonlinear resistive networkscited by 6
  5. 2025Local Learning Rules for Out-of-Equilibrium Physical Generative Modelscited by 4
  6. 2025Nonlinear Computation with Linear Optics via Source-Position Encodingcited by 2
  7. 2025Model-free Optical Processors using In Situ Reinforcement Learning with Proximal Policy Optimizationcited by 2
  8. 2025Programmable k-local Ising interactions and shallow optical Kolmogorov--Arnold networks through repeated data encounterscited by 2
  9. 2025Low-rank surrogate modeling and stochastic zero-order optimization for training of neural networks with black-box layerscited by 1
  10. 2026Physical Foundation Models: Fixed hardware implementations of large-scale neural networkscited by 1
  11. 2024Metasurface-generated large and arbitrary analog convolution kernels for accelerated machine visioncited by 0
  12. 2024Exploring Structural Nonlinearity in Binary Polariton-Based Neuromorphic Architecturescited by 0
8 more
  1. 2025Programmable metasurfaces for future photonic artificial intelligencecited by 0
  2. 2025Machine Intelligence on Wireless Edge Networkscited by 0
  3. 2025Universality of physical neural networks with multivariate nonlinearitycited by 0
  4. 2025Meta-training of diffractive meta-neural networks for super-resolution direction of arrival estimationcited by 0
  5. 2025Spatially Parallel All-optical Neural Networkscited by 0
  6. 2026Laser interferometry as a robust neuromorphic platform for machine learningcited by 0
  7. 2026Pre-training Enables Extraordinary All-optical Image Denoisingcited by 0
  8. 2026RAOA: Alternating-Operator Neural Computation with Programmable Radio Propagationcited by 0