mlsanityData to 14 Oct 2026

Local learning for stable backpropagation-free neural network training towards physical learning

arXiv 2603.24790 ↗First posted 25 Mar 2026cs.LG cs.CEcited by 1

Not on the map. Why?

Abstract (arXiv)

While backpropagation and automatic differentiation have driven deep learning's success, the physical limits of chip manufacturing and rising environmental costs of deep learning motivate alternative learning paradigms such as physical neural networks. However, most existing physical neural networks still rely on digital computing for training, largely because backpropagation and automatic differentiation are difficult to realize in physical systems. We introduce FFzero, a forward-only learning framework enabling stable neural network training without backpropagation or automatic differentiation. FFzero combines layer-wise local learning, prototype-based representations, and directional-derivative-based optimization through forward evaluations only. We show that local learning is effective under forward-only optimization, where backpropagation fails. FFzero generalizes to multilayer perceptron and convolutional neural networks across classification and regression. Using a simulated photonic neural network as an example, we demonstrate that FFzero provides a viable path toward backpropagation-free in-situ physical learning.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 25 of its 60 references that are in the map. First posted on arXiv 25 Mar 2026.

Builds on

25 of 60 references.

References · 25

  1. 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,349
  2. 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,254
  3. 2022The Forward-Forward Algorithm: Some Preliminary Investigationscited by 266
  4. 2016Direct Feedback Alignment Provides Learning in Deep Neural Networkscited by 240
  5. 2021Deep physical neural networks enabled by a backpropagation algorithm for arbitrary physical systemscited by 128
  6. 2019Hyperspherical Prototype Networkscited by 86
  7. 2022Gradients without Backpropagationcited by 73
  8. 2016Neuromorphic Silicon Photonic Networkscited by 68
  9. 2022Scaling Forward Gradient With Local Lossescited by 65
  10. 2022Hebbian Deep Learning Without Feedbackcited by 61
  11. 2020Physical reservoir computing -- An introductory perspectivecited by 58
  12. 2024Training of Physical Neural Networkscited by 49
13 more
  1. 2022Experimentally realized in situ backpropagation for deep learning in nanophotonic neural networkscited by 44
  2. 2022Holomorphic Equilibrium Propagation Computes Exact Gradients Through Finite Size Oscillationscited by 42
  3. 2023Backpropagation-free Training of Deep Physical Neural Networkscited by 42
  4. 2023Training an Ising Machine with Equilibrium Propagationcited by 29
  5. 2022Maximum Class Separation as Inductive Bias in One Matrixcited by 21
  6. 2019Reprogrammable Electro-Optic Nonlinear Activation Functions for Optical Neural Networkscited by 19
  7. 2024Self-Contrastive Forward-Forward Algorithmcited by 17
  8. 2023Watt For What: Rethinking Deep Learning's Energy-Performance Relationshipcited by 16
  9. 2023Training Convolutional Neural Networks with the Forward-Forward algorithmcited by 14
  10. 2018Matrix optimization on universal unitary photonic devicescited by 5
  11. 2021Hierarchical Architectures in Reservoir Computing Systemscited by 5
  12. 2019Parallel fault-tolerant programming of an arbitrary feedforward photonic networkcited by 4
  13. 2025Function regression using the forward forward training and inferring paradigmcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.