Closed-Form Feedback-Free Learning with Forward Projection
Not on the map. Why?
Abstract (arXiv)
State-of-the-art backpropagation-free learning methods employ local error feedback to direct iterative optimisation via gradient descent. Here, we examine the more restrictive setting where retrograde communication from neuronal outputs is unavailable for pre-synaptic weight optimisation. We propose Forward Projection (FP), a randomised closed-form training method requiring only a single forward pass over the dataset without retrograde communication. FP generates target values for pre-activation membrane potentials through randomised nonlinear projections of pre-synaptic inputs and labels. Local loss functions are optimised using closed-form regression without feedback from downstream layers. A key advantage is interpretability: membrane potentials in FP-trained networks encode information interpretable layer-wise as label predictions. Across several biomedical datasets, FP achieves generalisation comparable to gradient descent-based local learning methods while requiring only a single forward propagation step, yielding significant training speedup. In few-shot learning tasks, FP produces more generalisable models than backpropagation-optimised alternatives, with local interpretation functions successfully identifying clinically salient diagnostic features.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 18 of its 53 references that are in the map. First posted on arXiv 27 Jan 2025.
Builds on
18 of 53 references.
References · 18
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2022The Forward-Forward Algorithm: Some Preliminary Investigationscited by 262
- 2014Difference Target Propagationcited by 144
- 2019Training Neural Networks with Local Error Signalscited by 135
- 2021Explainable AI (XAI): A Systematic Meta-Survey of Current Challenges and Future Opportunitiescited by 125
- 2019On the Power and Limitations of Random Features for Understanding Neural Networkscited by 103
- 2019Deep Learning without Weight Transportcited by 87
- 2021Predictive Coding: a Theoretical and Experimental Reviewcited by 74
- 2021Revisiting Locally Supervised Learning: an Alternative to End-to-end Trainingcited by 71
- 2022Error-driven Input Modulation: Solving the Credit Assignment Problem without a Backward Passcited by 63
- 2018Biologically Motivated Algorithms for Propagating Local Target Representationscited by 43
6 more
- 2024SpikingResformer: Bridging ResNet and Vision Transformer in Spiking Neural Networkscited by 38
- 2018Deep learning with asymmetric connections and Hebbian updatescited by 16
- 2023Forward Learning with Top-Down Feedback: Empirical and Analytical Characterizationcited by 13
- 2021Biologically Plausible Training Mechanisms for Self-Supervised Learning in Deep Networkscited by 6
- 2024LLS: Local Learning Rule for Deep Neural Networks Inspired by Neural Activity Synchronizationcited by 5
- 2024Baseline Drift Tolerant Signal Encoding for ECG Classification with Deep Learningcited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.