Adaptive Spatial Goodness Encoding: Advancing and Scaling Forward-Forward Learning Without Backpropagation
Not on the map. Why?
Abstract (arXiv)
The Forward-Forward (FF) algorithm offers a promising alternative to backpropagation (BP). Despite advancements in recent FF-based extensions, which have enhanced the original algorithm and adapted it to convolutional neural networks (CNNs), they often suffer from limited representational capacity and poor scalability to large-scale datasets, primarily due to exploding channel dimensionality. In this work, we propose adaptive spatial goodness encoding (ASGE), a new FF-based training framework tailored for CNNs. ASGE leverages feature maps to compute spatially-aware goodness representations at each layer, enabling layer-wise supervision. Crucially, this approach decouples classification complexity from channel dimensionality, thereby addressing the issue of channel explosion and achieving competitive performance compared to other BP alternatives. ASGE outperforms all other FF-based approaches across multiple benchmarks, delivering test accuracies of 99.65% on MNIST, 93.41% on FashionMNIST, 90.62% on CIFAR-10, and 65.42% on CIFAR-100. Moreover, we present the first successful application of FF-based training to ImageNet, with Top-1 and Top-5 accuracies of 51.58% and 75.23%. Furthermore, we propose three prediction strategies to achieve flexible trade-offs among accuracy, parameters and memory usage, enabling deployment under diverse resource constraints.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 23 of its 42 references that are in the map. First posted on arXiv 15 Sep 2025.
Builds on
23 of 42 references.
References · 23
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2022Generative Adversarial Networkscited by 5,627
- 2022The Forward-Forward Algorithm: Some Preliminary Investigationscited by 266
- 2016Direct Feedback Alignment Provides Learning in Deep Neural Networkscited by 240
- 2019Training Neural Networks with Local Error Signalscited by 136
- 2018Greedy Layerwise Learning Can Scale to ImageNetcited by 115
- 2018Assessing the Scalability of Biologically-Motivated Deep Learning Algorithms and Architecturescited by 101
- 2014How Auto-Encoders Could Provide Credit Assignment in Deep Networks via Target Propagationcited by 79
- 2022Error-driven Input Modulation: Solving the Credit Assignment Problem without a Backward Passcited by 63
11 more
- 2017Understanding Synthetic Gradients and Decoupled Neural Interfacescited by 35
- 2022Towards Scaling Difference Target Propagation by Learning Backprop Targetscited by 34
- 2013Learned-Norm Pooling for Deep Feedforward and Recurrent Neural Networkscited by 32
- 2021SoftHebb: Bayesian Inference in Unsupervised Hebbian Soft Winner-Take-All Networkscited by 30
- 2023SymBa: Symmetric Backpropagation-Free Contrastive Learning with Forward-Forward Algorithm for Optimizing Convergencecited by 28
- 2019Direct Feedback Alignment with Sparse Connections for Local Learningcited by 26
- 2023Convolutional Channel-wise Competitive Learning for the Forward-Forward Algorithmcited by 25
- 2023Layer Collaboration in the Forward-Forward Algorithmcited by 21
- 2023Training Convolutional Neural Networks with the Forward-Forward algorithmcited by 14
- 2024LLS: Local Learning Rule for Deep Neural Networks Inspired by Neural Activity Synchronizationcited by 5
- 2024A Contrastive Symmetric Forward-Forward Algorithm (SFFA) for Continual Learning Taskscited by 2
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Cumulative-Goodness Free-Riding in Forward-Forward Networks: Real, Repairable, but Not Accuracy-Dominantcited by 0
- 2026Synthetic Benchmarks Overstate Forward-Forward Scaling: Real-Data Limits of Layer-Local Trainingcited by 0
- 2026Rescuing Points Trapped Inside Incorrect Decision Regions: A target for Evaluating and Improving Forward-Forward Learningcited by 0
- 2026Rescuing Points Trapped Inside Incorrect Decision Regions: A target for Evaluating and Improving Forward-Forward Learning12 Oct 2026
- 2026Synthetic Benchmarks Overstate Forward-Forward Scaling: Real-Data Limits of Layer-Local Training4 Jun 2026
- 2026Cumulative-Goodness Free-Riding in Forward-Forward Networks: Real, Repairable, but Not Accuracy-Dominant7 May 2026