mlsanityData to 14 Oct 2026

Adaptive Spatial Goodness Encoding: Advancing and Scaling Forward-Forward Learning Without Backpropagation

arXiv 2509.12394 ↗First posted 15 Sep 2025cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

The Forward-Forward (FF) algorithm offers a promising alternative to backpropagation (BP). Despite advancements in recent FF-based extensions, which have enhanced the original algorithm and adapted it to convolutional neural networks (CNNs), they often suffer from limited representational capacity and poor scalability to large-scale datasets, primarily due to exploding channel dimensionality. In this work, we propose adaptive spatial goodness encoding (ASGE), a new FF-based training framework tailored for CNNs. ASGE leverages feature maps to compute spatially-aware goodness representations at each layer, enabling layer-wise supervision. Crucially, this approach decouples classification complexity from channel dimensionality, thereby addressing the issue of channel explosion and achieving competitive performance compared to other BP alternatives. ASGE outperforms all other FF-based approaches across multiple benchmarks, delivering test accuracies of 99.65% on MNIST, 93.41% on FashionMNIST, 90.62% on CIFAR-10, and 65.42% on CIFAR-100. Moreover, we present the first successful application of FF-based training to ImageNet, with Top-1 and Top-5 accuracies of 51.58% and 75.23%. Furthermore, we propose three prediction strategies to achieve flexible trade-offs among accuracy, parameters and memory usage, enabling deployment under diverse resource constraints.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 23 of its 42 references that are in the map. First posted on arXiv 15 Sep 2025.

Builds on

23 of 42 references.

References · 23

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  4. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
  5. 2022Generative Adversarial Networkscited by 5,627
  6. 2022The Forward-Forward Algorithm: Some Preliminary Investigationscited by 266
  7. 2016Direct Feedback Alignment Provides Learning in Deep Neural Networkscited by 240
  8. 2019Training Neural Networks with Local Error Signalscited by 136
  9. 2018Greedy Layerwise Learning Can Scale to ImageNetcited by 115
  10. 2018Assessing the Scalability of Biologically-Motivated Deep Learning Algorithms and Architecturescited by 101
  11. 2014How Auto-Encoders Could Provide Credit Assignment in Deep Networks via Target Propagationcited by 79
  12. 2022Error-driven Input Modulation: Solving the Credit Assignment Problem without a Backward Passcited by 63
11 more
  1. 2017Understanding Synthetic Gradients and Decoupled Neural Interfacescited by 35
  2. 2022Towards Scaling Difference Target Propagation by Learning Backprop Targetscited by 34
  3. 2013Learned-Norm Pooling for Deep Feedforward and Recurrent Neural Networkscited by 32
  4. 2021SoftHebb: Bayesian Inference in Unsupervised Hebbian Soft Winner-Take-All Networkscited by 30
  5. 2023SymBa: Symmetric Backpropagation-Free Contrastive Learning with Forward-Forward Algorithm for Optimizing Convergencecited by 28
  6. 2019Direct Feedback Alignment with Sparse Connections for Local Learningcited by 26
  7. 2023Convolutional Channel-wise Competitive Learning for the Forward-Forward Algorithmcited by 25
  8. 2023Layer Collaboration in the Forward-Forward Algorithmcited by 21
  9. 2023Training Convolutional Neural Networks with the Forward-Forward algorithmcited by 14
  10. 2024LLS: Local Learning Rule for Deep Neural Networks Inspired by Neural Activity Synchronizationcited by 5
  11. 2024A Contrastive Symmetric Forward-Forward Algorithm (SFFA) for Continual Learning Taskscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.