mlsanityData to 14 Oct 2026

Forward-Only Convolutional Neural Networks with Learnable Channel-Class Assignment

arXiv 2606.09928 ↗First posted 7 Jun 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

The Forward-Forward (FF) algorithm offers a biologically inspired alternative to backpropagation by replacing gradient-based credit assignment with local, forward-only objectives. While recent extensions have adapted FF to convolutional neural networks (CNNs), existing formulations rely on static channel-class partitions and struggle to perform effectively in complex tasks. In this work, we introduce a learnable channel-class assignment mechanism that enables adaptive, data-driven specialization of convolutional channels, supported by entropy and orthogonality regularization to promote learning performance. We further propose a loss-aware layer contribution strategy that adaptively weights intermediate-layer predictions based on their validation performance, enhancing the effectiveness of forward-only inference. Integrated into residual CNNs, the proposed method achieves consistently superior performance across CIFAR-10, CIFAR-100, and Tiny-ImageNet compared to existing similar forward-only methods. Notably, it establishes new state-of-the-art performance among FF-based models, substantially narrowing the gap with backpropagation. These findings demonstrate that introducing learnable channel specialization and layer contribution weighting significantly enhances the representational capacity of forward-only learning in deep CNNs.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 26 of its 43 references that are in the map. First posted on arXiv 7 Jun 2026.

Builds on

26 of 43 references.

References · 26

  1. 2017Attention Is All You Needcited by 60,361
  2. 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,349
  3. 2016Instance Normalization: The Missing Ingredient for Fast Stylizationcited by 1,198
  4. 2022The Forward-Forward Algorithm: Some Preliminary Investigationscited by 266
  5. 2016Direct Feedback Alignment Provides Learning in Deep Neural Networkscited by 240
  6. 2014Difference Target Propagationcited by 148
  7. 2016Decoupled Neural Interfaces using Synthetic Gradientscited by 137
  8. 2018Assessing the Scalability of Biologically-Motivated Deep Learning Algorithms and Architecturescited by 101
  9. 2019Deep Learning without Weight Transportcited by 87
  10. 2019Decoupled Greedy Learning of CNNscited by 78
  11. 2022Error-driven Input Modulation: Solving the Credit Assignment Problem without a Backward Passcited by 63
  12. 2018Decoupled Parallel Backpropagation with Convergence Guaranteecited by 39
14 more
  1. 2017Understanding Synthetic Gradients and Decoupled Neural Interfacescited by 35
  2. 2023The Predictive Forward-Forward Algorithmcited by 35
  3. 2023Understanding Why ViT Trains Badly on Small Datasets: An Intuitive Perspectivecited by 28
  4. 2023SymBa: Symmetric Backpropagation-Free Contrastive Learning with Forward-Forward Algorithm for Optimizing Convergencecited by 28
  5. 2023Convolutional Channel-wise Competitive Learning for the Forward-Forward Algorithmcited by 25
  6. 2023Contrastive-Signal-Dependent Plasticity: Self-Supervised Learning in Spiking Neural Circuitscited by 10
  7. 2023A theory for the sparsity emerged in the Forward Forward algorithmcited by 7
  8. 2024HPFF: Hierarchical Locally Supervised Learning with Patch Feature Fusioncited by 5
  9. 2025Backpropagation-free Spiking Neural Networks with the Forward-Forward Algorithmcited by 5
  10. 2023Feed-Forward Optimization With Delayed Feedback for Neural Network Trainingcited by 3
  11. 2023Unlocking Deep Learning: A BP-Free Approach for Parallel Block-Wise Training of Neural Networkscited by 3
  12. 2024Forward-Forward Learning achieves Highly Selective Latent Representations for Out-of-Distribution Detection in Fully Spiking Neural Networkscited by 3
  13. 2024Emerging NeoHebbian Dynamics in Forward-Forward Learning: Implications for Neuromorphic Computingcited by 1
  14. 2024Deep Companion Learning: Enhancing Generalization Through Historical Consistencycited by 1

Built on by

Not cited yet.