HCL-FF: Hierarchical and Contrastive Learning for Forward-Forward Algorithm
Not on the map. Why?
Abstract (arXiv)
Deep neural networks trained with backpropagation have achieved outstanding performance in vision tasks but remain biologically implausible, computationally demanding, and difficult to interpret. The Forward-Forward (FF) algorithm offers a promising alternative by training each layer independently through local goodness objectives. However, its purely local optimization lacks hierarchical coordination across layers, and the decoupling of goodness from features leaves the representations unconstrained and semantically ambiguous. We propose a Hierarchical and Contrastive Learning FF framework (HCL-FF) to address these limitations. HCL-FF introduces (1) a coarse-to-fine hierarchical learning strategy that guides representations from low-level cues to high-level semantics, and (2) a supervised contrastive objective that enforces class-discriminative alignment after goodness decoupling. Experiments on CIFAR-10, CIFAR-100, and Tiny-ImageNet demonstrate that HCL-FF achieves new state-of-the-art performance among FF-based methods, with notable accuracy gains of +5.46%, +17.00%, and +12.51%, respectively.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 37 of its 57 references that are in the map. First posted on arXiv 24 May 2026.
Builds on
37 of 57 references.
References · 37
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
- 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,349
- 2020Supervised Contrastive Learningcited by 2,829
- 2018CosFace: Large Margin Cosine Loss for Deep Face Recognitioncited by 971
- 2017SphereFace: Deep Hypersphere Embedding for Face Recognitioncited by 737
- 2022The Forward-Forward Algorithm: Some Preliminary Investigationscited by 266
- 2016Direct Feedback Alignment Provides Learning in Deep Neural Networkscited by 240
- 2017NormFace: L2 Hypersphere Embedding for Face Verificationcited by 237
- 2014Difference Target Propagationcited by 148
- 2016Decoupled Neural Interfaces using Synthetic Gradientscited by 137
- 2018Assessing the Scalability of Biologically-Motivated Deep Learning Algorithms and Architecturescited by 101
25 more
- 2019Deep Learning without Weight Transportcited by 87
- 2014How Auto-Encoders Could Provide Credit Assignment in Deep Networks via Target Propagationcited by 79
- 2022Error-driven Input Modulation: Solving the Credit Assignment Problem without a Backward Passcited by 63
- 2022Hebbian Deep Learning Without Feedbackcited by 61
- 2020NBDT: Neural-Backed Decision Treescited by 46
- 2018Biologically Motivated Algorithms for Propagating Local Target Representationscited by 43
- 2023The Predictive Forward-Forward Algorithmcited by 35
- 2022Towards Scaling Difference Target Propagation by Learning Backprop Targetscited by 34
- 2021SoftHebb: Bayesian Inference in Unsupervised Hebbian Soft Winner-Take-All Networkscited by 30
- 2023SymBa: Symmetric Backpropagation-Free Contrastive Learning with Forward-Forward Algorithm for Optimizing Convergencecited by 28
- 2023Convolutional Channel-wise Competitive Learning for the Forward-Forward Algorithmcited by 25
- 2022Signal Propagation: A Framework for Learning and Inference In a Forward Passcited by 24
- 2019Principled Training of Neural Networks with Direct Feedback Alignmentcited by 23
- 2023Layer Collaboration in the Forward-Forward Algorithmcited by 21
- 2021Hebbian Semi-Supervised Learning in a Sample Efficiency Settingcited by 19
- 2021Hebbian learning with gradients: Hebbian convolutional neural networks with modern deep learning frameworkscited by 19
- 2023The Cascaded Forward Algorithm for Neural Network Trainingcited by 17
- 2024Self-Contrastive Forward-Forward Algorithmcited by 17
- 2023Brain-Inspired Machine Intelligence: A Survey of Neurobiologically-Plausible Credit Assignmentcited by 15
- 2023Training Convolutional Neural Networks with the Forward-Forward algorithmcited by 14
- 2023Forward Learning with Top-Down Feedback: Empirical and Analytical Characterizationcited by 13
- 2023The Trifecta: Three simple techniques for training deeper Forward-Forward networkscited by 12
- 2023Graph Neural Networks Go Forward-Forwardcited by 8
- 2023Forward-Forward Contrastive Learningcited by 5
- 2023Forward-Forward Algorithm for Hyperspectral Image Classification: A Preliminary Studycited by 5
Built on by
Citing papers per year: 2026: 2.
2 papers.