mlsanityData to 14 Oct 2026

HCL-FF: Hierarchical and Contrastive Learning for Forward-Forward Algorithm

arXiv 2605.24797 ↗First posted 24 May 2026cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Deep neural networks trained with backpropagation have achieved outstanding performance in vision tasks but remain biologically implausible, computationally demanding, and difficult to interpret. The Forward-Forward (FF) algorithm offers a promising alternative by training each layer independently through local goodness objectives. However, its purely local optimization lacks hierarchical coordination across layers, and the decoupling of goodness from features leaves the representations unconstrained and semantically ambiguous. We propose a Hierarchical and Contrastive Learning FF framework (HCL-FF) to address these limitations. HCL-FF introduces (1) a coarse-to-fine hierarchical learning strategy that guides representations from low-level cues to high-level semantics, and (2) a supervised contrastive objective that enforces class-discriminative alignment after goodness decoupling. Experiments on CIFAR-10, CIFAR-100, and Tiny-ImageNet demonstrate that HCL-FF achieves new state-of-the-art performance among FF-based methods, with notable accuracy gains of +5.46%, +17.00%, and +12.51%, respectively.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 37 of its 57 references that are in the map. First posted on arXiv 24 May 2026.

Builds on

37 of 57 references.

References · 37

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
  3. 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,349
  4. 2020Supervised Contrastive Learningcited by 2,829
  5. 2018CosFace: Large Margin Cosine Loss for Deep Face Recognitioncited by 971
  6. 2017SphereFace: Deep Hypersphere Embedding for Face Recognitioncited by 737
  7. 2022The Forward-Forward Algorithm: Some Preliminary Investigationscited by 266
  8. 2016Direct Feedback Alignment Provides Learning in Deep Neural Networkscited by 240
  9. 2017NormFace: L2 Hypersphere Embedding for Face Verificationcited by 237
  10. 2014Difference Target Propagationcited by 148
  11. 2016Decoupled Neural Interfaces using Synthetic Gradientscited by 137
  12. 2018Assessing the Scalability of Biologically-Motivated Deep Learning Algorithms and Architecturescited by 101
25 more
  1. 2019Deep Learning without Weight Transportcited by 87
  2. 2014How Auto-Encoders Could Provide Credit Assignment in Deep Networks via Target Propagationcited by 79
  3. 2022Error-driven Input Modulation: Solving the Credit Assignment Problem without a Backward Passcited by 63
  4. 2022Hebbian Deep Learning Without Feedbackcited by 61
  5. 2020NBDT: Neural-Backed Decision Treescited by 46
  6. 2018Biologically Motivated Algorithms for Propagating Local Target Representationscited by 43
  7. 2023The Predictive Forward-Forward Algorithmcited by 35
  8. 2022Towards Scaling Difference Target Propagation by Learning Backprop Targetscited by 34
  9. 2021SoftHebb: Bayesian Inference in Unsupervised Hebbian Soft Winner-Take-All Networkscited by 30
  10. 2023SymBa: Symmetric Backpropagation-Free Contrastive Learning with Forward-Forward Algorithm for Optimizing Convergencecited by 28
  11. 2023Convolutional Channel-wise Competitive Learning for the Forward-Forward Algorithmcited by 25
  12. 2022Signal Propagation: A Framework for Learning and Inference In a Forward Passcited by 24
  13. 2019Principled Training of Neural Networks with Direct Feedback Alignmentcited by 23
  14. 2023Layer Collaboration in the Forward-Forward Algorithmcited by 21
  15. 2021Hebbian Semi-Supervised Learning in a Sample Efficiency Settingcited by 19
  16. 2021Hebbian learning with gradients: Hebbian convolutional neural networks with modern deep learning frameworkscited by 19
  17. 2023The Cascaded Forward Algorithm for Neural Network Trainingcited by 17
  18. 2024Self-Contrastive Forward-Forward Algorithmcited by 17
  19. 2023Brain-Inspired Machine Intelligence: A Survey of Neurobiologically-Plausible Credit Assignmentcited by 15
  20. 2023Training Convolutional Neural Networks with the Forward-Forward algorithmcited by 14
  21. 2023Forward Learning with Top-Down Feedback: Empirical and Analytical Characterizationcited by 13
  22. 2023The Trifecta: Three simple techniques for training deeper Forward-Forward networkscited by 12
  23. 2023Graph Neural Networks Go Forward-Forwardcited by 8
  24. 2023Forward-Forward Contrastive Learningcited by 5
  25. 2023Forward-Forward Algorithm for Hyperspectral Image Classification: A Preliminary Studycited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.