mlsanityData to 7 Oct 2026

Adaptive Multi-Scale Goodness Aggregation for Forward-Forward Learning

arXiv 2605.18804 ↗First posted 11 May 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

We propose Adaptive Multi-Scale Goodness Aggregation (AMSGA), a novel extension of the Forward-Forward (FF) algorithm designed to improve stability, robustness, and generalization in local-learning neural networks. AMSGA addresses several limitations of the original FF framework by introducing multi-scale goodness aggregation across local, intermediate, and global representations; adaptive curriculum-guided hard negative mining; layer-dependent adaptive thresholds; and a warm-up cosine annealing learning-rate schedule for improved optimization stability. Together, these modifications strengthen the FF paradigm while preserving its biologically plausible and memory-efficient properties. Experiments on MNIST and Fashion-MNIST demonstrate consistent performance improvements over the baseline FF algorithm, achieving up to +1.45% improvement on MNIST and +1.50% improvement on Fashion-MNIST without significant computational overhead. Our results suggest that local learning methods can become substantially more competitive when goodness estimation and training dynamics are carefully designed.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 35 references that are in the map. First posted on arXiv 11 May 2026.

Builds on

15 of 35 references.

References · 15

  1. 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,283
  2. 2017Recent Trends in Deep Learning Based Natural Language Processingcited by 262
  3. 2022The Forward-Forward Algorithm: Some Preliminary Investigationscited by 262
  4. 2016Direct Feedback Alignment Provides Learning in Deep Neural Networkscited by 240
  5. 2016Towards an integration of deep learning and neurosciencecited by 77
  6. 2016Towards deep learning with segregated dendritescited by 71
  7. 2014Scalable, High-Quality Object Detectioncited by 11
  8. 2023SMOOT: Saliency Guided Mask Optimized Online Trainingcited by 8
  9. 2024FFCL: Forward-Forward Net with Cortical Loops, Training and Inference on Edge Without Backpropagationcited by 6
  10. 2024Novel Saliency Analysis for the Forward Forward Algorithmcited by 4
  11. 2024Saliency Assisted Quantization for Neural Networkscited by 4
  12. 2024Quantized and Interpretable Learning Scheme for Deep Neural Networks in Classification Taskcited by 4
3 more
  1. 2025Enhancing Polyp Segmentation via Encoder Attention and Dynamic Kernel Updatecited by 2
  2. 2025Resource-efficient medical image classification for edge devicescited by 1
  3. 2025NetworkFF: Unified Layer Optimization in Forward-Only Neural Networkscited by 1

Built on by

Not cited yet.