Local Synaptic Rules Can Implement a SIGReg Gradient Without Backpropagation
Not on the map. Why?
Abstract (arXiv)
We prove that two canonical local synaptic learning rules, the potentiation arm of spike-timing-dependent plasticity (STDP^+) and homeostatic plasticity (instantiated here via flashlight granule-cell-like neurons), together can implement the exact gradient of a SIGReg-like self-supervised learning objective. The equivalence requires no gradient calculations, no global error signals, no weight transport, and no label information: the only inputs are pre- and post-synaptic firing rates, local firing statistics, and the temporal contiguity of natural sensory streams. On a synthetic clustering task designed to probe whether class structure can be recovered from temporal ordering of inputs alone, ordered presentation raised cluster separation (CSR) to 2.49 while random ordering left it near baseline (0.83), a roughly threefold (≈ 3.5σ) separation attributable solely to input ordering. On temporally ordered MNIST, a two-layer network trained entirely with these rules achieved 87.3% linear-probe accuracy, showing that the mechanism functions end-to-end.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 20 references that are in the map. First posted on arXiv 3 Jul 2026.
Builds on
8 of 20 references.
References · 8
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
- 2021VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learningcited by 1,057
- 2022The Forward-Forward Algorithm: Some Preliminary Investigationscited by 266
- 2016Equilibrium Propagation: Bridging the Gap Between Energy-Based Models and Backpropagationcited by 259
- 2025LeJEPA: Provable and Scalable Self-Supervised Learning Without the Heuristicscited by 254
- 2026Weak-SIGReg: Covariance Regularization for Stable Deep Learningcited by 2
- 2026This is how the Neocortex Learnscited by 1
Built on by
Not cited yet.