# Event-Driven Contrastive Divergence for Spiking Neuromorphic Systems

arXiv: https://arxiv.org/abs/1311.0966 · HTML: https://mlsanity.com/paper/1311.0966/

## Key facts

- Cited by 14 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 5 Nov 2013.

## Built on by (most cited first, 14 of 14)

- [SpikE: spike-based embeddings for multi-relational graph data](https://mlsanity.com/paper/2104.13398/) (2021)
- [Spiking Neural Networks and Bio-Inspired Supervised Deep Learning: A Survey](https://mlsanity.com/paper/2307.16235/) (2023)
- [A Review of Neuroscience-Inspired Machine Learning](https://mlsanity.com/paper/2403.18929/) (2024)
- [An optimised deep spiking neural network architecture without gradients](https://mlsanity.com/paper/2109.12813/) (2021)
- [An energy-based model for neuro-symbolic reasoning on knowledge graphs](https://mlsanity.com/paper/2110.01639/) (2021)
- [Deep Unsupervised Learning Using Spike-Timing-Dependent Plasticity](https://mlsanity.com/paper/2307.04054/) (2023)
- [Supervised Training of Siamese Spiking Neural Networks with Earth Mover's Distance](https://mlsanity.com/paper/2203.13207/) (2022)
- [Spike-based computation using classical recurrent neural networks](https://mlsanity.com/paper/2306.03623/) (2023)
- [Spike-based alignment learning solves the weight transport problem](https://mlsanity.com/paper/2503.02642/) (2025)
- [RISC-V Toolchain and Agile Development based Open-source Neuromorphic Processor](https://mlsanity.com/paper/2210.00562/) (2022)
- [Active Inference in Hebbian Learning Networks](https://mlsanity.com/paper/2306.05053/) (2023)
- [Asynchronous Bioplausible Neuron for SNN for Event Vision](https://mlsanity.com/paper/2311.11853/) (2023)
- [Unveiling the Potential of Spiking Dynamics in Graph Representation Learning through Spatial-Temporal Normalization and Coding Strategies](https://mlsanity.com/paper/2407.20508/) (2024)
- [NeuroTrain: Surveying Local Learning Rules for Spiking Neural Networks with an Open Benchmarking Framework](https://mlsanity.com/paper/2605.15058/) (2026)

## Abstract (arXiv)

Restricted Boltzmann Machines (RBMs) and Deep Belief Networks have been demonstrated to perform efficiently in a variety of applications, such as dimensionality reduction, feature learning, and classification. Their implementation on neuromorphic hardware platforms emulating large-scale networks of spiking neurons can have significant advantages from the perspectives of scalability, power dissipation and real-time interfacing with the environment. However the traditional RBM architecture and the commonly used training algorithm known as Contrastive Divergence (CD) are based on discrete updates and exact arithmetics which do not directly map onto a dynamical neural substrate. Here, we present an event-driven variation of CD to train a RBM constructed with Integrate & Fire (I&F) neurons, that is constrained by the limitations of existing and near future neuromorphic hardware platforms. Our strategy is based on neural sampling, which allows us to synthesize a spiking neural network that samples from a target Boltzmann distribution. The recurrent activity of the network replaces the discrete steps of the CD algorithm, while Spike Time Dependent Plasticity (STDP) carries out the weight updates in an online, asynchronous fashion. We demonstrate our approach by training an RBM composed of leaky I&F neurons with STDP synapses to learn a generative model of the MNIST hand-written digit dataset, and by testing it in recognition, generation and cue integration tasks. Our results contribute to a machine learning-driven approach for synthesizing networks of spiking neurons capable of carrying out practical, high-level functionality.
