# Variation-aware Binarized Memristive Networks

arXiv: https://arxiv.org/abs/1910.05920 · HTML: https://mlsanity.com/paper/1910.05920/

## Key facts

- Cited by 4 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 14 Oct 2019.

## Built on by (most cited first, 4 of 4)

- [Memristive Stochastic Computing for Deep Learning Parameter Optimization](https://mlsanity.com/paper/2103.06506/) (2021)
- [A Bop and Beyond: A Second Order Optimizer for Binarized Neural Networks](https://mlsanity.com/paper/2104.05124/) (2021)
- [Seizure Detection and Prediction by Parallel Memristive Convolutional Neural Networks](https://mlsanity.com/paper/2206.09951/) (2022)
- [Design Space Exploration of Dense and Sparse Mapping Schemes for RRAM Architectures](https://mlsanity.com/paper/2201.06703/) (2022)

## Abstract (arXiv)

The quantization of weights to binary states in Deep Neural Networks (DNNs) can replace resource-hungry multiply accumulate operations with simple accumulations. Such Binarized Neural Networks (BNNs) exhibit greatly reduced resource and power requirements. In addition, memristors have been shown as promising synaptic weight elements in DNNs. In this paper, we propose and simulate novel Binarized Memristive Convolutional Neural Network (BMCNN) architectures employing hybrid weight and parameter representations. We train the proposed architectures offline and then map the trained parameters to our binarized memristive devices for inference. To take into account the variations in memristive devices, and to study their effect on the performance, we introduce variations in RON and ROFF. Moreover, we introduce means to mitigate the adverse effect of memristive variations in our proposed networks. Finally, we benchmark our BMCNNs and variation-aware BMCNNs using the MNIST dataset.
