mlsanityData to 7 Oct 2026

Implementation of a Binary Neural Network on a Passive Array of Magnetic Tunnel Junctions

arXiv 2112.09159 ↗First posted 16 Dec 2021cs.ET cond-mat.dis-nn cond-mat.mtrl-scicited by 1

Not on the map. Why?

Abstract (arXiv)

The increasing scale of neural networks and their growing application space have produced demand for more energy- and memory-efficient artificial-intelligence-specific hardware. Avenues to mitigate the main issue, the von Neumann bottleneck, include in-memory and near-memory architectures, as well as algorithmic approaches. Here we leverage the low-power and the inherently binary operation of magnetic tunnel junctions (MTJs) to demonstrate neural network hardware inference based on passive arrays of MTJs. In general, transferring a trained network model to hardware for inference is confronted by degradation in performance due to device-to-device variations, write errors, parasitic resistance, and nonidealities in the substrate. To quantify the effect of these hardware realities, we benchmark 300 unique weight matrix solutions of a 2-layer perceptron to classify the Wine dataset for both classification accuracy and write fidelity. Despite device imperfections, we achieve software-equivalent accuracy of up to 95.3 % with proper tuning of network parameters in 15 x 15 MTJ arrays having a range of device sizes. The success of this tuning process shows that new metrics are needed to characterize the performance and quality of networks reproduced in mixed signal hardware.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 13 of its 83 references that are in the map. First posted on arXiv 16 Dec 2021.

Builds on

13 of 83 references.

References · 13

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2015Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Codingcited by 2,291
  3. 2020Binary Neural Networks: A Surveycited by 184
  4. 2020Carbontracker: Tracking and Predicting the Carbon Footprint of Training Deep Learning Modelscited by 168
  5. 2016An Analysis of Deep Neural Network Models for Practical Applicationscited by 114
  6. 2018Benchmark Analysis of Representative Deep Neural Network Architecturescited by 77
  7. 2020Hardware and Software Optimizations for Accelerating Deep Neural Networks: Survey of Current Trends, Challenges, and the Road Aheadcited by 34
  8. 2020Survey of Machine Learning Acceleratorscited by 29
  9. 2020Fast Stencil-Code Computation on a Wafer-Scale Processorcited by 10
  10. 2019Streaming Batch Eigenupdates for Hardware Neuromorphic Networkscited by 3
  11. 2020Fast Implementation of 4-bit Convolutional Neural Networks for Mobile Devicescited by 3
  12. 2021Experimental Demonstration of Neuromorphic Network with STT MTJ Synapsescited by 2
1 more
  1. 2018In-situ Stochastic Training of MTJ Crossbar based Neural Networkscited by 1

Built on by

Cited by year

Citing papers per year: 2023: 1.

1 paper.