Brain-inspired Cognition in Next Generation Racetrack Memories
Not on the map. Why?
Abstract (arXiv)
Hyperdimensional computing (HDC) is an emerging computational framework inspired by the brain that operates on vectors with thousands of dimensions to emulate cognition. Unlike conventional computational frameworks that operate on numbers, HDC, like the brain, uses high dimensional random vectors and is capable of one-shot learning. HDC is based on a well-defined set of arithmetic operations and is highly error-resilient. The core operations of HDC manipulate HD vectors in bulk bit-wise fashion, offering many opportunities to leverage parallelism. Unfortunately, on conventional Von-Neuman architectures, the continuous movement of HD vectors among the processor and the memory can make the cognition task prohibitively slow and energy-intensive. Hardware accelerators only marginally improve related metrics. On the contrary, only partial implementation of an HDC framework inside memory, using emerging memristive devices, has reported considerable performance/energy gains. This paper presents an architecture based on racetrack memory (RTM) to conduct and accelerate the entire HDC framework within the memory. The proposed solution requires minimal additional CMOS circuitry and uses a read operation across multiple domains in RTMs called transverse read (TR) to realize exclusive-or (XOR) and addition operations. To minimize the overhead the CMOS circuitry, we propose an RTM nanowires-based counting mechanism that leverages the TR operation and the standard RTM operations. Using language recognition as the use case demonstrates 7.8x and 5.3x reduction in the overall runtime and energy consumption compared to the FPGA design, respectively. Compared to the state-of-the-art in-memory implementation, the proposed HDC system reduces the energy consumption by 8.6x.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 9 of its 76 references that are in the map. First posted on arXiv 3 Nov 2021.
Builds on
9 of 76 references.
References · 9
- 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,242
- 2020The Computational Limits of Deep Learningcited by 188
- 2020A comparison of Vector Symbolic Architecturescited by 63
- 2020Classification using Hyperdimensional Computing: A Reviewcited by 60
- 2019In-memory hyperdimensional computingcited by 47
- 2019Achieving Super-Linear Speedup across Multi-FPGA for Real-Time DNN Inferencecited by 13
- 2018PULP-HD: Accelerating Brain-Inspired High-Dimensional Computing on a Parallel Ultra-Low Power Platformcited by 11
- 2018Exploring Embedding Methods in Binary Hyperdimensional Computing: A Case Study for Motor-Imagery based Brain-Computer Interfacescited by 6
- 2019An Overview of In-memory Processing with Emerging Non-volatile Memory for Data-intensive Applicationscited by 5
Built on by
Citing papers per year: 2022: 1.
1 paper.