A Survey on Hyperdimensional Computing aka Vector Symbolic Architectures, Part II: Applications, Cognitive Models, and Challenges
Not on the map. Why?
Abstract (arXiv)
This is Part II of the two-part comprehensive survey devoted to a computing framework most commonly known under the names Hyperdimensional Computing and Vector Symbolic Architectures (HDC/VSA). Both names refer to a family of computational models that use high-dimensional distributed representations and rely on the algebraic properties of their key operations to incorporate the advantages of structured symbolic representations and vector distributed representations. Holographic Reduced Representations is an influential HDC/VSA model that is well-known in the machine learning domain and often used to refer to the whole family. However, for the sake of consistency, we use HDC/VSA to refer to the field. Part I of this survey covered foundational aspects of the field, such as the historical context leading to the development of HDC/VSA, key elements of any HDC/VSA model, known HDC/VSA models, and the transformation of input data of various types into high-dimensional vectors suitable for HDC/VSA. This second part surveys existing applications, the role of HDC/VSA in cognitive computing and architectures, as well as directions for future work. Most of the applications lie within the Machine Learning/Artificial Intelligence domain, however, we also cover other applications to provide a complete picture. The survey is written to be useful for both newcomers and practitioners.
Key facts. Cited by 68 papers in the map (data through 7 Oct 2026). Builds on 67 of its 446 references that are in the map. First posted on arXiv 12 Nov 2021.
Builds on
67 of 446 references.
References · 67
- 2017Attention Is All You Needcited by 59,932
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
- 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,441
- 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,242
- 2020Prevalence of Neural Collapse during the terminal phase of deep learning trainingcited by 713
- 2014Neural Turing Machinescited by 630
- 2020Hopfield Networks is All You Needcited by 461
- 2018The UCR Time Series Archivecited by 421
- 2020Inductive Biases for Deep Learning of Higher-Level Cognitioncited by 273
- 2020Neurosymbolic AI: The 3rd Wavecited by 253
- 2018Modeling polypharmacy side effects with graph convolutional networkscited by 237
- 2020On the Binding Problem in Artificial Neural Networkscited by 230
38 more
- 2020The Next Decade in AI: Four Steps Towards Robust Artificial Intelligencecited by 194
- 2019Neural-Symbolic Computing: An Effective Methodology for Principled Integration of Machine Learning and Reasoningcited by 149
- 2021How to represent part-whole hierarchies in a neural networkcited by 123
- 2021A Survey on Hyperdimensional Computing aka Vector Symbolic Architectures, Part I: Models and Data Transformationscited by 98
- 2020Benchmarking TinyML Systems: Challenges and Directioncited by 89
- 2019Superposition of many models into onecited by 64
- 2020A comparison of Vector Symbolic Architecturescited by 63
- 2020Classification using Hyperdimensional Computing: A Reviewcited by 60
- 2021Computing on Functions Using Randomized Vector Representationscited by 41
- 2016Associative Long Short-Term Memorycited by 37
- 2021Vector Symbolic Architectures as a Computing Framework for Emerging Hardwarecited by 35
- 2021Hyperdimensional computing as a framework for systematic aggregation of image descriptorscited by 32
- 2020Robust High-dimensional Memory-augmented Neural Networkscited by 31
- 2018A theory of sequence indexing and working memory in recurrent neural networkscited by 29
- 2021Attention Approximates Sparse Distributed Memorycited by 29
- 2020Variable Binding for Sparse Distributed Representations: Theory and Applicationscited by 27
- 2018RNNs Implicitly Implement Tensor Product Representationscited by 25
- 2021Learning with Holographic Reduced Representationscited by 25
- 2017The High-Dimensional Geometry of Binary Neural Networkscited by 22
- 2019Robust computation with rhythmic spike patternscited by 21
- 2021Hypervector Design for Efficient Hyperdimensional Computing on Edge Devicescited by 16
- 2019Density Encoding Enables Resource-Efficient Randomly Connected Neural Networkscited by 15
- 2018One-shot Learning for iEEG Seizure Detection Using End-to-end Binary Operations: Local Binary Patterns with Hyperdimensional Computingcited by 14
- 2018An EMG Gesture Recognition System with Flexible High-Density Sensors and Brain-Inspired High-Dimensional Classifiercited by 13
- 2020End to End Binarized Neural Networks for Text Classificationcited by 13
- 2017Autoscaling Bloom Filter: Controlling Trade-off Between True and False Positivescited by 12
- 2017Neural Distributed Autoassociative Memories: A Surveycited by 12
- 2020Neuromorphic Nearest-Neighbor Search Using Intel's Pohoiki Springscited by 12
- 2021Generalized Learning Vector Quantization for Classification in Randomized Neural Networks and Hyperdimensional Computingcited by 12
- 2017Integer Echo State Networks: Efficient Reservoir Computing for Digital Hardwarecited by 11
- 2018PULP-HD: Accelerating Brain-Inspired High-Dimensional Computing on a Parallel Ultra-Low Power Platformcited by 11
- 2019Recursive Sketches for Modular Deep Learningcited by 11
- 2020HyperEmbed: Tradeoffs Between Resources and Performance in NLP Tasks with Hyperdimensional Computing enabled Embedding of n-gram Statisticscited by 11
- 2021Systematic Assessment of Hyperdimensional Computing for Epileptic Seizure Detectioncited by 9
- 2021Memory-Efficient, Limb Position-Aware Hand Gesture Recognition using Hyperdimensional Computingcited by 8
- 2021Hyperseed: Unsupervised Learning with Vector Symbolic Architecturescited by 8
- 2020Commentaries on "Learning Sensorimotor Control with Neuromorphic Sensors: Toward Hyperdimensional Active Perception" [Science Robotics Vol. 4 Issue 30 (2019) 1-10cited by 7
- 2021Hyperdimensional Computing for Efficient Distributed Classification with Randomized Neural Networkscited by 7
50 most cited of 67 All 67 (JSON)
Built on by
Citing papers per year: 2021: 1; 2022: 15; 2023: 9; 2024: 20; 2025: 8; 2026: 15.
68 papers.
Sort:
By area:
- 2022A Neuro-vector-symbolic Architecture for Solving Raven's Progressive Matricescited by 64
- 2022Deep Learning Methods for Abstract Visual Reasoning: A Survey on Raven's Progressive Matricescited by 37
- 2022Torchhd: An Open Source Python Library to Support Research on Hyperdimensional Computing and Vector Symbolic Architecturescited by 17
- 2022Neuromorphic Visual Scene Understanding with Resonator Networkscited by 17
- 2024Imperative Learning: A Self-supervised Neuro-Symbolic Learning Framework for Robot Autonomycited by 16
- 2022HDC-MiniROCKET: Explicit Time Encoding in Time Series Classification with Hyperdimensional Computingcited by 13
- 2022Unpaired Image Translation via Vector Symbolic Architecturescited by 13
- 2022In-memory factorization of holographic perceptual representationscited by 10
- 2022Hyperdimensional Computing vs. Neural Networks: Comparing Architecture and Learning Processcited by 7
- 2023Learning from Hypervectors: A Survey on Hypervector Encodingcited by 7
- 2023Computing with Residue Numbers in High-Dimensional Representationcited by 7
- 2024Generalized Holographic Reduced Representationscited by 6
38 more
- 2024Hyperdimensional Representation Learning for Node Classification and Link Predictioncited by 5
- 2021Shift-Equivariant Similarity-Preserving Hypervector Representations of Sequencescited by 4
- 2024Laplace-HDC: Understanding the geometry of binary hyperdimensional computingcited by 4
- 2024Vector-Symbolic Architecture for Event-Based Optical Flowcited by 4
- 2024A Walsh Hadamard Derived Linear Vector Symbolic Architecturecited by 4
- 2025Dynamic Epistemic Friction in Dialoguecited by 4
- 2022Streaming Encoding Algorithms for Scalable Hyperdimensional Computingcited by 3
- 2023Resource-Efficient Federated Hyperdimensional Computingcited by 3
- 2023Unsupervised Dialogue Topic Segmentation in Hyperdimensional Spacecited by 3
- 2024HDReason: Algorithm-Hardware Codesign for Hyperdimensional Knowledge Graph Reasoningcited by 3
- 2024Compositional Factorization of Visual Scenes with Convolutional Sparse Coding and Resonator Networkscited by 3
- 2024Distributed Representations Enable Robust Multi-Timescale Symbolic Computation in Neuromorphic Hardwarecited by 3
- 2022Recursive Binding for Similarity-Preserving Hypervector Representations of Sequencescited by 2
- 2022Generalized Key-Value Memory to Flexibly Adjust Redundancy in Memory-Augmented Networkscited by 2
- 2022Graph Embeddings via Tensor Products and Approximately Orthonormal Codescited by 2
- 2023The Hyperdimensional Transform: a Holographic Representation of Functionscited by 2
- 2023Decodable and Sample Invariant Continuous Object Encodercited by 2
- 2023The Hyperdimensional Transform for Distributional Modelling, Regression and Classificationcited by 2
- 2024Hyperdimensional computing: a fast, robust and interpretable paradigm for biological datacited by 2
- 2024Self-Attention Based Semantic Decomposition in Vector Symbolic Architecturescited by 2
- 2024H3DFact: Heterogeneous 3D Integrated CIM for Factorization with Holographic Perceptual Representationscited by 2
- 2024Symbolic Disentangled Representations for Imagescited by 2
- 2025HD-CB: The First Exploration of Hyperdimensional Computing for Contextual Bandits Problemscited by 2
- 2025Hey Pentti, We Did It!: A Fully Vector-Symbolic Lispcited by 2
- 2026Bridging the Gap Between Hyperdimensional Computing and Kernel Methods via the Nystr"om Methodcited by 2
- 2022Residual and Attentional Architectures for Vector-Symbolscited by 1
- 2024A Mathematical Framework for the Problem of Security for Cognition in Neurotechnologycited by 1
- 2024Scheduled Knowledge Acquisition on Lightweight Vector Symbolic Architectures for Brain-Computer Interfacescited by 1
- 2024On the Role of Noise in Factorizers for Disentangling Distributed Representationscited by 1
- 2024A Hyperdimensional One Place Signature to Represent Them All: Stackable Descriptors For Visual Place Recognitioncited by 1
- 2024On Design Choices in Similarity-Preserving Sparse Randomized Embeddingscited by 1
- 2025Towards Vector Optimization on Low-Dimensional Vector Symbolic Architecturecited by 1
- 2025FactorHD: A Hyperdimensional Computing Model for Multi-Object Multi-Class Representation and Factorizationcited by 1
- 2026AMS-HD: Hyperdimensional Computing for Real-Time and Energy-Efficient Acute Mountain Sickness Detectioncited by 1
- 2026Large-Margin Hyperdimensional Computing: A Learning-Theoretical Perspectivecited by 1
- 2022Orthogonal Matrices for MBAT Vector Symbolic Architectures, and a "Soft" VSA Representation for JSONcited by 0
- 2022Computing with Hypervectors for Efficient Speaker Identificationcited by 0
- 2023Random Projections of Sparse Adjacency Matricescited by 0
50 most cited of 68 All 68 (JSON)
- 2026Superposed Inference for Hyperdimensional Computing26 Sep 2026
- 2026Hardware-Aware Learned Representation Compression for Distributed In-Sensor Vision12 Sep 2026
- 2026Real-Valued Hyperdimensional Sequence Representations with Hadamard Product Binding and Shift Equivariance28 Aug 2026
- 2026Bridging the Gap Between Hyperdimensional Computing and Kernel Methods via the Nystr"om Method7 Aug 2026
- 2026Forgetting Our Way to Shared Meaning: Effects of Forgetting on Conceptual Alignment in a Non-Partnership Coordination Game13 Jul 2026
- 2026Qubit-Efficient Quantum Search for Hyperdimensional Decomposition via Logarithmic Encoding11 Jul 2026
- 2026Hyperdimensional computing for structured querying on tabular data embeddings11 Jun 2026
- 2026Encoding Robust Topological Signatures for Hyperdimensional Computing16 May 2026
- 2026SRMU: Relevance-Gated Updates for Streaming Hyperdimensional Memories16 Apr 2026
- 2026Robot Arm Control via Cognitive Map Learners24 Mar 2026
- 2026Federated Hyperdimensional Computing for Resource-Constrained Industrial IoT20 Mar 2026
- 2026Large-Margin Hyperdimensional Computing: A Learning-Theoretical Perspective4 Mar 2026
38 more
- 2026AMS-HD: Hyperdimensional Computing for Real-Time and Energy-Efficient Acute Mountain Sickness Detection9 Feb 2026
- 2026Primitive-Driven Acceleration of Hyperdimensional Computing for Real-Time Image Classification27 Jan 2026
- 2026Heterogeneous computing platform for real-time robotics13 Jan 2026
- 2025Approximating the Mathematical Structure of Psychodynamics5 Nov 2025
- 2025Efficient Vector Symbolic Architectures from Histogram Recovery3 Nov 2025
- 2025Hey Pentti, We Did It!: A Fully Vector-Symbolic Lisp18 Oct 2025
- 2025FactorHD: A Hyperdimensional Computing Model for Multi-Object Multi-Class Representation and Factorization16 Jul 2025
- 2025Dynamic Epistemic Friction in Dialogue12 Jun 2025
- 2025ScalableHD: Scalable and High-Throughput Hyperdimensional Computing Inference on Multi-Core CPUs10 Jun 2025
- 2025Towards Vector Optimization on Low-Dimensional Vector Symbolic Architecture19 Feb 2025
- 2025HD-CB: The First Exploration of Hyperdimensional Computing for Contextual Bandits Problems28 Jan 2025
- 2024Symbolic Disentangled Representations for Images25 Dec 2024
- 2024On Design Choices in Similarity-Preserving Sparse Randomized Embeddings12 Dec 2024
- 2024A Hyperdimensional One Place Signature to Represent Them All: Stackable Descriptors For Visual Place Recognition9 Dec 2024
- 2024On the Role of Noise in Factorizers for Disentangling Distributed Representations30 Nov 2024
- 2024A Walsh Hadamard Derived Linear Vector Symbolic Architecture30 Oct 2024
- 2024Imperative Learning: A Self-supervised Neuro-Symbolic Learning Framework for Robot Autonomy23 Jun 2024
- 2024Hyperdimensional Quantum Factorization13 Jun 2024
- 2024Unsupervised Extractive Dialogue Summarization in Hyperdimensional Space16 May 2024
- 2024Generalized Holographic Reduced Representations15 May 2024
- 2024Vector-Symbolic Architecture for Event-Based Optical Flow14 May 2024
- 2024Distributed Representations Enable Robust Multi-Timescale Symbolic Computation in Neuromorphic Hardware2 May 2024
- 2024Compositional Factorization of Visual Scenes with Convolutional Sparse Coding and Resonator Networks29 Apr 2024
- 2024Laplace-HDC: Understanding the geometry of binary hyperdimensional computing16 Apr 2024
- 2024H3DFact: Heterogeneous 3D Integrated CIM for Factorization with Holographic Perceptual Representations5 Apr 2024
- 2024Self-Attention Based Semantic Decomposition in Vector Symbolic Architectures20 Mar 2024
- 2024Scheduled Knowledge Acquisition on Lightweight Vector Symbolic Architectures for Brain-Computer Interfaces18 Mar 2024
- 2024A Mathematical Framework for the Problem of Security for Cognition in Neurotechnology11 Mar 2024
- 2024HDReason: Algorithm-Hardware Codesign for Hyperdimensional Knowledge Graph Reasoning9 Mar 2024
- 2024Hyperdimensional computing: a fast, robust and interpretable paradigm for biological data27 Feb 2024
- 2024Hyperdimensional Representation Learning for Node Classification and Link Prediction26 Feb 2024
- 2023Robust Clustering using Hyperdimensional Computing5 Dec 2023
- 2023The Hyperdimensional Transform for Distributional Modelling, Regression and Classification14 Nov 2023
- 2023Computing with Residue Numbers in High-Dimensional Representation8 Nov 2023
- 2023Decodable and Sample Invariant Continuous Object Encoder31 Oct 2023
- 2023The Hyperdimensional Transform: a Holographic Representation of Functions24 Oct 2023
- 2023Random Projections of Sparse Adjacency Matrices4 Sep 2023
- 2023Unsupervised Dialogue Topic Segmentation in Hyperdimensional Space21 Aug 2023
50 newest of 68 All 68 (JSON)
- 2025Dynamic Epistemic Friction in Dialoguecited by 4
- 2025Dynamic Epistemic Friction in Dialogue12 Jun 2025
- 2022A Neuro-vector-symbolic Architecture for Solving Raven's Progressive Matricescited by 64
- 2022Torchhd: An Open Source Python Library to Support Research on Hyperdimensional Computing and Vector Symbolic Architecturescited by 17
- 2022Neuromorphic Visual Scene Understanding with Resonator Networkscited by 17
- 2022HDC-MiniROCKET: Explicit Time Encoding in Time Series Classification with Hyperdimensional Computingcited by 13
- 2022Unpaired Image Translation via Vector Symbolic Architecturescited by 13
- 2022In-memory factorization of holographic perceptual representationscited by 10
- 2022Hyperdimensional Computing vs. Neural Networks: Comparing Architecture and Learning Processcited by 7
- 2023Learning from Hypervectors: A Survey on Hypervector Encodingcited by 7
- 2023Computing with Residue Numbers in High-Dimensional Representationcited by 7
- 2024Generalized Holographic Reduced Representationscited by 6
- 2024Hyperdimensional Representation Learning for Node Classification and Link Predictioncited by 5
- 2021Shift-Equivariant Similarity-Preserving Hypervector Representations of Sequencescited by 4
12 most cited of 64 All 64 (JSON)
- 2026Superposed Inference for Hyperdimensional Computing26 Sep 2026
- 2026Hardware-Aware Learned Representation Compression for Distributed In-Sensor Vision12 Sep 2026
- 2026Real-Valued Hyperdimensional Sequence Representations with Hadamard Product Binding and Shift Equivariance28 Aug 2026
- 2026Bridging the Gap Between Hyperdimensional Computing and Kernel Methods via the Nystr"om Method7 Aug 2026
- 2026Forgetting Our Way to Shared Meaning: Effects of Forgetting on Conceptual Alignment in a Non-Partnership Coordination Game13 Jul 2026
- 2026Qubit-Efficient Quantum Search for Hyperdimensional Decomposition via Logarithmic Encoding11 Jul 2026
- 2026Hyperdimensional computing for structured querying on tabular data embeddings11 Jun 2026
- 2026Encoding Robust Topological Signatures for Hyperdimensional Computing16 May 2026
- 2026SRMU: Relevance-Gated Updates for Streaming Hyperdimensional Memories16 Apr 2026
- 2026Robot Arm Control via Cognitive Map Learners24 Mar 2026
- 2026Federated Hyperdimensional Computing for Resource-Constrained Industrial IoT20 Mar 2026
- 2026Large-Margin Hyperdimensional Computing: A Learning-Theoretical Perspective4 Mar 2026
12 newest of 64 All 64 (JSON)