mlsanityData to 7 Oct 2026

A Survey on Hyperdimensional Computing aka Vector Symbolic Architectures, Part II: Applications, Cognitive Models, and Challenges

arXiv 2112.15424 ↗First posted 12 Nov 2021cs.AIcited by 68

Not on the map. Why?

Abstract (arXiv)

This is Part II of the two-part comprehensive survey devoted to a computing framework most commonly known under the names Hyperdimensional Computing and Vector Symbolic Architectures (HDC/VSA). Both names refer to a family of computational models that use high-dimensional distributed representations and rely on the algebraic properties of their key operations to incorporate the advantages of structured symbolic representations and vector distributed representations. Holographic Reduced Representations is an influential HDC/VSA model that is well-known in the machine learning domain and often used to refer to the whole family. However, for the sake of consistency, we use HDC/VSA to refer to the field. Part I of this survey covered foundational aspects of the field, such as the historical context leading to the development of HDC/VSA, key elements of any HDC/VSA model, known HDC/VSA models, and the transformation of input data of various types into high-dimensional vectors suitable for HDC/VSA. This second part surveys existing applications, the role of HDC/VSA in cognitive computing and architectures, as well as directions for future work. Most of the applications lie within the Machine Learning/Artificial Intelligence domain, however, we also cover other applications to provide a complete picture. The survey is written to be useful for both newcomers and practitioners.

Key facts. Cited by 68 papers in the map (data through 7 Oct 2026). Builds on 67 of its 446 references that are in the map. First posted on arXiv 12 Nov 2021.

Builds on

67 of 446 references.

References · 67

  1. 2017Attention Is All You Needcited by 59,932
  2. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
  3. 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,441
  4. 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,242
  5. 2020Prevalence of Neural Collapse during the terminal phase of deep learning trainingcited by 713
  6. 2014Neural Turing Machinescited by 630
  7. 2020Hopfield Networks is All You Needcited by 461
  8. 2018The UCR Time Series Archivecited by 421
  9. 2020Inductive Biases for Deep Learning of Higher-Level Cognitioncited by 273
  10. 2020Neurosymbolic AI: The 3rd Wavecited by 253
  11. 2018Modeling polypharmacy side effects with graph convolutional networkscited by 237
  12. 2020On the Binding Problem in Artificial Neural Networkscited by 230
38 more
  1. 2020The Next Decade in AI: Four Steps Towards Robust Artificial Intelligencecited by 194
  2. 2019Neural-Symbolic Computing: An Effective Methodology for Principled Integration of Machine Learning and Reasoningcited by 149
  3. 2021How to represent part-whole hierarchies in a neural networkcited by 123
  4. 2021A Survey on Hyperdimensional Computing aka Vector Symbolic Architectures, Part I: Models and Data Transformationscited by 98
  5. 2020Benchmarking TinyML Systems: Challenges and Directioncited by 89
  6. 2019Superposition of many models into onecited by 64
  7. 2020A comparison of Vector Symbolic Architecturescited by 63
  8. 2020Classification using Hyperdimensional Computing: A Reviewcited by 60
  9. 2021Computing on Functions Using Randomized Vector Representationscited by 41
  10. 2016Associative Long Short-Term Memorycited by 37
  11. 2021Vector Symbolic Architectures as a Computing Framework for Emerging Hardwarecited by 35
  12. 2021Hyperdimensional computing as a framework for systematic aggregation of image descriptorscited by 32
  13. 2020Robust High-dimensional Memory-augmented Neural Networkscited by 31
  14. 2018A theory of sequence indexing and working memory in recurrent neural networkscited by 29
  15. 2021Attention Approximates Sparse Distributed Memorycited by 29
  16. 2020Variable Binding for Sparse Distributed Representations: Theory and Applicationscited by 27
  17. 2018RNNs Implicitly Implement Tensor Product Representationscited by 25
  18. 2021Learning with Holographic Reduced Representationscited by 25
  19. 2017The High-Dimensional Geometry of Binary Neural Networkscited by 22
  20. 2019Robust computation with rhythmic spike patternscited by 21
  21. 2021Hypervector Design for Efficient Hyperdimensional Computing on Edge Devicescited by 16
  22. 2019Density Encoding Enables Resource-Efficient Randomly Connected Neural Networkscited by 15
  23. 2018One-shot Learning for iEEG Seizure Detection Using End-to-end Binary Operations: Local Binary Patterns with Hyperdimensional Computingcited by 14
  24. 2018An EMG Gesture Recognition System with Flexible High-Density Sensors and Brain-Inspired High-Dimensional Classifiercited by 13
  25. 2020End to End Binarized Neural Networks for Text Classificationcited by 13
  26. 2017Autoscaling Bloom Filter: Controlling Trade-off Between True and False Positivescited by 12
  27. 2017Neural Distributed Autoassociative Memories: A Surveycited by 12
  28. 2020Neuromorphic Nearest-Neighbor Search Using Intel's Pohoiki Springscited by 12
  29. 2021Generalized Learning Vector Quantization for Classification in Randomized Neural Networks and Hyperdimensional Computingcited by 12
  30. 2017Integer Echo State Networks: Efficient Reservoir Computing for Digital Hardwarecited by 11
  31. 2018PULP-HD: Accelerating Brain-Inspired High-Dimensional Computing on a Parallel Ultra-Low Power Platformcited by 11
  32. 2019Recursive Sketches for Modular Deep Learningcited by 11
  33. 2020HyperEmbed: Tradeoffs Between Resources and Performance in NLP Tasks with Hyperdimensional Computing enabled Embedding of n-gram Statisticscited by 11
  34. 2021Systematic Assessment of Hyperdimensional Computing for Epileptic Seizure Detectioncited by 9
  35. 2021Memory-Efficient, Limb Position-Aware Hand Gesture Recognition using Hyperdimensional Computingcited by 8
  36. 2021Hyperseed: Unsupervised Learning with Vector Symbolic Architecturescited by 8
  37. 2020Commentaries on "Learning Sensorimotor Control with Neuromorphic Sensors: Toward Hyperdimensional Active Perception" [Science Robotics Vol. 4 Issue 30 (2019) 1-10cited by 7
  38. 2021Hyperdimensional Computing for Efficient Distributed Classification with Randomized Neural Networkscited by 7

50 most cited of 67 All 67 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 1; 2022: 15; 2023: 9; 2024: 20; 2025: 8; 2026: 15.

68 papers.

Sort:

By area:

  1. 2022A Neuro-vector-symbolic Architecture for Solving Raven's Progressive Matricescited by 64
  2. 2022Deep Learning Methods for Abstract Visual Reasoning: A Survey on Raven's Progressive Matricescited by 37
  3. 2022Torchhd: An Open Source Python Library to Support Research on Hyperdimensional Computing and Vector Symbolic Architecturescited by 17
  4. 2022Neuromorphic Visual Scene Understanding with Resonator Networkscited by 17
  5. 2024Imperative Learning: A Self-supervised Neuro-Symbolic Learning Framework for Robot Autonomycited by 16
  6. 2022HDC-MiniROCKET: Explicit Time Encoding in Time Series Classification with Hyperdimensional Computingcited by 13
  7. 2022Unpaired Image Translation via Vector Symbolic Architecturescited by 13
  8. 2022In-memory factorization of holographic perceptual representationscited by 10
  9. 2022Hyperdimensional Computing vs. Neural Networks: Comparing Architecture and Learning Processcited by 7
  10. 2023Learning from Hypervectors: A Survey on Hypervector Encodingcited by 7
  11. 2023Computing with Residue Numbers in High-Dimensional Representationcited by 7
  12. 2024Generalized Holographic Reduced Representationscited by 6
38 more
  1. 2024Hyperdimensional Representation Learning for Node Classification and Link Predictioncited by 5
  2. 2021Shift-Equivariant Similarity-Preserving Hypervector Representations of Sequencescited by 4
  3. 2024Laplace-HDC: Understanding the geometry of binary hyperdimensional computingcited by 4
  4. 2024Vector-Symbolic Architecture for Event-Based Optical Flowcited by 4
  5. 2024A Walsh Hadamard Derived Linear Vector Symbolic Architecturecited by 4
  6. 2025Dynamic Epistemic Friction in Dialoguecited by 4
  7. 2022Streaming Encoding Algorithms for Scalable Hyperdimensional Computingcited by 3
  8. 2023Resource-Efficient Federated Hyperdimensional Computingcited by 3
  9. 2023Unsupervised Dialogue Topic Segmentation in Hyperdimensional Spacecited by 3
  10. 2024HDReason: Algorithm-Hardware Codesign for Hyperdimensional Knowledge Graph Reasoningcited by 3
  11. 2024Compositional Factorization of Visual Scenes with Convolutional Sparse Coding and Resonator Networkscited by 3
  12. 2024Distributed Representations Enable Robust Multi-Timescale Symbolic Computation in Neuromorphic Hardwarecited by 3
  13. 2022Recursive Binding for Similarity-Preserving Hypervector Representations of Sequencescited by 2
  14. 2022Generalized Key-Value Memory to Flexibly Adjust Redundancy in Memory-Augmented Networkscited by 2
  15. 2022Graph Embeddings via Tensor Products and Approximately Orthonormal Codescited by 2
  16. 2023The Hyperdimensional Transform: a Holographic Representation of Functionscited by 2
  17. 2023Decodable and Sample Invariant Continuous Object Encodercited by 2
  18. 2023The Hyperdimensional Transform for Distributional Modelling, Regression and Classificationcited by 2
  19. 2024Hyperdimensional computing: a fast, robust and interpretable paradigm for biological datacited by 2
  20. 2024Self-Attention Based Semantic Decomposition in Vector Symbolic Architecturescited by 2
  21. 2024H3DFact: Heterogeneous 3D Integrated CIM for Factorization with Holographic Perceptual Representationscited by 2
  22. 2024Symbolic Disentangled Representations for Imagescited by 2
  23. 2025HD-CB: The First Exploration of Hyperdimensional Computing for Contextual Bandits Problemscited by 2
  24. 2025Hey Pentti, We Did It!: A Fully Vector-Symbolic Lispcited by 2
  25. 2026Bridging the Gap Between Hyperdimensional Computing and Kernel Methods via the Nystr"om Methodcited by 2
  26. 2022Residual and Attentional Architectures for Vector-Symbolscited by 1
  27. 2024A Mathematical Framework for the Problem of Security for Cognition in Neurotechnologycited by 1
  28. 2024Scheduled Knowledge Acquisition on Lightweight Vector Symbolic Architectures for Brain-Computer Interfacescited by 1
  29. 2024On the Role of Noise in Factorizers for Disentangling Distributed Representationscited by 1
  30. 2024A Hyperdimensional One Place Signature to Represent Them All: Stackable Descriptors For Visual Place Recognitioncited by 1
  31. 2024On Design Choices in Similarity-Preserving Sparse Randomized Embeddingscited by 1
  32. 2025Towards Vector Optimization on Low-Dimensional Vector Symbolic Architecturecited by 1
  33. 2025FactorHD: A Hyperdimensional Computing Model for Multi-Object Multi-Class Representation and Factorizationcited by 1
  34. 2026AMS-HD: Hyperdimensional Computing for Real-Time and Energy-Efficient Acute Mountain Sickness Detectioncited by 1
  35. 2026Large-Margin Hyperdimensional Computing: A Learning-Theoretical Perspectivecited by 1
  36. 2022Orthogonal Matrices for MBAT Vector Symbolic Architectures, and a "Soft" VSA Representation for JSONcited by 0
  37. 2022Computing with Hypervectors for Efficient Speaker Identificationcited by 0
  38. 2023Random Projections of Sparse Adjacency Matricescited by 0

50 most cited of 68 All 68 (JSON)