Associative Long Short-Term Memory
Not on the map. Why?
Abstract (arXiv)
We investigate a new method to augment recurrent neural networks with extra memory without increasing the number of network parameters. The system has an associative memory based on complex-valued vectors and is closely related to Holographic Reduced Representations and Long Short-Term Memory networks. Holographic Reduced Representations have limited capacity: as they store more information, each retrieval becomes noisier due to interference. Our system in contrast creates redundant copies of stored information, which enables retrieval with reduced noise. Experiments demonstrate faster learning on multiple memorization tasks.
Key facts. Cited by 37 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Feb 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 14; 2022: 5; 2023: 4; 2024: 6; 2025: 6; 2026: 2.
37 papers.
Sort:
By area:
- 2022Neural Networks and the Chomsky Hierarchycited by 214
- 2021A Survey on Hyperdimensional Computing aka Vector Symbolic Architectures, Part I: Models and Data Transformationscited by 98
- 2021A Survey on Hyperdimensional Computing aka Vector Symbolic Architectures, Part II: Applications, Cognitive Models, and Challengescited by 68
- 2021A Survey of Complex-Valued Neural Networkscited by 61
- 2021Hyperdimensional computing as a framework for systematic aggregation of image descriptorscited by 32
- 2021Attention Approximates Sparse Distributed Memorycited by 29
- 2021Learning with Holographic Reduced Representationscited by 25
- 2023Recasting Self-Attention with Holographic Reduced Representationscited by 14
- 2022HDC-MiniROCKET: Explicit Time Encoding in Time Series Classification with Hyperdimensional Computingcited by 13
- 2025Mechanistic evaluation of Transformers and state space modelscited by 8
- 2021Towards Understanding Theoretical Advantages of Complex-Reaction Networkscited by 6
- 2021Quaternion Factorization Machines: A Lightweight Solution to Intricate Feature Interaction Modellingcited by 4
25 more
- 2023CoNO: Complex Neural Operator for Continuous Dynamical Systemscited by 4
- 2021Co-domain Symmetry for Complex-Valued Deep Learningcited by 3
- 2024CoNO: Complex Neural Operator for Continous Dynamical Physical Systemscited by 3
- 2021MITNet: GAN Enhanced Magnetic Induction Tomography Based on Complex CNNcited by 2
- 2021BCNN: Binary Complex Neural Networkcited by 2
- 2022Entropic Associative Memory for Manuscript Symbolscited by 2
- 2022State-Regularized Recurrent Neural Networks to Extract Automata and Explain Predictionscited by 2
- 2023Adapting Pre-trained Language Models for Quantum Natural Language Processingcited by 2
- 2025Linearithmic Clean-up for Vector-Symbolic Key-Value Memory with Kroneker Rotation Productscited by 2
- 2025RVFL-X: A Novel Randomized Network Based on Complex Transformed Real-Valued Tabular Datasetscited by 2
- 2024Multi-label Learning with Random Circular Vectorscited by 1
- 2024Associative Knowledge Graphs for Efficient Sequence Storage and Retrievalcited by 1
- 2025Transfer Learning for Temporal Link Predictioncited by 1
- 2025Lego Sketch: A Scalable Memory-augmented Neural Network for Sketching Data Streamscited by 1
- 2021Neural Networks with Complex-Valued Weights Have No Spurious Local Minimacited by 0
- 2021Energy time series forecasting-Analytical and empirical assessment of conventional and machine learning modelscited by 0
- 2021Spectral Complexity-scaled Generalization Bound of Complex-valued Neural Networkscited by 0
- 2022A photonic chip-based machine learning approach for the prediction of molecular propertiescited by 0
- 2023Deep Axial Hypercomplex Networkscited by 0
- 2024Entropic associative memory for real world imagescited by 0
- 2024Metric Learning for Clifford Group Equivariant Neural Networkscited by 0
- 2024Exploring Learnability in Memory-Augmented Recurrent Neural Networks: Precision, Stability, and Empirical Insightscited by 0
- 2025A Vector Symbolic Approach to Multiple Instance Learningcited by 0
- 2026Phase-Associative Memory: Sequence Modeling in Complex Hilbert Spacecited by 0
- 2026Gating Enables Curvature: A Geometric Expressivity Gap in Attentioncited by 0
- 2026Gating Enables Curvature: A Geometric Expressivity Gap in Attention16 Apr 2026
- 2026Phase-Associative Memory: Sequence Modeling in Complex Hilbert Space6 Apr 2026
- 2025A Vector Symbolic Approach to Multiple Instance Learning20 Nov 2025
- 2025RVFL-X: A Novel Randomized Network Based on Complex Transformed Real-Valued Tabular Datasets6 Oct 2025
- 2025Linearithmic Clean-up for Vector-Symbolic Key-Value Memory with Kroneker Rotation Products18 Jun 2025
- 2025Lego Sketch: A Scalable Memory-augmented Neural Network for Sketching Data Streams26 May 2025
- 2025Mechanistic evaluation of Transformers and state space models21 May 2025
- 2025Transfer Learning for Temporal Link Prediction15 Apr 2025
- 2024Associative Knowledge Graphs for Efficient Sequence Storage and Retrieval19 Nov 2024
- 2024Exploring Learnability in Memory-Augmented Recurrent Neural Networks: Precision, Stability, and Empirical Insights4 Oct 2024
- 2024Metric Learning for Clifford Group Equivariant Neural Networks13 Jul 2024
- 2024Multi-label Learning with Random Circular Vectors8 Jul 2024
25 more
- 2024CoNO: Complex Neural Operator for Continous Dynamical Physical Systems1 Jun 2024
- 2024Entropic associative memory for real world images21 May 2024
- 2023CoNO: Complex Neural Operator for Continuous Dynamical Systems3 Oct 2023
- 2023Recasting Self-Attention with Holographic Reduced Representations31 May 2023
- 2023Adapting Pre-trained Language Models for Quantum Natural Language Processing24 Feb 2023
- 2023Deep Axial Hypercomplex Networks11 Jan 2023
- 2022State-Regularized Recurrent Neural Networks to Extract Automata and Explain Predictions10 Dec 2022
- 2022Neural Networks and the Chomsky Hierarchy5 Jul 2022
- 2022A photonic chip-based machine learning approach for the prediction of molecular properties3 Mar 2022
- 2022Entropic Associative Memory for Manuscript Symbols17 Feb 2022
- 2022HDC-MiniROCKET: Explicit Time Encoding in Time Series Classification with Hyperdimensional Computing16 Feb 2022
- 2021Spectral Complexity-scaled Generalization Bound of Complex-valued Neural Networks7 Dec 2021
- 2021Co-domain Symmetry for Complex-Valued Deep Learning2 Dec 2021
- 2021A Survey on Hyperdimensional Computing aka Vector Symbolic Architectures, Part II: Applications, Cognitive Models, and Challenges12 Nov 2021
- 2021A Survey on Hyperdimensional Computing aka Vector Symbolic Architectures, Part I: Models and Data Transformations11 Nov 2021
- 2021Attention Approximates Sparse Distributed Memory10 Nov 2021
- 2021Learning with Holographic Reduced Representations5 Sep 2021
- 2021Energy time series forecasting-Analytical and empirical assessment of conventional and machine learning models24 Aug 2021
- 2021Towards Understanding Theoretical Advantages of Complex-Reaction Networks15 Aug 2021
- 2021Quaternion Factorization Machines: A Lightweight Solution to Intricate Feature Interaction Modelling5 Apr 2021
- 2021BCNN: Binary Complex Neural Network28 Mar 2021
- 2021MITNet: GAN Enhanced Magnetic Induction Tomography Based on Complex CNN16 Feb 2021
- 2021Neural Networks with Complex-Valued Weights Have No Spurious Local Minima31 Jan 2021
- 2021A Survey of Complex-Valued Neural Networks28 Jan 2021
- 2021Hyperdimensional computing as a framework for systematic aggregation of image descriptors19 Jan 2021
- 2022Neural Networks and the Chomsky Hierarchycited by 214
- 2021A Survey on Hyperdimensional Computing aka Vector Symbolic Architectures, Part I: Models and Data Transformationscited by 98
- 2021A Survey on Hyperdimensional Computing aka Vector Symbolic Architectures, Part II: Applications, Cognitive Models, and Challengescited by 68
- 2021A Survey of Complex-Valued Neural Networkscited by 61
- 2021Hyperdimensional computing as a framework for systematic aggregation of image descriptorscited by 32
- 2021Attention Approximates Sparse Distributed Memorycited by 29
- 2021Learning with Holographic Reduced Representationscited by 25
- 2023Recasting Self-Attention with Holographic Reduced Representationscited by 14
- 2022HDC-MiniROCKET: Explicit Time Encoding in Time Series Classification with Hyperdimensional Computingcited by 13
- 2021Towards Understanding Theoretical Advantages of Complex-Reaction Networkscited by 6
- 2021Quaternion Factorization Machines: A Lightweight Solution to Intricate Feature Interaction Modellingcited by 4
- 2023CoNO: Complex Neural Operator for Continuous Dynamical Systemscited by 4
12 most cited of 36 All 36 (JSON)
- 2026Gating Enables Curvature: A Geometric Expressivity Gap in Attention16 Apr 2026
- 2026Phase-Associative Memory: Sequence Modeling in Complex Hilbert Space6 Apr 2026
- 2025A Vector Symbolic Approach to Multiple Instance Learning20 Nov 2025
- 2025RVFL-X: A Novel Randomized Network Based on Complex Transformed Real-Valued Tabular Datasets6 Oct 2025
- 2025Linearithmic Clean-up for Vector-Symbolic Key-Value Memory with Kroneker Rotation Products18 Jun 2025
- 2025Lego Sketch: A Scalable Memory-augmented Neural Network for Sketching Data Streams26 May 2025
- 2025Transfer Learning for Temporal Link Prediction15 Apr 2025
- 2024Associative Knowledge Graphs for Efficient Sequence Storage and Retrieval19 Nov 2024
- 2024Exploring Learnability in Memory-Augmented Recurrent Neural Networks: Precision, Stability, and Empirical Insights4 Oct 2024
- 2024Metric Learning for Clifford Group Equivariant Neural Networks13 Jul 2024
- 2024Multi-label Learning with Random Circular Vectors8 Jul 2024
- 2024CoNO: Complex Neural Operator for Continous Dynamical Physical Systems1 Jun 2024
12 newest of 36 All 36 (JSON)