Neural Random-Access Machines
Not on the map. Why?
Abstract (arXiv)
In this paper, we propose and investigate a new neural network architecture called Neural Random Access Machine. It can manipulate and dereference pointers to an external variable-size random-access memory. The model is trained from pure input-output examples using backpropagation. We evaluate the new model on a number of simple algorithmic tasks whose solutions require pointer manipulation and dereferencing. Our results show that the proposed model can learn to solve algorithmic tasks of such type and is capable of operating on simple data structures like linked-lists and binary trees. For easier tasks, the learned solutions generalize to sequences of arbitrary length. Moreover, memory access during inference can be done in a constant time under some assumptions.
Key facts. Cited by 34 papers in the map (data through 14 Oct 2026). First posted on arXiv 19 Nov 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 13; 2022: 4; 2023: 7; 2024: 6; 2025: 1; 2026: 3.
34 papers.
Sort:
By area:
- 2021Program Synthesis with Large Language Modelscited by 3,637
- 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,407
- 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,167
- 2021Show Your Work: Scratchpads for Intermediate Computation with Language Modelscited by 886
- 2022CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement Learningcited by 358
- 2021Combinatorial optimization and reasoning with graph neural networkscited by 268
- 2022Neural Networks and the Chomsky Hierarchycited by 217
- 2021Neural Algorithmic Reasoningcited by 94
- 2023CodeChain: Towards Modular Code Generation Through Chain of Self-revisions with Representative Sub-modulescited by 58
- 2023Code Execution with Pre-trained Language Modelscited by 34
- 2021How to transfer algorithmic reasoning knowledge to learn new algorithms?cited by 22
- 2023Pushdown Layers: Encoding Recursive Structure in Transformer Language Modelscited by 19
22 more
- 2022Neural Approximation of Graph Topological Featurescited by 17
- 2024Autoregressive Large Language Models are Computationally Universalcited by 15
- 2021UnweaveNet: Unweaving Activity Storiescited by 14
- 2024INDICT: Code Generation with Internal Dialogues of Critiques for Both Security and Helpfulnesscited by 8
- 2021Robot Program Parameter Inference via Differentiable Shadow Program Inversioncited by 5
- 2021Evolutionary Training and Abstraction Yields Algorithmic Generalization of Neural Computerscited by 5
- 2023Differentiable Tree Operations Promote Compositional Generalizationcited by 5
- 2023Rationalizing Predictions by Adversarial Information Calibrationcited by 4
- 2024Learning Program Behavioral Models from Synthesized Input-Output Pairscited by 4
- 2021BF++: a language for general-purpose program synthesiscited by 3
- 2023Neural Machine Translation for Code Generationcited by 3
- 2021State-Space Constraints Can Improve the Generalisation of the Differentiable Neural Computer to Input Sequences With Unseen Lengthcited by 1
- 2025Exact Learning of Arithmetic with Differentiable Agentscited by 1
- 2026Universal computation is intrinsic to language model decodingcited by 1
- 2021PAC-learning gains of Turing machines over circuits and neural networkscited by 0
- 2021Enhancing Reinforcement Learning with discrete interfaces to learn the Dyck Languagecited by 0
- 2023Program Generation from Diverse Video Demonstrationscited by 0
- 2024Enhancing Length Extrapolation in Sequential Models with Pointer-Augmented Neural Memorycited by 0
- 2024DNCs Require More Planning Stepscited by 0
- 2024Exploring Learnability in Memory-Augmented Recurrent Neural Networks: Precision, Stability, and Empirical Insightscited by 0
- 2026A Symbolic Neural CPU for Quantization-Simulated Writeback and Interpretable Program Executioncited by 0
- 2026Latest Exact Match Attentioncited by 0
- 2026Latest Exact Match Attention22 Sep 2026
- 2026A Symbolic Neural CPU for Quantization-Simulated Writeback and Interpretable Program Execution10 Jul 2026
- 2026Universal computation is intrinsic to language model decoding12 Jan 2026
- 2025Exact Learning of Arithmetic with Differentiable Agents27 Nov 2025
- 2024Autoregressive Large Language Models are Computationally Universal4 Oct 2024
- 2024Exploring Learnability in Memory-Augmented Recurrent Neural Networks: Precision, Stability, and Empirical Insights4 Oct 2024
- 2024Learning Program Behavioral Models from Synthesized Input-Output Pairs11 Jul 2024
- 2024INDICT: Code Generation with Internal Dialogues of Critiques for Both Security and Helpfulness23 Jun 2024
- 2024DNCs Require More Planning Steps4 Jun 2024
- 2024Enhancing Length Extrapolation in Sequential Models with Pointer-Augmented Neural Memory18 Apr 2024
- 2023Pushdown Layers: Encoding Recursive Structure in Transformer Language Models29 Oct 2023
- 2023CodeChain: Towards Modular Code Generation Through Chain of Self-revisions with Representative Sub-modules13 Oct 2023
22 more
- 2023Differentiable Tree Operations Promote Compositional Generalization1 Jun 2023
- 2023Neural Machine Translation for Code Generation22 May 2023
- 2023Code Execution with Pre-trained Language Models8 May 2023
- 2023Program Generation from Diverse Video Demonstrations1 Feb 2023
- 2023Rationalizing Predictions by Adversarial Information Calibration15 Jan 2023
- 2022Neural Networks and the Chomsky Hierarchy5 Jul 2022
- 2022CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement Learning5 Jul 2022
- 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Models21 May 2022
- 2022Neural Approximation of Graph Topological Features28 Jan 2022
- 2021UnweaveNet: Unweaving Activity Stories19 Dec 2021
- 2021Show Your Work: Scratchpads for Intermediate Computation with Language Models30 Nov 2021
- 2021Enhancing Reinforcement Learning with discrete interfaces to learn the Dyck Language27 Oct 2021
- 2021How to transfer algorithmic reasoning knowledge to learn new algorithms?26 Oct 2021
- 2021State-Space Constraints Can Improve the Generalisation of the Differentiable Neural Computer to Input Sequences With Unseen Length18 Oct 2021
- 2021Program Synthesis with Large Language Models16 Aug 2021
- 2021Evolutionary Training and Abstraction Yields Algorithmic Generalization of Neural Computers17 May 2021
- 2021Neural Algorithmic Reasoning6 May 2021
- 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges27 Apr 2021
- 2021Robot Program Parameter Inference via Differentiable Shadow Program Inversion26 Mar 2021
- 2021PAC-learning gains of Turing machines over circuits and neural networks23 Mar 2021
- 2021Combinatorial optimization and reasoning with graph neural networks18 Feb 2021
- 2021BF++: a language for general-purpose program synthesis23 Jan 2021
- 2021Program Synthesis with Large Language Modelscited by 3,637
- 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,167
- 2022CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement Learningcited by 358
- 2021Combinatorial optimization and reasoning with graph neural networkscited by 268
- 2022Neural Networks and the Chomsky Hierarchycited by 217
- 2021Neural Algorithmic Reasoningcited by 94
- 2023CodeChain: Towards Modular Code Generation Through Chain of Self-revisions with Representative Sub-modulescited by 58
- 2023Code Execution with Pre-trained Language Modelscited by 34
- 2021How to transfer algorithmic reasoning knowledge to learn new algorithms?cited by 22
- 2023Pushdown Layers: Encoding Recursive Structure in Transformer Language Modelscited by 19
- 2022Neural Approximation of Graph Topological Featurescited by 17
- 2024Autoregressive Large Language Models are Computationally Universalcited by 15
12 most cited of 32 All 32 (JSON)
- 2026Latest Exact Match Attention22 Sep 2026
- 2026A Symbolic Neural CPU for Quantization-Simulated Writeback and Interpretable Program Execution10 Jul 2026
- 2026Universal computation is intrinsic to language model decoding12 Jan 2026
- 2025Exact Learning of Arithmetic with Differentiable Agents27 Nov 2025
- 2024Autoregressive Large Language Models are Computationally Universal4 Oct 2024
- 2024Exploring Learnability in Memory-Augmented Recurrent Neural Networks: Precision, Stability, and Empirical Insights4 Oct 2024
- 2024Learning Program Behavioral Models from Synthesized Input-Output Pairs11 Jul 2024
- 2024INDICT: Code Generation with Internal Dialogues of Critiques for Both Security and Helpfulness23 Jun 2024
- 2024DNCs Require More Planning Steps4 Jun 2024
- 2024Enhancing Length Extrapolation in Sequential Models with Pointer-Augmented Neural Memory18 Apr 2024
- 2023Pushdown Layers: Encoding Recursive Structure in Transformer Language Models29 Oct 2023
- 2023CodeChain: Towards Modular Code Generation Through Chain of Self-revisions with Representative Sub-modules13 Oct 2023
12 newest of 32 All 32 (JSON)