Learning Random Numbers to Realize Appendable Memory System for Artificial Intelligence to Acquire New Knowledge after Deployment
Not on the map. Why?
Abstract (arXiv)
In this study, we developed a learning method for constructing a neural network system capable of memorizing data and recalling it without parameter updates. The system we built using this method is called the Appendable Memory system. The Appendable Memory system enables an artificial intelligence (AI) to acquire new knowledge even after deployment. It consists of two AIs: the Memorizer and the Recaller. This system is a key-value store built using neural networks. The Memorizer receives data and stores it in the Appendable Memory vector, which is dynamically updated when the AI acquires new knowledge. Meanwhile, the Recaller retrieves information from the Appendable Memory vector. What we want to teach AI in this study are the operations of memorizing and recalling information. However, traditional machine learning methods make AI learn features inherent in the learning dataset. We demonstrate that the systems we intend to create cannot be realized by current machine learning methods, that is, by merely repeating the input and output learning sequences with AI. Instead, we propose a method to teach AI to learn operations, by completely removing the features contained in the learning dataset. Specifically, we probabilized all the data involved in learning. This measure prevented AI from learning the features of the data. The learning method proposed in the study differs from traditional machine learning methods and provides fundamental approaches for building an AI system that can store information in a finite memory and recall it at a later date.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 6 of its 13 references that are in the map. First posted on arXiv 29 Jul 2024.
Builds on
6 of 13 references.
References · 6
- 2017Attention Is All You Needcited by 60,106
- 2020Denoising Diffusion Probabilistic Modelscited by 20,952
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,492
- 2016Optimization Methods for Large-Scale Machine Learningcited by 1,142
- 2019Learning from Dialogue after Deployment: Feed Yourself, Chatbot!cited by 102
- 2024Beyond the Limits: A Survey of Techniques to Extend the Context Length in Large Language Modelscited by 72
Built on by
Not cited yet.