Meaning Versus Information, Prediction Versus Memory, and Question Versus Answer
Not on the map. Why?
Abstract (arXiv)
Brain science and artificial intelligence have made great progress toward the understanding and engineering of the human mind. The progress has accelerated significantly since the turn of the century thanks to new methods for probing the brain (both structure and function), and rapid development in deep learning research. However, despite these new developments, there are still many open questions, such as how to understand the brain at the system level, and various robustness issues and limitations of deep learning. In this informal essay, I will talk about some of the concepts that are central to brain science and artificial intelligence, such as information and memory, and discuss how a different view on these concepts can help us move forward, beyond current limits of our understanding in these fields.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 52 references that are in the map. First posted on arXiv 29 Jun 2021.
Builds on
14 of 52 references.
References · 14
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
- 2016Deep Visual Foresight for Planning Robot Motioncited by 276
- 2017Automatic Goal Generation for Reinforcement Learning Agentscited by 252
- 2019Paired Open-Ended Trailblazer (POET): Endlessly Generating Increasingly Complex and Diverse Learning Environments and Their Solutionscited by 182
- 2020Language as a Cognitive Tool to Imagine Goals in Curiosity-Driven Explorationcited by 68
- 2020Word meaning in minds and machinescited by 51
- 2021PIGLeT: Language Grounding Through Neuro-Symbolic Interaction in a 3D Worldcited by 47
- 2021Why AI is Harder Than We Thinkcited by 40
- 2017Learning by Asking Questionscited by 25
- 2017iVQA: Inverse Visual Question Answeringcited by 22
- 2017Independently Controllable Featurescited by 11
Built on by
Not cited yet.