A Memory System of a Robot Cognitive Architecture and its Implementation in ArmarX
Not on the map. Why?
Abstract (arXiv)
Cognitive agents such as humans and robots perceive their environment through an abundance of sensors producing streams of data that need to be processed to generate intelligent behavior. A key question of cognition-enabled and AI-driven robotics is how to organize and manage knowledge efficiently in a cognitive robot control architecture. We argue, that memory is a central active component of such architectures that mediates between semantic and sensorimotor representations, orchestrates the flow of data streams and events between different processes and provides the components of a cognitive architecture with data-driven services for the abstraction of semantics from sensorimotor data, the parametrization of symbolic plans for execution and prediction of action effects. Based on related work, and the experience gained in developing our ARMAR humanoid robot systems, we identified conceptual and technical requirements of a memory system as central component of cognitive robot control architecture that facilitate the realization of high-level cognitive abilities such as explaining, reasoning, prospection, simulation and augmentation. Conceptually, a memory should be active, support multi-modal data representations, associate knowledge, be introspective, and have an inherently episodic structure. Technically, the memory should support a distributed design, be access-efficient and capable of long-term data storage. We introduce the memory system for our cognitive robot control architecture and its implementation in the robot software framework ArmarX. We evaluate the efficiency of the memory system with respect to transfer speeds, compression, reproduction and prediction capabilities.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 6 of its 65 references that are in the map. First posted on arXiv 5 Jun 2022.
Builds on
6 of 65 references.
References · 6
- 2013Auto-Encoding Variational Bayescited by 3,980
- 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,813
- 2015Deep multi-scale video prediction beyond mean square errorcited by 297
- 2021STORM: An Integrated Framework for Fast Joint-Space Model-Predictive Control for Reactive Manipulationcited by 46
- 2018A Survey of Knowledge Representation in Service Roboticscited by 18
- 2018Deep Episodic Memory: Encoding, Recalling, and Predicting Episodic Experiences for Robot Action Executioncited by 11
Built on by
Citing papers per year: 2023: 1; 2024: 3; 2025: 2; 2026: 5.
11 papers.
- 2024PerAct2: Benchmarking and Learning for Robotic Bimanual Manipulation Taskscited by 37
- 2023Incremental Learning of Humanoid Robot Behavior from Natural Interaction and Large Language Modelscited by 19
- 2024Robots Can Multitask Too: Integrating a Memory Architecture and LLMs for Enhanced Cross-Task Robot Action Generationcited by 5
- 2024Episodic Memory Verbalization using Hierarchical Representations of Life-Long Robot Experiencecited by 4
- 2026NativeMEM: Native Memory Compression for Long-Horizon Robotic Manipulationcited by 4
- 2025How Metacognitive Architectures Remember Their Own Thoughts: A Systematic Reviewcited by 2
- 2026eMEM: A Hybrid Spatio-Temporal Memory System For Embodied Agentscited by 1
- 2025Towards a cognitive architecture to enable natural language interaction in co-constructive task learningcited by 0
- 2026Learning to Forget -- Hierarchical Episodic Memory for Lifelong Robot Deploymentcited by 0
- 2026Human-Inspired Context-Selective Multimodal Memory for Social Robotscited by 0
- 2026Not Forgotten: Implementation and Evaluation of a Personalized Episodic Memory for the Humanoid Robot Head Kimcited by 0
- 2026Not Forgotten: Implementation and Evaluation of a Personalized Episodic Memory for the Humanoid Robot Head Kim27 Jul 2026
- 2026NativeMEM: Native Memory Compression for Long-Horizon Robotic Manipulation7 Jul 2026
- 2026eMEM: A Hybrid Spatio-Temporal Memory System For Embodied Agents2 Jun 2026
- 2026Human-Inspired Context-Selective Multimodal Memory for Social Robots13 Apr 2026
- 2026Learning to Forget -- Hierarchical Episodic Memory for Lifelong Robot Deployment13 Apr 2026
- 2025Towards a cognitive architecture to enable natural language interaction in co-constructive task learning31 Mar 2025
- 2025How Metacognitive Architectures Remember Their Own Thoughts: A Systematic Review28 Feb 2025
- 2024Episodic Memory Verbalization using Hierarchical Representations of Life-Long Robot Experience26 Sep 2024
- 2024Robots Can Multitask Too: Integrating a Memory Architecture and LLMs for Enhanced Cross-Task Robot Action Generation18 Jul 2024
- 2024PerAct2: Benchmarking and Learning for Robotic Bimanual Manipulation Tasks29 Jun 2024
- 2023Incremental Learning of Humanoid Robot Behavior from Natural Interaction and Large Language Models8 Sep 2023