Sensorimotor Self-Recognition in Multimodal Large Language Model-Driven Robots
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
Self-recognition -- the ability to maintain an internal representation of one's own body within the environment -- underpins intelligent, autonomous behavior. As a foundational component of the minimal self, self-recognition provides the initial substrate from which higher forms of self-awareness may eventually emerge. Recent advances in large language models achieve human-like performance in tasks integrating multimodal information, raising growing interest in the embodiment capabilities of AI agents deployed on nonhuman platforms such as robots. We investigate whether multimodal LLMs can develop self-recognition through sensorimotor experience by integrating an LLM into an autonomous mobile robot. The system exhibits robust environmental awareness, self-identification, and predictive awareness, enabling it to infer its robotic nature and motion characteristics. Structural equation modeling reveals how sensory integration influences distinct dimensions of the minimal self and their coordination with past-present memory, as well as the hierarchical internal associations that drive self-identification. Ablation tests of sensory inputs demonstrate compensatory interactions among sensors and confirm the essential role of structured and episodic memory. Given appropriate sensory information about the world and itself, multimodal LLMs open the door to artificial selfhood in embodied cognitive systems.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 11 of its 50 references that are in the map. First posted on arXiv 25 May 2025.
Builds on
11 of 50 references.
Closest ancestors · 1
Same direction, newest first
Other references · 10
- 2023GPT-4 Technical Reportcited by 18,396
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
- 2023A Survey on Evaluation of Large Language Modelscited by 1,242
- 2023Prometheus: Inducing Fine-grained Evaluation Capability in Language Modelscited by 575
- 2024Optimization-based Prompt Injection Attack to LLM-as-a-Judgecited by 143
- 2024LLM-based NLG Evaluation: Current Status and Challengescited by 73
- 2023Evaluating Language Models for Mathematics through Interactionscited by 70
- 2019An interdisciplinary overview of developmental indices and behavioral measures of the minimal selfcited by 2
- 2024Towards Development of Automated Knowledge Maps and Databases for Materials Engineering using Large Language Modelscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023LLM as A Robotic Brain: Unifying Egocentric Memory and Control
- 2026A Sense of Proprioception in Language Models
- 2023Chat with the Environment: Interactive Multimodal Perception Using Large Language Models
- 2026From Language to Action: Can LLM-Based Agents Be Used for Embodied Robot Cognition?
- 2024Reconfigurable Robot Identification from Motion Data
- 2025Minimal and Mechanistic Conditions for Behavioral Self-Awareness in LLMs
- 2016Discovering Latent States for Model Learning: Applying Sensorimotor Contingencies Theory and Predictive Processing to Model Context
- 2026Embodied GPT-5.1: Evidence of a World Model?