Mirror, Mirror on the Wall: Can VLM Agents Tell Who They Are at All?
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
In the animal kingdom, mirror self-recognition is a canonical probe of higher-order cognition, emerging only in some species. We ask whether an analogous functional capability emerges in embodied vision-language model (VLM) agents: can they recognize themselves in a mirror? We introduce a controlled 3D benchmark where a first-person VLM agent must infer a hidden body attribute from its reflection and select the matching target, while avoiding self-other misattribution. To separate mirror-grounded self-identification from shortcuts, we test mirror removal, misleading cues, and occluded reflections. We also evaluate the decision process through mirror seeking, temporal ordering, self-attribution, and reasoning-action consistency. Our experiments show that mirror-based self-identification emerges mainly in stronger VLMs. These models can use reflected evidence for action, whereas weaker models often inspect the mirror but fail to extract self-relevant information or misattribute their reflection. Language-vision conflict further shows that self-referential language alone is not evidence of grounded self-identification. Overall, mirror-based evaluation provides a diagnostic for whether embodied self-grounding is causally rooted in perception and action rather than priors, prompt compliance, or confabulation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 12 of its 40 references that are in the map. First posted on arXiv 9 May 2026.
Builds on
12 of 40 references.
References · 12
- 2025Qwen3 Technical Reportcited by 8,820
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,141
- 2025OpenAI GPT-5 System Cardcited by 989
- 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 914
- 2024Vision language models are blind: Failing to translate detailed visual features into wordscited by 147
- 2026Ministral 3cited by 114
- 2024NaturalBench: Evaluating Vision-Language Models on Natural Adversarial Samplescited by 97
- 2025Self-Rewarding Vision-Language Model via Reasoning Decompositioncited by 97
- 2024Calibrated Self-Rewarding Vision Language Modelscited by 78
- 2024Enhancing Visual-Language Modality Alignment in Large Vision Language Models via Self-Improvementcited by 74
- 2019Embodied Visual Recognitioncited by 9
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026MirrorBench: Evaluating Self-centric Intelligence in MLLMs by Introducing a Mirror
- 2025From Emergence to Control: Probing and Modulating Self-Reflection in Language Models
- 2026Belief Without Behavior: Measuring the Translation of Theory of Mind into Coordinated Social Action in Vision-Language Models
- 2026Hy-Embodied-VLM-1.0: Efficient Physical-World Agents
- 2026How Foundational Skills Influence VLM-based Embodied Agents:A Native Perspective
- 2026Do Vision-Language-Action Models Mean What They Say? On the Role of Faithfulness in Embodied Reasoning
- 2026Mirror Learning
- 2026MIRROR: A Hierarchical Benchmark for Metacognitive Calibration in Large Language Models