Embodied GPT-5.1: Evidence of a World Model?
On the map: World models → World models for navigation
Abstract (arXiv)
This exploratory study examines whether a large multimodal language model, GPT-5.1, can serve as the high-level controller of a physical mobile robot despite having no prior embodiment, no training in simulated environments, and no exposure to sensorimotor experience. Using only low-resolution first-person images and a discrete action set, the model was tasked with navigation and object-directed behaviors such as locating and contacting a target toy. Across multiple trials, GPT-5.1 demonstrated emergent capabilities that suggest elements of spatial reasoning and physical understanding. These included maintaining short-term memory of object locations after they left the camera frame, inferring the physical consequences of its own movements, and executing coherent action sequences such as colliding with an object and reversing to visually verify the outcome. At the same time, the model displayed inefficiencies and perceptual limitations, including imprecise alignment strategies and occasional misidentification of distant distractors. Overall, the results indicate that GPT-5.1 exhibits signs of world-model-like behavior in an embodied setting, despite the absence of any embodiment-related training, a finding that challenges long-standing views in cognitive science and robotics which hold that a physical body is a necessary prerequisite for developing such forms of intelligence. The findings motivate deeper investigation into the emergence, limits, and robustness of physical understanding in large language models.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in World models for navigation, one of 11 directions in World models. Builds on 7 of its 17 references that are in the map. First posted on arXiv 27 Jul 2026.
Builds on
7 of 17 references.
References · 7
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
- 2018World Modelscited by 1,444
- 2023EmbodiedGPT: Vision-Language Pre-Training via Embodied Chain of Thoughtcited by 276
- 2024Understanding World or Predicting Future? A Comprehensive Survey of World Modelscited by 161
- 2023LangNav: Language as a Perceptual Representation for Navigationcited by 47
- 2023RobotGPT: Robot Manipulation Learning from ChatGPTcited by 39
- 2024Deployment of Large Language Models to Control Mobile Robots at the Edgecited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Large Language Models for Robotics: Opportunities, Challenges, and Perspectives
- 2026World Models for Embodied Intelligence: From Plausible to Controllable to Actionable
- 2025A Survey: Learning Embodied Intelligence from Physical Simulators and World Models
- 2025ENACT: Evaluating Embodied Cognition with World Modeling of Egocentric Interaction
- 2025NavBench: Probing Multimodal Large Language Models for Embodied Navigation
- 2026From World Action Models to Embodied Brains: A Roadmap for Open-World Physical Intelligence
- 2023GPT-4V(ision) for Robotics: Multimodal Task Planning from Human Demonstration
- 2025From Grounding to Manipulation: Case Studies of Foundation Model Integration in Embodied Robotic Systems