VLM-DEWM: Dynamic External World Model for Verifiable and Resilient Vision-Language Planning in Manufacturing
On the map: World models → Embodied and robot world models
Abstract (arXiv)
Vision-language model (VLM) shows promise for high-level planning in smart manufacturing, yet their deployment in dynamic workcells faces two critical challenges: (1) stateless operation, they cannot persistently track out-of-view states, causing world-state drift; and (2) opaque reasoning, failures are difficult to diagnose, leading to costly blind retries. This paper presents VLM-DEWM, a cognitive architecture that decouples VLM reasoning from world-state management through a persistent, queryable Dynamic External World Model (DEWM). Each VLM decision is structured into an Externalizable Reasoning Trace (ERT), comprising action proposal, world belief, and causal assumption, which is validated against DEWM before execution. When failures occur, discrepancy analysis between predicted and observed states enables targeted recovery instead of global replanning. We evaluate VLM-DEWM on multi-station assembly, large-scale facility exploration, and real-robot recovery under induced failures. Compared to baseline memory-augmented VLM systems, VLM DEWM improves state-tracking accuracy from 56% to 93%, increases recovery success rate from below 5% to 95%, and significantly reduces computational overhead through structured memory. These results establish VLM-DEWM as a verifiable and resilient solution for long-horizon robotic operations in dynamic manufacturing environments.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 18 of its 32 references that are in the map. First posted on arXiv 17 Feb 2026.
Builds on
18 of 32 references.
References · 18
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,057
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
- 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 598
- 2023PaLI-X: On Scaling up a Multilingual Vision and Language Modelcited by 254
- 2024RT-H: Action Hierarchies Using Languagecited by 204
- 2023BundleSDF: Neural 6-DoF Tracking and 3D Reconstruction of Unknown Objectscited by 144
- 2025SAM2Act: Integrating Visual Foundation Model with A Memory Architecture for Robotic Manipulationcited by 58
- 2024A Survey on LLM-based Multi-Agent System: Recent Advances and New Frontiers in Applicationcited by 54
- 2024Self-evolving Agents with reflective and memory-augmented abilitiescited by 52
6 more
- 2024RoboEXP: Action-Conditioned Scene Graph via Interactive Exploration for Robotic Manipulationcited by 48
- 2024GraspSplats: Efficient Manipulation with 3D Feature Splattingcited by 41
- 2024Dynamic Open-Vocabulary 3D Scene Graphs for Long-term Language-Guided Mobile Manipulationcited by 38
- 2024Emotional RAG: Enhancing Role-Playing Agents through Emotional Retrievalcited by 26
- 2023CATNIPS: Collision Avoidance Through Neural Implicit Probabilistic Scenescited by 19
- 2024GeAR: Graph-enhanced Agent for Retrieval-augmented Generationcited by 17
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026H-WM: Robotic Task and Motion Planning Guided by Hierarchical World Model
- 2025Towards Logic-Aware Manipulation: A Knowledge Primitive for VLM-Based Assistants in Smart Manufacturing
- 2026GAVEL: Graph World Models for Verified and Efficient Long-Horizon LLM Task Planning
- 2026ProAct-VLM: Pre-Failure Vision-Language Task Replanning with Continuous Perception Feedback ↗
- 2025Planning with Reasoning using Vision Language World Model
- 2025Vision-Language-Policy Model for Dynamic Robot Task Planning
- 2025ExploreVLM: Closed-Loop Robot Exploration Task Planning with Vision-Language Models
- 2025Making VLMs More Robot-Friendly: Self-Critical Distillation of Low-Level Procedural Reasoning