Goal-VLA: Image-Generative VLMs as Object-Centric World Models Empowering Zero-shot Robot Manipulation
On the map: World models → Embodied and robot world models
Abstract (arXiv)
Generalization remains a fundamental challenge in robotic manipulation. To tackle this challenge, recent Vision-Language-Action (VLA) models build policies on top of Vision-Language Models (VLMs), seeking to transfer their open-world semantic knowledge. However, their zero-shot capability lags significantly behind the base VLMs, as the instruction-vision-action data is too limited to cover diverse scenarios, tasks, and robot embodiments. In this work, we present Goal-VLA, a zero-shot framework that leverages Image-Generative VLMs as world models to generate desired goal states, from which the target object pose is derived to enable generalizable manipulation. The key insight is that object state representation is the golden interface, naturally separating a manipulation system into high-level and low-level policies. This representation abstracts away explicit action annotations, allowing the use of highly generalizable VLMs while simultaneously providing spatial cues for training-free low-level control. To further improve robustness, we introduce a Reflection-through-Synthesis process that iteratively validates and refines the generated goal image before execution. Both simulated and real-world experiments demonstrate that our name achieves strong performance and inspiring generalizability in manipulation tasks. Supplementary materials are available at https://nus-lins-lab.github.io/goalvlaweb/.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 15 of its 50 references that are in the map. First posted on arXiv 30 Jun 2025.
Builds on
15 of 50 references.
Closest ancestors · 4
Same direction, newest first
- 2025Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasets3 Apr
- 2024iVideoGPT: Interactive VideoGPTs are Scalable World Models24 May
- 20243D-VLA: A 3D Vision-Language-Action Generative World Model14 Mar
- 2023Zero-Shot Robotic Manipulation with Pretrained Image-Editing Diffusion Models16 Oct
Other references · 11
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 914
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
- 2022DayDreamer: World Models for Physical Robot Learningcited by 372
- 2024ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulationcited by 305
- 2024A Survey on Vision-Language-Action Models for Embodied AIcited by 274
- 2024A Self-Correcting Vision-Language-Action Model for Fast and Slow System Manipulationcited by 20
Built on by
Citing papers per year: 2026: 15.
15 papers.
Sort:
By area:
- 2026OA-WAM: Object-Addressable World Action Model for Robust Robot Manipulationcited by 25
- 2026RHO: Your Coding Agent is Secretly a Roboticistcited by 18
- 2026Show-Harness: Just a VLM Agent Can Play Robotscited by 17
- 2026LiLa-WAM: Lightweight Latent Reasoning World-Action Model for Robotic Manipulationcited by 9
- 2026H-WM: Robotic Task and Motion Planning Guided by Hierarchical World Modelcited by 6
- 2026MultihopSpatial: Multi-hop Compositional Spatial Reasoning Benchmark for Vision-Language Modelcited by 3
- 2026AC-VLA: Robust Out-of-Distribution Action Execution via Compositional Learningcited by 3
- 2026Continuous Reasoning for Vision-Language-Actioncited by 2
- 2026SWEET: Sparse World Modeling with Image Editing for Embodied Task Executioncited by 1
- 2026GeoAlign: Beyond Semantics with State-Guided Spatial Alignment in VLA Modelscited by 1
- 2026World Models for Embodied Intelligence: From Plausible to Controllable to Actionablecited by 1
- 2026LAMP: Lift Image-Editing as General 3D Priors for Open-world Manipulationcited by 0
- 2026World Models for Embodied Intelligence: From Plausible to Controllable to Actionable15 Sep 2026
- 2026Dynin-Robotics: Omnimodal Unified Diffusion Vision-Language-Action Model11 Sep 2026
- 2026Show-Harness: Just a VLM Agent Can Play Robots9 Sep 2026
- 2026GIFT: Goal-Injected Fine-Tuning for Efficient Manipulation Policy Adaptation7 Sep 2026
- 2026LiLa-WAM: Lightweight Latent Reasoning World-Action Model for Robotic Manipulation4 Aug 2026
- 2026AC-VLA: Robust Out-of-Distribution Action Execution via Compositional Learning17 Jul 2026
- 2026Pelican-VLA 0.5: Attending Before Acting Benefits Generalization7 Jul 2026
- 2026RHO: Your Coding Agent is Secretly a Roboticist15 Jun 2026
- 2026GeoAlign: Beyond Semantics with State-Guided Spatial Alignment in VLA Models2 Jun 2026
- 2026Continuous Reasoning for Vision-Language-Action29 May 2026
- 2026SWEET: Sparse World Modeling with Image Editing for Embodied Task Execution19 May 2026
- 2026OA-WAM: Object-Addressable World Action Model for Robust Robot Manipulation7 May 2026
- 2026AC-VLA: Robust Out-of-Distribution Action Execution via Compositional Learningcited by 3
- 2026GeoAlign: Beyond Semantics with State-Guided Spatial Alignment in VLA Modelscited by 1
- 2026Pelican-VLA 0.5: Attending Before Acting Benefits Generalizationcited by 0
- 2026GIFT: Goal-Injected Fine-Tuning for Efficient Manipulation Policy Adaptationcited by 0
- 2026Dynin-Robotics: Omnimodal Unified Diffusion Vision-Language-Action Modelcited by 0
- 2026Dynin-Robotics: Omnimodal Unified Diffusion Vision-Language-Action Model11 Sep 2026
- 2026GIFT: Goal-Injected Fine-Tuning for Efficient Manipulation Policy Adaptation7 Sep 2026
- 2026AC-VLA: Robust Out-of-Distribution Action Execution via Compositional Learning17 Jul 2026
- 2026Pelican-VLA 0.5: Attending Before Acting Benefits Generalization7 Jul 2026
- 2026GeoAlign: Beyond Semantics with State-Guided Spatial Alignment in VLA Models2 Jun 2026
- 2026OA-WAM: Object-Addressable World Action Model for Robust Robot Manipulationcited by 25
- 2026LiLa-WAM: Lightweight Latent Reasoning World-Action Model for Robotic Manipulationcited by 9
- 2026H-WM: Robotic Task and Motion Planning Guided by Hierarchical World Modelcited by 6
- 2026SWEET: Sparse World Modeling with Image Editing for Embodied Task Executioncited by 1
- 2026World Models for Embodied Intelligence: From Plausible to Controllable to Actionablecited by 1
- 2026World Models for Embodied Intelligence: From Plausible to Controllable to Actionable15 Sep 2026
- 2026LiLa-WAM: Lightweight Latent Reasoning World-Action Model for Robotic Manipulation4 Aug 2026
- 2026SWEET: Sparse World Modeling with Image Editing for Embodied Task Execution19 May 2026
- 2026OA-WAM: Object-Addressable World Action Model for Robust Robot Manipulation7 May 2026
- 2026H-WM: Robotic Task and Motion Planning Guided by Hierarchical World Model11 Feb 2026
- 2026RHO: Your Coding Agent is Secretly a Roboticistcited by 18
- 2026RHO: Your Coding Agent is Secretly a Roboticist15 Jun 2026
- 2026Show-Harness: Just a VLM Agent Can Play Robotscited by 17
- 2026Show-Harness: Just a VLM Agent Can Play Robots9 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2026Scaling World Model for Hierarchical Manipulation Policies
- 2026GeneralVLA: Generalizable Vision-Language-Action Models with Knowledge-Guided Trajectory Planning
- 2025VLA-0: Building State-of-the-Art VLAs with Zero Modification
- 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Survey
- 2026AWM-VLA: AlignedWorld Modeling for Efficient and Explainable Vision-Language-Action Policies
- 2025VLA^2: Empowering Vision-Language-Action Models with an Agentic Framework for Unseen Concept Manipulation
- 2026H-VLA: Hierarchical Vision-Language-Action Model with Key-Action Reasoning and Motion Planning in a Unified Action Space
- 2025VITA-VLA: Efficiently Teaching Vision-Language Models to Act via Action Expert Distillation