mlsanityData to 7 Oct 2026

Goal-VLA: Image-Generative VLMs as Object-Centric World Models Empowering Zero-shot Robot Manipulation

arXiv 2506.23919 ↗First posted 30 Jun 2025cs.ROcited by 15

On the map: World models → Embodied and robot world models

Abstract (arXiv)

Generalization remains a fundamental challenge in robotic manipulation. To tackle this challenge, recent Vision-Language-Action (VLA) models build policies on top of Vision-Language Models (VLMs), seeking to transfer their open-world semantic knowledge. However, their zero-shot capability lags significantly behind the base VLMs, as the instruction-vision-action data is too limited to cover diverse scenarios, tasks, and robot embodiments. In this work, we present Goal-VLA, a zero-shot framework that leverages Image-Generative VLMs as world models to generate desired goal states, from which the target object pose is derived to enable generalizable manipulation. The key insight is that object state representation is the golden interface, naturally separating a manipulation system into high-level and low-level policies. This representation abstracts away explicit action annotations, allowing the use of highly generalizable VLMs while simultaneously providing spatial cues for training-free low-level control. To further improve robustness, we introduce a Reflection-through-Synthesis process that iteratively validates and refines the generated goal image before execution. Both simulated and real-world experiments demonstrate that our name achieves strong performance and inspiring generalizability in manipulation tasks. Supplementary materials are available at https://nus-lins-lab.github.io/goalvlaweb/.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 15 of its 50 references that are in the map. First posted on arXiv 30 Jun 2025.

Builds on

15 of 50 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasets3 Apr
  2. 2024iVideoGPT: Interactive VideoGPTs are Scalable World Models24 May
  3. 20243D-VLA: A 3D Vision-Language-Action Generative World Model14 Mar
  4. 2023Zero-Shot Robotic Manipulation with Pretrained Image-Editing Diffusion Models16 Oct

Other references · 11

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  3. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  4. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  5. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
  6. 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 914
  7. 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
  8. 2022DayDreamer: World Models for Physical Robot Learningcited by 372
  9. 2024ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulationcited by 305
  10. 2024A Survey on Vision-Language-Action Models for Embodied AIcited by 274
  11. 2024A Self-Correcting Vision-Language-Action Model for Fast and Slow System Manipulationcited by 20

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 15.

15 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2026Scaling World Model for Hierarchical Manipulation Policies
  2. 2026GeneralVLA: Generalizable Vision-Language-Action Models with Knowledge-Guided Trajectory Planning
  3. 2025VLA-0: Building State-of-the-Art VLAs with Zero Modification
  4. 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Survey
  5. 2026AWM-VLA: AlignedWorld Modeling for Efficient and Explainable Vision-Language-Action Policies
  6. 2025VLA^2: Empowering Vision-Language-Action Models with an Agentic Framework for Unseen Concept Manipulation
  7. 2026H-VLA: Hierarchical Vision-Language-Action Model with Key-Action Reasoning and Motion Planning in a Unified Action Space
  8. 2025VITA-VLA: Efficiently Teaching Vision-Language Models to Act via Action Expert Distillation