mlsanityData to 7 Oct 2026

StageWAM: Joint-Embedding Stage Prediction for World-Action Models in Robot Manipulation

arXiv 2608.10780 ↗First posted 11 Aug 2026cs.ROcited by 3

On the map: World models → Embodied and robot world models

also in 1 more
Abstract (arXiv)

Generalist robot policies aim to map multimodal observations and linguistic task instructions to actions across diverse tasks. However, existing methods typically represent the future as a fixed, short video-action chunk. This short-term future captures local scene evolution for action execution, but it does not explicitly describe the stage-level future that specifies how a task should progress from its current stage to the next. We therefore distinguish two complementary futures for robot manipulation: a short-term physical future to capture local scene evolution and a stage-level semantic future to represent task progress. We introduce StageWAM, which augments a Motus-based World Action Model (WAM) with Stage-JEPA, a goal-conditioned Joint-Embedding Predictive Architecture (JEPA) predictor. Given the current observation and task instruction, Stage-JEPA uses a frozen V-JEPA2 encoder to extract the current-state representation and predicts the latent target of the next inferred stage. Across 50 RoboTwin 2.0 tasks in clean and randomized environments, StageWAM achieves 90.25% overall success and reduces the mean number of execution steps in successful rollouts by 5.97% relative to the strongest baseline.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 26 of its 40 references that are in the map. First posted on arXiv 11 Aug 2026.

Builds on

26 of 40 references.

Closest ancestors · 13

Same direction, newest first

  1. 2026Learning 4D Geometric Priors for Inference-Efficient World Action Models6 Jul
  2. 2026LaWAM: Latent World Action Models for Efficient Dynamics-Aware Robot Policies14 Jun
  3. 2026Unifying Object-Centric World Models and Diffusion Policy: A Hierarchical Framework for Multi-Stage Robotic Tasks7 Jun
  4. 2026DexFuture: Hierarchical Future-State Visuomotor Targeting for Bimanual Dexterous Tool Use4 Jun
  5. 2026HarmoWAM: Harmonizing Generalizable and Precise Manipulation via Adaptive World Action Models11 May
  6. 2026OA-WAM: Object-Addressable World Action Model for Robust Robot Manipulation7 May
  7. 2026Motubrain: An Advanced World Action Model for Robot Control30 Apr
  8. 2026H-WM: Robotic Task and Motion Planning Guided by Hierarchical World Model11 Feb
  9. 2026Scaling World Model for Hierarchical Manipulation Policies11 Feb
  10. 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Model10 Feb
  11. 2025Motus: A Unified Latent Action World Model15 Dec
  12. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planning11 Jun
1 more
  1. 2025Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasets3 Apr

Other references · 13

  1. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  2. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  3. 2025Qwen3-VL Technical Reportcited by 2,534
  4. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  5. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
  6. 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
  7. 2023Mastering Diverse Domains through World Modelscited by 1,193
  8. 2020Mastering Atari with Discrete World Modelscited by 990
  9. 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 490
  10. 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 477
  11. 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 285
  12. 2025Unified Video Action Modelcited by 195
1 more
  1. 2026Improving Vision-Language-Action Model Fine-Tuning with Structured Stage and Keyframe Supervisioncited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Data
  2. 2026PACT-WAM: Predicting Actions and Visual Foresight with Compact Temporal Encoding for Robot Manipulation
  3. 2026DELE-w0.5: Inferring Action from Future Latent State for Robotic Manipulation
  4. 2026GE-Act 2.0: Pretraining and Scaling a World-Action Model for Robotic Manipulation
  5. 2026Beyond Task Success: Behavioral and Representational Diagnostics for WAM and VLA
  6. 2026World Models for Robotic Manipulation: A Survey
  7. 2026JEPA-WAM: Learning Vision-Language-Action Policies with Joint-Embedding World Modeling
  8. 2026UniMPA: A Unified Memory-Prediction-Action Model via Action-Grounded Transition Modeling