JEPA-WAM: Learning Vision-Language-Action Policies with Joint-Embedding World Modeling
On the map: World models → Embodied and robot world models
also in 1 more
Abstract (arXiv)
Robust robot control benefits from explicitly modeling state transitions, but video-generation world action models (WAMs) introduce substantial deployment cost. Existing latent WAMs avoid explicit future generation, but often compress predictive representations or separate predictive modeling from the representations used for action generation. We introduce JEPA-WAM, a latent WAM built in a pretrained V-JEPA space, which couples latent transition prediction with continuous action generation through a shared predictor. JEPA-WAM predicts a spatially structured joint current-future target that captures task-shared visual temporal structure between current and future observations, while preserving dense patch-level correspondence. Through the shared predictor, transition supervision directly shapes the backbone, from which dedicated representations are extracted for action prediction. The same design can also be instantiated in pretrained VLA policies while preserving their original perception and action pathways. On LIBERO-Plus, JEPA-WAM achieves 79.2%, the best result without large-scale robot-policy pretraining, while its pretrained π0.5 instantiation reaches 86.3%, achieving the best overall performance. Experiments on RoboTwin 2.0 and real-world bimanual manipulation further demonstrate strong generalization under visual and spatial shifts.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 17 of its 22 references that are in the map. First posted on arXiv 10 Aug 2026.
Builds on
17 of 22 references.
Closest ancestors · 8
Same direction, newest first
- 2026LaWAM: Latent World Action Models for Efficient Dynamics-Aware Robot Policies14 Jun
- 2026StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developing6 Apr
- 2026FRAPPE: Infusing World Modeling into Generalist Policies via Multiple Future Representation Alignment19 Feb
- 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Model10 Feb
- 2026Causal World Modeling for Robot Control29 Jan
- 2025Motus: A Unified Latent Action World Model15 Dec
- 2025WorldVLA: Towards Autoregressive Action World Model26 Jun
- 2025FLARE: Robot Learning with Implicit World Modeling21 May
Other references · 9
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 477
- 2025LIBERO-Plus: In-depth Robustness Analysis of Vision-Language-Action Modelscited by 278
- 2026JEPA-VLA: Video Predictive Embedding is Needed for VLA Modelscited by 22
- 2026PokeVLA: Empowering Pocket-Sized Vision-Language-Action Model with Comprehensive World Knowledge Guidancecited by 6
- 2026Training Vision-Language-Action Models with Dense Embodied Chain-of-Thought Supervisioncited by 5
Built on by
Citing papers per year: 2026: 12.
12 papers.
- 2026World-Action Models for Robot Learning and Control: A Surveycited by 1
- 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Datacited by 1
- 2026PAVE: Predictive Alignment and Value-Guided Evolution for World-Action Policiescited by 0
- 2026CSWAM: Better Causal Semantic Representations for Out-of-Distribution Generalization in World Action Modelscited by 0
- 2026MoWAM: Explicit Future Motion Prediction for Efficient World Action Modelscited by 0
- 2026Copper-Policy: Focus on the Representation for Robust Robot Manipulationcited by 0
- 2026DeltaWAM: Change-Centric Visual Foresight via Delta Tokens for an Efficient World-Action Modelcited by 0
- 2026FutureDuet: Decoupling Observation Access from Future Supervision in World Action Modelscited by 0
- 2026One from Infinity: Actualizing Futures from Pretrained World Models into Robot Actionscited by 0
- 2026Staircase Policy: Streaming Inference for World-Action Models with Large Action Chunkscited by 0
- 2026V-JEPA Policy: Building Effective World-Action Models on Predictive Visual Latentscited by 0
- 2026Magic-W0: A Structured World-Action Foundation Model for Physical Intelligencecited by 0
- 2026Magic-W0: A Structured World-Action Foundation Model for Physical Intelligence30 Sep 2026
- 2026V-JEPA Policy: Building Effective World-Action Models on Predictive Visual Latents29 Sep 2026
- 2026Staircase Policy: Streaming Inference for World-Action Models with Large Action Chunks29 Sep 2026
- 2026One from Infinity: Actualizing Futures from Pretrained World Models into Robot Actions29 Sep 2026
- 2026FutureDuet: Decoupling Observation Access from Future Supervision in World Action Models28 Sep 2026
- 2026DeltaWAM: Change-Centric Visual Foresight via Delta Tokens for an Efficient World-Action Model27 Sep 2026
- 2026Copper-Policy: Focus on the Representation for Robust Robot Manipulation26 Sep 2026
- 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Data25 Sep 2026
- 2026MoWAM: Explicit Future Motion Prediction for Efficient World Action Models17 Sep 2026
- 2026CSWAM: Better Causal Semantic Representations for Out-of-Distribution Generalization in World Action Models16 Sep 2026
- 2026World-Action Models for Robot Learning and Control: A Survey13 Sep 2026
- 2026PAVE: Predictive Alignment and Value-Guided Evolution for World-Action Policies31 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026JEPA-WAM: Connecting Generated Visual Instructions to World Action Models through JEPA Latent Representations
- 2026GigaWorld-Policy: An Efficient Action-Centered World--Action Model
- 2026World2Act: Latent Action Post-Training from World Model Dynamics
- 2026GigaWorld-Policy-0.5: A Faster and Stronger WAM Empowered by AutoResearch
- 2026ACG-WAM: World-Action Modeling via Action-Conditioned Geometric Latent Prediction
- 2026ViDAL: A Visual Dynamics-Grounded Action Latent Space for Vision-Language-Action Models
- 2026Juno: Taming Predictive Latents for Vision-Language-Action Models
- 2026Being-H0.7: A Latent World-Action Model from Egocentric Videos