mlsanityData to 7 Oct 2026

Native Action-Prior Learning from Videos for World Action Models

arXiv 2610.03391 ↗First posted 2 Oct 2026cs.CV cs.ROcited by 0

On the map: World models → Embodied and robot world models

also in 1 more
Abstract (arXiv)

World action models integrate future visual dynamics with robot action prediction, but their scalability remains limited by the need for action-annotated robot trajectories. Observation-only videos contain rich evidence about interaction dynamics, but existing approaches typically use them either to pretrain visual representations that must later be adapted for control, or to infer latent actions that are subsequently grounded to robot commands. We present NAVA-WAM, which introduces native action-prior learning by directly pretraining the action policy from observation-only videos, avoiding indirect representation-to-control transfer or a separate latent-action model. Our training consists of two stages. First, we pretrain on observation-only videos, where future-video flow-matching supervision over visual transitions is propagated through transition-structured joint attention to optimize the Action-DiT and learn action-relevant priors. Second, we use action-labeled demonstrations to post-train the Action-DiT for robot control through joint video--action flow matching, while asymmetric attention decouples the visual branch from iterative action denoising and enables efficient action-only inference. Extensive experiments show that NAVA-WAM consistently outperforms prior approaches under both in-distribution and out-of-distribution settings, while demonstrating strong action-label efficiency and effective real-robot generalization. These results establish native action-prior learning as an effective approach to directly pretrain action policies from observation-only videos, providing a scalable path beyond action-labeled robot data.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. First posted on arXiv 2 Oct 2026.

Builds on

No reference list yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Data
  2. 2026Vid2WAM: Distilling Video Diffusion Priors into World Action Models
  3. 2026Learning Transferable Dynamics Priors from Action to World Modeling
  4. 2026Foresight Without Seeing: Latent Futures for World Action Models
  5. 2026Native Video-Action Pretraining for Generalizable Robot Control
  6. 2025mimic-video: Video-Action Models for Generalizable Robot Control Beyond VLAs
  7. 2026EVO-WAM: Evolving World Action Models through Video-Action Verification
  8. 2026LD4WAM: Learning Latent Dynamics from Human Videos for World Action Models