mlsanityData to 7 Oct 2026

DeltaWAM: Distilling Action Tangent Fields into World Action Models

arXiv 2610.09734 ↗First posted 7 Oct 2026cs.ROcited by 0

On the map: World models → Embodied and robot world models

Abstract (arXiv)

World Action Models (WAM) improve robot policies by augmenting sparse action supervision with dense future prediction. However, much of the predictable future is dominated by appearance and scene persistence rather than action-dependent dynamics. We observe that several recent WAM designs, including optical flow, motion-centric representations, and latent actions, can be understood from a common perspective in which world supervision becomes more efficient as it contains a higher proportion of action-relevant variation. Based on this insight, we introduce Action Tangent Fields, which reformulate world supervision through a local Taylor expansion of how actions induce changes in future dynamics. We represent future dynamics in Residual-VAE space, where the future latent remains recoverable from the current latent and its residual, and use a strong action-conditioned world model (ACWM) to probe the local correspondence between action variations and residual-world variations. This local first-order structure is distilled into the WAM to guide its denoising supervision toward dynamics that are more tightly coupled to action, rather than merely predictable from appearance. Across LIBERO-Plus, RoboTwin, and RoboTwin2.0-Plus, our method consistently improves robustness to lighting, background, camera, layout, and other environmental perturbations. Despite using no large-scale embodied pretraining, it achieves stronger robustness under several distribution shifts than pretrained policies. We further distill multi-step VideoDiT denoising into a single step for efficient inference. Our results suggest that effective WAM supervision should remain information-rich while concentrating its predictive capacity on the directions along which actions change the future.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. First posted on arXiv 7 Oct 2026.

Builds on

No reference list yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Foresight Without Seeing: Latent Futures for World Action Models
  2. 2026Faster-WAM: Efficient Inference-Time Future Conditioning for Robust World Action Models
  3. 2026SG-WAM: Self-Guided World Modeling in Geometry-Aware Policy Space
  4. 2026DualWAM: Dual-System World Action Models for Asynchronous Global Planning and Local Refinement
  5. 2026Sparse-WAM: Accelerating World Action Models via Action-Guided Sparse Imagination
  6. 2026MoWAM: Explicit Future Motion Prediction for Efficient World Action Models
  7. 2026From World Models to World Action Models: Rethinking Next-State Prediction
  8. 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Data