mlsanityData to 14 Oct 2026

DeltaWAM: Change-Centric Visual Foresight via Delta Tokens for an Efficient World-Action Model

arXiv 2609.33177 ↗First posted 27 Sep 2026cs.RO cs.CVcited by 0

On the map: World models → Embodied and robot world models

Abstract (arXiv)

World-Action Models (WAMs) offer visual foresight for robotic manipulation, but pixel-space models repeatedly reconstruct entire future scenes, incurring high computational cost and spatio-temporal redundancy. In physical manipulation, consecutive frames often share most of their visual context; the changes between them are what an action policy needs to anticipate. We introduce DeltaWAM, a change-centric WAM that makes a compact delta token the unit of future prediction. Each token is a single vector encoding changes between consecutive dense DINO feature maps. DeltaWAM builds on DeltaWorld, a latent world model pretrained on large-scale videos, to autoregressively predict one delta token per future frame. A flow-matching action expert then conditions on the predicted transitions and current DINO features, which serve as spatial anchors, to generate action chunks. Trained for 256 GPU hours on two H100 GPUs, DeltaWAM has 0.725B parameters and achieves 92.8% average success on LIBERO. It also shows robust generalization under procedural perturbations on LIBERO-Pro. Inference takes 142.1 ms per action chunk with 3.86 GB peak memory.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 51 of its 59 references that are in the map. First posted on arXiv 27 Sep 2026.

Builds on

51 of 59 references.

Closest ancestors · 18

Same direction, newest first

  1. 2026DELE-w0.5: Inferring Action from Future Latent State for Robotic Manipulation22 Aug
  2. 2026Foresight Without Seeing: Latent Futures for World Action Models12 Aug
  3. 2026JEPA-WAM: Learning Vision-Language-Action Policies with Joint-Embedding World Modeling10 Aug
  4. 2026LiLa-WAM: Lightweight Latent Reasoning World-Action Model for Robotic Manipulation4 Aug
  5. 2026LaWAM: Latent World Action Models for Efficient Dynamics-Aware Robot Policies14 Jun
  6. 2026Light-WAM: Efficient World Action Models with State-Fusion Action Decoding6 Jun
  7. 2026Being-H0.7: A Latent World-Action Model from Egocentric Videos30 Apr
  8. 2026Do World Action Models Generalize Better than VLAs? A Robustness Study23 Mar
  9. 2026GigaWorld-Policy: An Efficient Action-Centered World--Action Model18 Mar
  10. 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?17 Mar
  11. 2026World Guidance: World Modeling in Condition Space for Action Generation25 Feb
  12. 2026World Action Models are Zero-shot Policies17 Feb
6 more
  1. 2026Causal World Modeling for Robot Control29 Jan
  2. 2025Motus: A Unified Latent Action World Model15 Dec
  3. 2025WorldVLA: Towards Autoregressive Action World Model26 Jun
  4. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planning11 Jun
  5. 2025Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasets3 Apr
  6. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusion7 Mar

Other references · 33

  1. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  3. 2022Scalable Diffusion Models with Transformerscited by 6,054
  4. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
  5. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  6. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  7. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  8. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
  9. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  10. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
  11. 2025DINOv3cited by 1,414
  12. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
21 more
  1. 2018Learning Latent Dynamics for Planning from Pixelscited by 1,264
  2. 2018Recurrent World Models Facilitate Policy Evolutioncited by 785
  3. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 665
  4. 2023TD-MPC2: Scalable, Robust World Models for Continuous Controlcited by 512
  5. 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 410
  6. 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planningcited by 386
  7. 2016A Learned Representation For Artistic Stylecited by 341
  8. 2019A Short Note on the Kinetics-700 Human Action Datasetcited by 310
  9. 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 303
  10. 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 300
  11. 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 289
  12. 2016Unsupervised Learning for Physical Interaction through Video Predictioncited by 260
  13. 2025MolmoAct: Action Reasoning Models that can Reason in Spacecited by 197
  14. 2025LIBERO-PRO: Towards Robust and Fair Evaluation of Vision-Language-Action Models Beyond Memorizationcited by 179
  15. 2025mimic-video: Video-Action Models for Generalizable Robot Control Beyond VLAscited by 142
  16. 2025NORA: A Small Open-Sourced Generalist Vision Language Action Model for Embodied Taskscited by 127
  17. 2025F1: A Vision-Language-Action Model Bridging Understanding and Generation to Actionscited by 86
  18. 2018Accurate and Diverse Sampling of Sequences based on a "Best of Many" Sample Objectivecited by 56
  19. 2026LDA-1B: Scaling Latent Dynamics Action Model via Universal Embodied Data Ingestioncited by 52
  20. 2026A Frame is Worth One Token: Efficient Generative World Modeling with Delta Tokenscited by 10
  21. 2018Visual Reasoning with Multi-hop Feature Modulationcited by 7

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026DeltaWAM: Delta World Action Models for Bimanual Manipulation
  2. 2026PACT-WAM: Predicting Actions and Visual Foresight with Compact Temporal Encoding for Robot Manipulation
  3. 2026Bridge-WA: Predicting Where and How the World Changes for Robotic Action
  4. 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Data
  5. 2026MemoryWAM: Efficient World Action Modeling with Persistent Memory
  6. 2026ST-WAM: Semantic-Temporal World Action Model for Robust Manipulation under Visual Distribution Shifts
  7. 2026Beyond Dense Futures: World Models as Structured Planners for Robotic Manipulation
  8. 2026MoWAM: Explicit Future Motion Prediction for Efficient World Action Models