mlsanityData to 7 Oct 2026

RealtimeWAM: One-Step Asynchronous World Action Models

arXiv 2610.06617 ↗First posted 5 Oct 2026cs.CV cs.LG cs.ROcited by 0

On the map: World models → Embodied and robot world models also fits: Video-generation world models and simulators

Abstract (arXiv)

World Action Models (WAMs) incorporate visual representations from video generation backbones to guide action prediction. Recent efficient WAMs adopt Mixture-of-Transformers (MoT) architectures and compute video representations once for reuse by the action expert. However, intra-expert iteration (ie, multi-step action denoising) and inter-expert waiting (ie, sequential execution of the video and action experts) still limit inference efficiency. To this end, we present RealtimeWAM, an extremely efficient WAM variant with one-step action generation and asynchronous inference, addressing these two bottlenecks. To reduce intra-expert iteration, we propose Teacher-Anchored Consistency Distillation (TACD) to address a local-global error gap: low local consistency error alone does not guarantee accurate final actions. TACD supplements local consistency with explicit supervision from the frozen teacher's multi-step rollout endpoint, enabling accurate one-step action generation. Additionally, we propose Cross-Expert Wavefront Pipelining (CEWP) to eliminate unnecessary expert-level waiting. It overlaps the two experts through block-wise sharing of the video KV cache, synchronizing only immediately before the corresponding action attention consumes it. Extensive experiments across diverse benchmarks (eg, LIBERO, LIBERO-Plus and RoboTwin) and model variants (eg, Fast-WAM and Faster-WAM) demonstrate the superiority of RealtimeWAM. Notably, RealtimeWAM maintains near-lossless performance (ie, <1% drop) across these benchmarks while delivering significant end-to-end speedup (eg, ~25× on H100). Our code and checkpoints are available via this hrefhttps://github.com/ModelTC/LightX2V/tree/main/examples/realtimewamlink.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. First posted on arXiv 5 Oct 2026.

Builds on

No reference list yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026RealtimeWAM: How Fast Can I Run My World Action Model?
  2. 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?
  3. 2026Flash-WAM: Modality-Aware Distillation for World Action Models
  4. 2026AHA-WAM:Asynchronous Horizon-Adaptive World-Action Modeling with Observation-Guided Context Routing
  5. 2026SplineWAM: Adaptive Action Horizons for World Action Models via B-Spline Representations
  6. 2026ImageWAM: Do World Action Models Really Need Video Generation, or Just Image Editing?
  7. 2026Efficient-WAM: A 1B-Parameter World-Action Model with Low-Cost Future Imagination
  8. 2026AnyStep-WAM: Budget-Aligned Distillation and Adaptive Inference for World Action Models