mlsanityData to 14 Oct 2026

FLEX-WAM: Flexible Block-Causal World-Action Models for Long-Horizon Imagination and Planning

arXiv 2610.05483 ↗First posted 4 Oct 2026cs.RO cs.AIcited by 0

On the map: World models → Embodied and robot world models also fits: Latent predictive world models

Abstract (arXiv)

World--action models (WAMs) promise a unified model that predicts action-conditioned futures, generates feasible actions, and supports planning in imagination. However, existing joint video--action models often use computationally heavy, fixed-horizon backbones ill-suited to streaming inference and stable long-horizon open-loop rollouts. We introduce FLEX-WAM, a Flexible and Efficient Block-Causal World--Action Model for unified simulation and policy inference. FLEX-WAM supports variable-length contexts and non-causal prediction horizons, as well as infinite autoregressive generation frame by frame or block by block. Its block-causal, KV-cacheable architecture combines axial attention and blockwise diffusion forcing to enable efficient real-time rollout and deployment-time latency--throughput tradeoffs without retraining. Joint training can nevertheless produce plausible futures that weakly respond to commanded actions. We address this failure mode by balancing state and action flow-matching gradient contributions across the state--action diffusion-noise grid and regulating world-model sampling using Forward-Dynamics (FD) elasticity, an efficient training-time proxy for action responsiveness. Across simulated and real-world datasets, FLEX-WAM achieves superior multi-step prediction quality and latency while producing stable joint state--action rollouts for thousands of steps. As a joint action proposer and simulator within MCTS, it solves long-horizon PushT and all five OGBench Puzzle-4x4 tasks entirely in imagination. On a bimanual OpenArm-based robot, a single checkpoint jointly serves as a play policy and expected-outcome predictor, enabling real-time identification and collection of model--reality mismatches for future self-improvement.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 18 of its 24 references that are in the map. First posted on arXiv 4 Oct 2026.

Builds on

18 of 24 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026World Action Models are Zero-shot Policies17 Feb
  2. 2026Coupled Local and Global World Models for Efficient First Order RL5 Feb
  3. 2025Motus: A Unified Latent Action World Model15 Dec
  4. 2025WorldPlanner: Monte Carlo Tree Search and MPC with Action-Conditioned Visual World Models4 Nov
  5. 2025Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasets3 Apr

Other references · 13

  1. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  2. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  3. 2021Offline Reinforcement Learning with Implicit Q-Learningcited by 1,293
  4. 2018Learning Latent Dynamics for Planning from Pixelscited by 1,264
  5. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
  6. 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 364
  7. 2019Axial Attention in Multidimensional Transformerscited by 358
  8. 2016Deep Visual Foresight for Planning Robot Motioncited by 285
  9. 2016Unsupervised Learning for Physical Interaction through Video Predictioncited by 260
  10. 2024OGBench: Benchmarking Offline Goal-Conditioned RLcited by 238
  11. 2026Cosmos 3: Omnimodal World Models for Physical AIcited by 165
  12. 2025Training Agents Inside of Scalable World Modelscited by 136
1 more
  1. 2024Prediction with Action: Visual Policy Learning via Joint Denoising Processcited by 70

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Sparse-WAM: Accelerating World Action Models via Action-Guided Sparse Imagination
  2. 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?
  3. 2026World Action Models: A Survey
  4. 2026AHA-WAM:Asynchronous Horizon-Adaptive World-Action Modeling with Observation-Guided Context Routing
  5. 2026DualWAM: Dual-System World Action Models for Asynchronous Global Planning and Local Refinement
  6. 2026MARS: Systematic Multi-Level Acceleration for World Action Models
  7. 2026CtrlWAM: Controllable World Action Models with Aligned Intent and Foresight
  8. 2026Foresight Without Seeing: Latent Futures for World Action Models