mlsanityData to 7 Oct 2026

Mind the Execution Gap: Action-Semantic Mismatch in World-Model Control

arXiv 2610.06582 ↗First posted 5 Oct 2026cs.AI cs.CL cs.IRcited by 0

On the map: World models → World model security and GUI agents also fits: World models for language agents

Abstract (arXiv)

World-model controllers rely on action-conditioned dynamics for prediction and planning, yet real control systems often execute commands asynchronously due to communication delay, packet loss, reordering, and actuator buffering. We study how asynchronous execution changes the action semantics assumed within world-model controllers, rather than treating it only as an external control disturbance. Through controlled interventions, we identify two architecture-dependent failure modes: planning-based controllers such as TD-MPC2 suffer from a future-action timeline mismatch between imagined and executed action sequences, while recurrent world models such as DreamerV3 can attribute observed transitions to commands that were not actually applied. Our analysis shows that TD-MPC2 requires the correct future action sequence during latent dynamics rollout, whereas DreamerV3 requires timely attribution of each transition to the action that generated it. Based on these findings, we introduce two lightweight execution-consistent interfaces, Future-Sequence for TD-MPC2 and Applied-Action Feedback for DreamerV3, that correct these mismatches without modifying the pretrained world models. Experiments across delays, packet loss, reordering, multiple control domains, measured network traces, and a process-separated asynchronous stack consistently support both diagnoses and the corresponding architecture-specific corrections.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in World model security and GUI agents, one of 11 directions in World models. First posted on arXiv 5 Oct 2026.

Builds on

No reference list yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026World Action Models in Real Time: An Empirical Study of Smooth Execution via Asynchronous Deployment
  2. 2026ReSync: Re-Aligning the Two Clocks of Asynchronous World-Action Models
  3. 2026Is the Future Compatible? Diagnosing Dynamic Consistency in World Action Models
  4. 2026ATM: Action-Consistency Transfer Matrix for Diagnosing and Improving Latent World Models
  5. 2026Rethink Before You Execute: Adaptive Execution for World Action Models
  6. 2026Do Robotic World Models Really Follow Actions? Diagnosing and Aligning Action-Conditioned Generation for Policy Learning
  7. 2026ActSWM: Action-Sensitive World Models for Long-Horizon Planning in Open-World Games
  8. 2026Action-Consequence Alignment for Reliable Planning and Self-Improving in Latent World Models