On the Capability Separation Between World-Model Policy Learning and Imitated World-Action Models
On the map: World models → Embodied and robot world models
Abstract (arXiv)
World-action models predict a future outcome and then infer an associated action. Although this factorization can improve representation learning and data efficiency, it is unclear whether it provides stronger control capability than direct behavior cloning when both are trained from the same observational demonstrations. We compare a direct behavior-cloning policy, an imitation-trained world-action policy, and a policy optimized with an action-conditioned world model. At the controller-class level, every world-action policy can be flattened into a direct stochastic policy with the same closed-loop trajectory distribution. At the population level, under realizability, exact optimization, common deployment information, and distribution-preserving deployment, direct behavior cloning and world-action imitation both recover the observational behavior policy. Thus, future prediction changes the learning factorization but not the unrestricted external policy class or ideal imitation target. Action-conditioned world-model learning differs by predicting outcomes under specified actions and comparing them through a control objective. We characterize the irreducible action-specific prediction error of future models that do not condition on the candidate action, identify conditions under which a world-action joint can recover an interventional forward model, and show that observational demonstrations do not identify action effects in general. Finally, we construct an environment family in which every observational learner has positive worst-case regret, whereas one informative intervention permits zero regret. The key distinction is therefore between predicting futures associated with observed behavior and predicting consequences of specified actions for policy optimization.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 0 of its 22 references that are in the map. First posted on arXiv 23 Aug 2026.
Builds on
0 of 22 references.
No references here yet.
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Enhancing Policy Learning with World-Action Model
- 2025WorldPlanner: Monte Carlo Tree Search and MPC with Action-Conditioned Visual World Models
- 2026World Action Verifier: Self-Improving World Models via Forward-Inverse Asymmetry
- 2026Do Robotic World Models Really Follow Actions? Diagnosing and Aligning Action-Conditioned Generation for Policy Learning
- 2026PAVE: Predictive Alignment and Value-Guided Evolution for World-Action Policies
- 2026Direct Experience World-Model Optimization: Learning the World Beyond Action Imitation
- 2026How do World Models and Policies Compose in LLM Agents? A Joint Spectral and Behavioral Account
- 2026Imitation from Heterogeneous Demonstrations using Grounded Latent-Action World Models