Achieve What You Imagined: Learning to Align Actions with Visual Plans
On the map: World models → Embodied and robot world models
Abstract (arXiv)
World-action models can jointly predict future visual observations and robot actions. However, discrepancies may exist between their visual predictions and the consequences implied by generated actions. We observe that WAMs can often generate visually plausible task-completion outcomes before producing action sequences that reliably achieve them. Consequently, we treat the WAM-generated visual prediction as a goal-conditioned visual proposal rather than a directly executable plan. We use a frozen action-conditioned world model to predict action-conditioned consequences and construct feedback based on consistency between the two future predictions and alignment with the terminal goal. Leveraging this feedback, we employ Flow Policy Optimization (FPO) to optimize the action head of the WAM. This framework avoids online robot interaction and additional training of task-specific reward models. Across four real-world UR5 manipulation tasks, our method increases the mean success rate from 43.4% to 75.1%, compared with 61.4% for π0.5. These results show that cross-model prediction discrepancy can provide useful feedback for improving robot policies under the evaluated manipulation tasks. Website: https://imagine-to-achieve.github.io/
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 6 of its 34 references that are in the map. First posted on arXiv 27 Sep 2026.
Builds on
6 of 34 references.
Closest ancestors · 3
Same direction, newest first
- 2026LaWAM: Latent World Action Models for Efficient Dynamics-Aware Robot Policies14 Jun
- 2026World Action Models are Zero-shot Policies17 Feb
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planning11 Jun
Other references · 3
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2026Turning Video Models into Generalist Robot Policiescited by 10
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026R2-WAM: Repair-and-Reject Post-Training for World Action Models
- 2026GE-Act 2.0: Pretraining and Scaling a World-Action Model for Robotic Manipulation
- 2026World Models for Robotic Manipulation: A Survey
- 2026PACT-WAM: Predicting Actions and Visual Foresight with Compact Temporal Encoding for Robot Manipulation
- 2026τ0-WM: A Unified Video-Action World Model for Robotic Manipulation
- 2026Copper-Policy: Focus on the Representation for Robust Robot Manipulation
- 2026Rethinking World-Action Model for Compositional and In-Context Robotic Manipulation
- 2026Streaming-WAM: Action-Conditioned World-Action Model for Asynchronous Robot Manipulation