# EmboAlign: Aligning Video Generation with Compositional Constraints for Zero-Shot Manipulation

arXiv: https://arxiv.org/abs/2603.05757 · HTML: https://mlsanity.com/paper/2603.05757/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 5 Mar 2026.

## Built on by (most cited first, 3 of 3)

- [World Action Models: A Survey](https://mlsanity.com/paper/2606.20781/) (2026)
- [CreFlow: Corrective Reflow for Sparse-Reward Embodied Video Diffusion RL](https://mlsanity.com/paper/2605.14274/) (2026)
- [CASTER: Formalizing Zero-Shot Manipulation from Synthetic Videos as Constrained Optimization](https://mlsanity.com/paper/2610.12567/) (2026)

## Abstract (arXiv)

Video generative models (VGMs) pretrained on large-scale internet data can produce temporally coherent rollout videos that capture rich object dynamics, offering a compelling foundation for zero-shot robotic manipulation. However, VGMs often produce physically implausible rollouts, and converting their pixel-space motion into robot actions through geometric retargeting further introduces cumulative errors from imperfect depth estimation and keypoint tracking. To address these challenges, we present EmboAlign, a data-free framework that aligns VGM outputs with compositional constraints generated by vision-language models (VLMs) at inference time. The key insight is that VLMs offer a capability complementary to VGMs: structured spatial reasoning that can identify the physical constraints critical to the success and safety of manipulation execution. Given a language instruction, EmboAlign uses a VLM to automatically extract a set of compositional constraints capturing task-specific requirements, which are then applied at two stages: (1) constraint-guided rollout selection, which scores and filters a batch of VGM rollouts to retain the most physically plausible candidate, and (2) constraint-based trajectory optimization, which uses the selected rollout as initialization and refines the robot trajectory under the same constraint set to correct retargeting errors. We evaluate EmboAlign on six real-robot manipulation tasks requiring precise, constraint-sensitive execution, improving the overall success rate by 43.3 percentage points over the strongest baseline without any task-specific training data.