DIDO: Distilling Interaction-Centric Dynamics into One-Step Denoising for World Action Models
On the map: World models → Embodied and robot world models
Abstract (arXiv)
World Action Models (WAMs) use video generation models to predict future visual dynamics for robotic manipulation, but iterative denoising introduces additional latency for closed-loop control. We empirically find that visual content converges at different rates during denoising. Static background structure forms early, whereas the gripper and manipulated object remain blurry after the first step, with their interaction dynamics emerging only through subsequent denoising. Consequently, naively truncating a multi-step video model to one step preserves scene structure but loses the interaction-centric dynamics most critical for manipulation. To address this issue, we propose DIDO, which distills the converged dynamics of a multi-step video model into a single denoising step. DIDO combines distribution matching distillation with interaction-centric representation guidance. Beyond compressing multi-step generation into one forward pass, DIDO explicitly models the gripper, manipulated object, and their interaction using supervised bounding-box visual reasoning tokens. Additionally, DIDO aligns the target object's representations across multiple model layers with features from a pretrained DINOv3 encoder. This interaction-centric guidance helps the distilled model preserve both the relevant entities and their future dynamics in a single step, while substantially reducing inference latency. DIDO achieves an average success rate of 99.0% on LIBERO, 76.6% on LIBERO-Plus, and 92.0% on RoboTwin, while also demonstrating effective transfer to long-horizon and generalization tasks in real-world robotic manipulation.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 21 of its 55 references that are in the map. First posted on arXiv 14 Sep 2026.
Builds on
21 of 55 references.
Closest ancestors · 13
Same direction, newest first
- 2026Faster-WAM: Efficient Inference-Time Future Conditioning for Robust World Action Models5 Aug
- 2026Faster-WAM: Do World Action Models Need Deep Action Modules?3 Aug
- 2026ST-WAM: Semantic-Temporal World Action Model for Robust Manipulation under Visual Distribution Shifts31 Jul
- 2026GigaWorld-Policy-0.5: A Faster and Stronger WAM Empowered by AutoResearch15 Jul
- 2026Learning 4D Geometric Priors for Inference-Efficient World Action Models6 Jul
- 2026MaskWAM: Unifying Mask Prompting and Prediction for World-Action Models11 Jun
- 2026Flash-WAM: Modality-Aware Distillation for World Action Models3 Jun
- 2026OA-WAM: Object-Addressable World Action Model for Robust Robot Manipulation7 May
- 2026Motubrain: An Advanced World Action Model for Robot Control30 Apr
- 2026GigaWorld-Policy: An Efficient Action-Centered World--Action Model18 Mar
- 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?17 Mar
- 2026World Action Models are Zero-shot Policies17 Feb
1 more
Other references · 8
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 921
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 477
- 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 290
- 2025LIBERO-Plus: In-depth Robustness Analysis of Vision-Language-Action Modelscited by 278
- 2026PRM-as-a-Judge: A Dense Evaluation Paradigm for Fine-Grained Robotic Auditingcited by 8
- 2026Orca: The World is in Your Mindcited by 6
- 2026SAM3D-Guided Object-Centric Representation Alignment for Vision-Language-Action Modelscited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Rolling-WAM: World Action Models with Rolling Imagination
- 2026Unified Video-Action Joint Denoising for Dexterous Action and Data Generation
- 2025LongScape: Advancing Long-Horizon Embodied World Models with Context-Aware MoE
- 2026MobileWAM: Bridging World Action Models to Mobile Manipulation with Chain-of-Foresight
- 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Data
- 2026Mixture of Frames Policy: Multi-Frame Action Denoising for Bimanual Mobile Manipulation
- 2026τ0-WM: A Unified Video-Action World Model for Robotic Manipulation
- 2026SANTS: A State-Adaptive Scheduler for World Action Models