Video Generators are Robot Policies
Not on the map. Why?
Cited by 54 in World models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Despite tremendous progress in dexterous manipulation, current visuomotor policies remain fundamentally limited by two challenges: they struggle to generalize under perceptual or behavioral distribution shifts, and their performance is constrained by the size of human demonstration data. In this paper, we use video generation as a proxy for robot policy learning to address both limitations simultaneously. We propose Video Policy, a modular framework that combines video and action generation that can be trained end-to-end. Our results demonstrate that learning to generate videos of robot behavior allows for the extraction of policies with minimal demonstration data, significantly improving robustness and sample efficiency. Our method shows strong generalization to unseen objects, backgrounds, and tasks, both in simulation and the real world. We further highlight that task success is closely tied to the generated video, with action-free video data providing critical benefits for generalizing to novel tasks. By leveraging large-scale video generative models, we achieve superior performance compared to traditional behavior cloning, paving the way for more scalable and data-efficient robot policy learning.
Key facts. Cited by 92 papers in the map (data through 14 Oct 2026). First posted on arXiv 1 Aug 2025.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2025: 11; 2026: 81.
92 papers.
Sort:
By area:
- 2026World Action Models are Zero-shot Policiescited by 465
- 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?cited by 349
- 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 300
- 2025mimic-video: Video-Action Models for Generalizable Robot Control Beyond VLAscited by 142
- 2026π0.7: a Steerable Generalist Robotic Foundation Model with Emergent Capabilitiescited by 138
- 2026DiT4DiT: Jointly Modeling Video Dynamics and Actions for Generalizable Robot Controlcited by 76
- 2026Being-H0.7: A Latent World-Action Model from Egocentric Videoscited by 75
- 2026World Action Models: The Next Frontier in Embodied AIcited by 50
- 2026World Model for Robot Learning: A Comprehensive Surveycited by 46
- 2026DSpark: Confidence-Scheduled Speculative Decoding with Semi-Autoregressive Generationcited by 45
- 2025NovaFlow: Zero-Shot Manipulation via Actionable Flow from Generated Videoscited by 40
- 2025Dual-Stream Diffusion for World-Model Augmented Vision-Language-Action Modelcited by 36
38 more
- 2026Rethinking Video Generation Model for the Embodied Worldcited by 33
- 2026Interactive World Simulator for Robot Policy Training and Evaluationcited by 31
- 2026When Vision Overrides Language: Evaluating and Mitigating Counterfactual Failures in VLAscited by 30
- 2025ViPRA: Video Prediction for Robot Actionscited by 26
- 2026Light-WAM: Efficient World Action Models with State-Fusion Action Decodingcited by 23
- 2025Act2Goal: From World Model To General Goal-conditioned Policycited by 20
- 2026When to Trust Imagination: Adaptive Action Execution for World Action Modelscited by 20
- 2026Flash-WAM: Modality-Aware Distillation for World Action Modelscited by 19
- 2026PlayWorld: Learning Robot World Models from Autonomous Playcited by 18
- 2025Contrastive Representation Regularization for Vision-Language-Action Modelscited by 17
- 2026WALL-WM: Carving World Action Modeling at the Event Jointscited by 17
- 2026MaskWAM: Unifying Mask Prompting and Prediction for World-Action Modelscited by 16
- 2025A Step Toward World Models: A Survey on Robotic Manipulationcited by 15
- 2026Walk through Paintings: Egocentric World Models from Internet Priorscited by 14
- 2026MemoryWAM: Efficient World Action Modeling with Persistent Memorycited by 13
- 2026Zero-WAM: In-Context World-Action Modeling from Human Videos for Open-Ended Task Generalizationcited by 13
- 2026Action Images: End-to-End Policy Learning via Multiview Video Generationcited by 12
- 2026AIM: Intent-Aware Unified world action Modeling with Spatial Value Mapscited by 12
- 2026World Action Models: A Surveycited by 12
- 2026Dexterous Manipulation Policies from RGB Human Videos via 3D Hand-Object Trajectory Reconstructioncited by 11
- 2026Is the Future Compatible? Diagnosing Dynamic Consistency in World Action Modelscited by 11
- 2026Making Foresight Actionable: Repurposing Representation Alignment in World Action Modelscited by 11
- 2026HarmoWAM: Harmonizing Generalizable and Precise Manipulation via Adaptive World Action Modelscited by 10
- 2026PhysisForcing: Physics Reinforced World Simulator for Robotic Manipulationcited by 10
- 20253D Flow Diffusion Policy: Visuomotor Policy Learning via Generating Flow in 3D Spacecited by 9
- 2025CoVAR: Co-generation of Video and Action for Robotic Manipulation via Multi-Modal Diffusioncited by 9
- 2026ViVa: A Video-Generative Value Model for Robot Reinforcement Learningcited by 9
- 2026UNIVERSE: Unified Video Action Models for Autonomous Driving with Flexible Mask-Modulated Modality Generationcited by 9
- 2026NovaPlan: Zero-Shot Long-Horizon Manipulation via Closed-Loop Video Language Planningcited by 8
- 2026Veo-Act: Enhancing VLA Policies with Frontier Video Modelscited by 5
- 2026A Mechanistic Analysis of Sim-and-Real Co-Training in Generative Robot Policiescited by 5
- 2026Visual Generation in the New Era: An Evolution from Atomic Mapping to Agentic World Modelingcited by 5
- 2026EA-WM: Event-Aware Generative World Model with Structured Kinematic-to-Visual Action Fieldscited by 5
- 2026UAM: A Dual-Stream Perspective on Forgetting in VLA Trainingcited by 5
- 2026Diffusion ReRoll: Revisable Denoising for Robotic Sequential Predictioncited by 5
- 2026Spatially Aware World Action Model via Geometric Latent Diffusioncited by 5
- 2026From World Models to World Action Models: A Concise Tutorial for Roboticscited by 4
- 2026DeVA: Decoupled Video-Action Model with physical guidance for robot policy learningcited by 4
50 most cited of 92 All 92 (JSON)
- 2026Box-WAM: Box Trajectories as Compact State Representations for World Action Models13 Oct 2026
- 2026UniLAP: A Unified Latent Action Policy for Cross-Embodiment Manipulation12 Oct 2026
- 2026CASTER: Formalizing Zero-Shot Manipulation from Synthetic Videos as Constrained Optimization8 Oct 2026
- 2026Connected Self Forcing: Beyond Local Learning in Video Autoregression8 Oct 2026
- 2026WAM-Cache: Staleness-Bounded KV Reuse for Efficient World Action Models8 Oct 2026
- 2026SimForcing: Distilling Simulation Motion Priors into Real-Domain Robot World Models5 Oct 2026
- 2026Future Anchored Verification and Online Recovery for World Action Models5 Oct 2026
- 2026V-JEPA Policy: Building Effective World-Action Models on Predictive Visual Latents29 Sep 2026
- 2026Spotter: Let the Embodied Model Lead, and the VLM Reflect for It29 Sep 2026
- 2026FutureDuet: Decoupling Observation Access from Future Supervision in World Action Models28 Sep 2026
- 2026Beyond Future Prediction: Denoising as Generative Adaptation for Robot Control23 Sep 2026
- 2026DualWAM: Dual-System World Action Models for Asynchronous Global Planning and Local Refinement21 Sep 2026
38 more
- 2026Track, Articulate, Act: Generating Articulation from Casual Human Videos16 Sep 2026
- 2026XPACE: Joint World and Action Modeling from Heterogeneous Experience15 Sep 2026
- 2026World Models for Embodied Intelligence: From Plausible to Controllable to Actionable15 Sep 2026
- 2026Dynin-Robotics: Omnimodal Unified Diffusion Vision-Language-Action Model11 Sep 2026
- 2026GIFT: Guided Intermediate Feature Training via Action-Oriented Structural Supervision for Robotic Manipulation3 Sep 2026
- 2026Spatially Aware World Action Model via Geometric Latent Diffusion2 Sep 2026
- 2026Riemann-1.0: An Embodied World Action Model for Physical AI27 Aug 2026
- 2026Zero-WAM: In-Context World-Action Modeling from Human Videos for Open-Ended Task Generalization26 Aug 2026
- 2026Latent Action as Intention Enables Efficient Future Imagination for World Action Models25 Aug 2026
- 2026Act with Intent: Distilling Behavior Intent for Vision-Language-Action Models24 Aug 2026
- 2026WorldToken: Time-First Sequence Modeling for Robotic Imitation Learning23 Aug 2026
- 2026VGI-Bench: Probing Visual Intelligence in Video Generation Models20 Aug 2026
- 2026JEPA-WAM: Connecting Generated Visual Instructions to World Action Models through JEPA Latent Representations4 Aug 2026
- 2026QuantWAMs: Calibrating at the Right Granularity for World Action Models30 Jul 2026
- 2026ODEWorld: A Continuous Predictive Architecture via Physical-Time Flow30 Jul 2026
- 2026ContactFlow: A video action conditioning that transfers across embodiments29 Jul 2026
- 2026DeVA: Decoupled Video-Action Model with physical guidance for robot policy learning27 Jul 2026
- 2026LeapBot-WA: World-Anchor Action Models via Predictive Latent Alignments27 Jul 2026
- 2026Diffusion ReRoll: Revisable Denoising for Robotic Sequential Prediction22 Jul 2026
- 2026MotionForesight: Re-purposing Video Models for Future 3D Scene-Flow Prediction17 Jul 2026
- 2026Towards Predictive, Aligned, and Scalable Robot Learning13 Jul 2026
- 2026Understanding and Mitigating the Video-Action Generalization Gap via Temporal Ratio9 Jul 2026
- 2026RoboTALES: Learning Reasoning-Guided Robot Policies via Task-Aligned Simulated Futures7 Jul 2026
- 2026DSpark: Confidence-Scheduled Speculative Decoding with Semi-Autoregressive Generation6 Jul 2026
- 2026UNIVERSE: Unified Video Action Models for Autonomous Driving with Flexible Mask-Modulated Modality Generation6 Jul 2026
- 2026From World Models to World Action Models: A Concise Tutorial for Robotics1 Jul 2026
- 20263D Point World Models: Point Completion Enables More Accurate Dynamics Learning30 Jun 2026
- 2026PhysisForcing: Physics Reinforced World Simulator for Robotic Manipulation26 Jun 2026
- 2026Supervise What Survives: Geometry-Guided VLA Adaptation from Synthetic Robot Videos23 Jun 2026
- 2026World Action Models: A Survey18 Jun 2026
- 2026MemoryWAM: Efficient World Action Modeling with Persistent Memory18 Jun 2026
- 2026MaskWAM: Unifying Mask Prompting and Prediction for World-Action Models11 Jun 2026
- 2026Making Foresight Actionable: Repurposing Representation Alignment in World Action Models10 Jun 2026
- 2026Light-WAM: Efficient World Action Models with State-Fusion Action Decoding6 Jun 2026
- 2026Flash-WAM: Modality-Aware Distillation for World Action Models3 Jun 2026
- 2026Dream.exe: Can Video Generation Models Dream Executable Robot Manipulation?3 Jun 2026
- 2026PointAction: 3D Points as Universal Action Representations for Robot Control2 Jun 2026
- 2026Unified Video-Action Joint Denoising for Dexterous Action and Data Generation2 Jun 2026
50 newest of 92 All 92 (JSON)
- 2026World Action Models are Zero-shot Policiescited by 465
- 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?cited by 349
- 2026Being-H0.7: A Latent World-Action Model from Egocentric Videoscited by 75
- 2026World Action Models: The Next Frontier in Embodied AIcited by 50
- 2026World Model for Robot Learning: A Comprehensive Surveycited by 46
- 2025Dual-Stream Diffusion for World-Model Augmented Vision-Language-Action Modelcited by 36
- 2026Interactive World Simulator for Robot Policy Training and Evaluationcited by 31
- 2026Light-WAM: Efficient World Action Models with State-Fusion Action Decodingcited by 23
- 2025Act2Goal: From World Model To General Goal-conditioned Policycited by 20
- 2026When to Trust Imagination: Adaptive Action Execution for World Action Modelscited by 20
- 2026Flash-WAM: Modality-Aware Distillation for World Action Modelscited by 19
- 2026PlayWorld: Learning Robot World Models from Autonomous Playcited by 18
12 most cited of 54 All 54 (JSON)
- 2026Box-WAM: Box Trajectories as Compact State Representations for World Action Models13 Oct 2026
- 2026WAM-Cache: Staleness-Bounded KV Reuse for Efficient World Action Models8 Oct 2026
- 2026SimForcing: Distilling Simulation Motion Priors into Real-Domain Robot World Models5 Oct 2026
- 2026Future Anchored Verification and Online Recovery for World Action Models5 Oct 2026
- 2026V-JEPA Policy: Building Effective World-Action Models on Predictive Visual Latents29 Sep 2026
- 2026FutureDuet: Decoupling Observation Access from Future Supervision in World Action Models28 Sep 2026
- 2026DualWAM: Dual-System World Action Models for Asynchronous Global Planning and Local Refinement21 Sep 2026
- 2026XPACE: Joint World and Action Modeling from Heterogeneous Experience15 Sep 2026
- 2026World Models for Embodied Intelligence: From Plausible to Controllable to Actionable15 Sep 2026
- 2026GIFT: Guided Intermediate Feature Training via Action-Oriented Structural Supervision for Robotic Manipulation3 Sep 2026
- 2026Spatially Aware World Action Model via Geometric Latent Diffusion2 Sep 2026
- 2026Riemann-1.0: An Embodied World Action Model for Physical AI27 Aug 2026
12 newest of 54 All 54 (JSON)
- 2025mimic-video: Video-Action Models for Generalizable Robot Control Beyond VLAscited by 142
- 2026DiT4DiT: Jointly Modeling Video Dynamics and Actions for Generalizable Robot Controlcited by 76
- 2026When Vision Overrides Language: Evaluating and Mitigating Counterfactual Failures in VLAscited by 30
- 2026ViVa: A Video-Generative Value Model for Robot Reinforcement Learningcited by 9
- 2026Veo-Act: Enhancing VLA Policies with Frontier Video Modelscited by 5
- 2026Supervise What Survives: Geometry-Guided VLA Adaptation from Synthetic Robot Videoscited by 1
- 2026Act with Intent: Distilling Behavior Intent for Vision-Language-Action Modelscited by 0
- 2026Dynin-Robotics: Omnimodal Unified Diffusion Vision-Language-Action Modelcited by 0
- 2026Dynin-Robotics: Omnimodal Unified Diffusion Vision-Language-Action Model11 Sep 2026
- 2026Act with Intent: Distilling Behavior Intent for Vision-Language-Action Models24 Aug 2026
- 2026Supervise What Survives: Geometry-Guided VLA Adaptation from Synthetic Robot Videos23 Jun 2026
- 2026ViVa: A Video-Generative Value Model for Robot Reinforcement Learning9 Apr 2026
- 2026Veo-Act: Enhancing VLA Policies with Frontier Video Models6 Apr 2026
- 2026DiT4DiT: Jointly Modeling Video Dynamics and Actions for Generalizable Robot Control11 Mar 2026
- 2026When Vision Overrides Language: Evaluating and Mitigating Counterfactual Failures in VLAs19 Feb 2026
- 2025mimic-video: Video-Action Models for Generalizable Robot Control Beyond VLAs17 Dec 2025
- 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 300
- 20253D Flow Diffusion Policy: Visuomotor Policy Learning via Generating Flow in 3D Spacecited by 9
- 2025CoVAR: Co-generation of Video and Action for Robotic Manipulation via Multi-Modal Diffusioncited by 9
- 2026PointAction: 3D Points as Universal Action Representations for Robot Controlcited by 2
- 2026Beyond Future Prediction: Denoising as Generative Adaptation for Robot Controlcited by 0
- 2026Beyond Future Prediction: Denoising as Generative Adaptation for Robot Control23 Sep 2026
- 2026PointAction: 3D Points as Universal Action Representations for Robot Control2 Jun 2026
- 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planning22 Jan 2026
- 2025CoVAR: Co-generation of Video and Action for Robotic Manipulation via Multi-Modal Diffusion17 Dec 2025
- 20253D Flow Diffusion Policy: Visuomotor Policy Learning via Generating Flow in 3D Space23 Sep 2025
- 2026π0.7: a Steerable Generalist Robotic Foundation Model with Emergent Capabilitiescited by 138
- 2025NovaFlow: Zero-Shot Manipulation via Actionable Flow from Generated Videoscited by 40
- 2026Rethinking Video Generation Model for the Embodied Worldcited by 33
- 2025ViPRA: Video Prediction for Robot Actionscited by 26
- 2026Dexterous Manipulation Policies from RGB Human Videos via 3D Hand-Object Trajectory Reconstructioncited by 11
- 2026PhysisForcing: Physics Reinforced World Simulator for Robotic Manipulationcited by 10
- 2026NovaPlan: Zero-Shot Long-Horizon Manipulation via Closed-Loop Video Language Planningcited by 8
- 2026A Mechanistic Analysis of Sim-and-Real Co-Training in Generative Robot Policiescited by 5
- 2026UAM: A Dual-Stream Perspective on Forgetting in VLA Trainingcited by 5
- 2026Diffusion ReRoll: Revisable Denoising for Robotic Sequential Predictioncited by 5
- 2026DeVA: Decoupled Video-Action Model with physical guidance for robot policy learningcited by 4
- 2026From Imagined Futures to Executable Actions: Mixture of Latent Actions for Robot Manipulationcited by 2
12 most cited of 19 All 19 (JSON)
- 2026UniLAP: A Unified Latent Action Policy for Cross-Embodiment Manipulation12 Oct 2026
- 2026CASTER: Formalizing Zero-Shot Manipulation from Synthetic Videos as Constrained Optimization8 Oct 2026
- 2026Connected Self Forcing: Beyond Local Learning in Video Autoregression8 Oct 2026
- 2026Spotter: Let the Embodied Model Lead, and the VLM Reflect for It29 Sep 2026
- 2026Track, Articulate, Act: Generating Articulation from Casual Human Videos16 Sep 2026
- 2026DeVA: Decoupled Video-Action Model with physical guidance for robot policy learning27 Jul 2026
- 2026Diffusion ReRoll: Revisable Denoising for Robotic Sequential Prediction22 Jul 2026
- 2026MotionForesight: Re-purposing Video Models for Future 3D Scene-Flow Prediction17 Jul 2026
- 2026PhysisForcing: Physics Reinforced World Simulator for Robotic Manipulation26 Jun 2026
- 2026Dream.exe: Can Video Generation Models Dream Executable Robot Manipulation?3 Jun 2026
- 2026UAM: A Dual-Stream Perspective on Forgetting in VLA Training15 May 2026
- 2026From Imagined Futures to Executable Actions: Mixture of Latent Actions for Robot Manipulation12 May 2026
12 newest of 19 All 19 (JSON)