# Native Video-Action Pretraining for Generalizable Robot Control

arXiv: https://arxiv.org/abs/2607.08639 · HTML: https://mlsanity.com/paper/2607.08639/

## Key facts

- Cited by 36 papers in the map (data through 14 Oct 2026).
- Builds on 115 of its 131 references that are in the map.
- First posted on arXiv 9 Jul 2026.

## Builds on (most cited first, 30 of 115)

- [An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale](https://mlsanity.com/paper/2010.11929/) (2020)
- [Flow Matching for Generative Modeling](https://mlsanity.com/paper/2210.02747/) (2022)
- [RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control](https://mlsanity.com/paper/2307.15818/) (2023)
- [OpenVLA: An Open-Source Vision-Language-Action Model](https://mlsanity.com/paper/2406.09246/) (2024)
- [Diffusion Policy: Visuomotor Policy Learning via Action Diffusion](https://mlsanity.com/paper/2303.04137/) (2023)
- [Wan: Open and Advanced Large-Scale Video Generative Models](https://mlsanity.com/paper/2503.20314/) (2025)
- [π0: A Vision-Language-Action Flow Model for General Robot Control](https://mlsanity.com/paper/2410.24164/) (2024)
- [RT-1: Robotics Transformer for Real-World Control at Scale](https://mlsanity.com/paper/2212.06817/) (2022)
- [Consistency Models](https://mlsanity.com/paper/2303.01469/) (2023)
- [π0.5: a Vision-Language-Action Model with Open-World Generalization](https://mlsanity.com/paper/2504.16054/) (2025)
- [Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardware](https://mlsanity.com/paper/2304.13705/) (2023)
- [Octo: An Open-Source Generalist Robot Policy](https://mlsanity.com/paper/2405.12213/) (2024)
- [GR00T N1: An Open Foundation Model for Generalist Humanoid Robots](https://mlsanity.com/paper/2503.14734/) (2025)
- [WorldSimBench: Towards Video Generation Models as World Simulators](https://mlsanity.com/paper/2410.18072/) (2024)
- [Improving and generalizing flow-based generative models with minibatch optimal transport](https://mlsanity.com/paper/2302.00482/) (2023)
- [DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models](https://mlsanity.com/paper/2401.06066/) (2024)
- [DROID: A Large-Scale In-The-Wild Robot Manipulation Dataset](https://mlsanity.com/paper/2403.12945/) (2024)
- [Genie: Generative Interactive Environments](https://mlsanity.com/paper/2402.15391/) (2024)
- [RDT-1B: a Diffusion Foundation Model for Bimanual Manipulation](https://mlsanity.com/paper/2410.07864/) (2024)
- [Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusion](https://mlsanity.com/paper/2407.01392/) (2024)
- [Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusion](https://mlsanity.com/paper/2506.08009/) (2025)
- [Learning Universal Policies via Text-Guided Video Generation](https://mlsanity.com/paper/2302.00111/) (2023)
- [RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulation](https://mlsanity.com/paper/2506.18088/) (2025)
- [TD-MPC2: Scalable, Robust World Models for Continuous Control](https://mlsanity.com/paper/2310.16828/) (2023)
- [Deep learning for universal linear embeddings of nonlinear dynamics](https://mlsanity.com/paper/1712.09707/) (2017)
- [World Action Models are Zero-shot Policies](https://mlsanity.com/paper/2602.15922/) (2026)
- [CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Models](https://mlsanity.com/paper/2503.22020/) (2025)
- [Muon is Scalable for LLM Training](https://mlsanity.com/paper/2502.16982/) (2025)
- [CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation](https://mlsanity.com/paper/2411.19650/) (2024)
- [UniVLA: Learning to Act Anywhere with Task-centric Latent Actions](https://mlsanity.com/paper/2505.06111/) (2025)

## Built on by (most cited first, 30 of 36)

- [Xiaomi-Robotics-1: Scaling Vision-Language-Action Models with over 100K Hours of Real-World Trajectories](https://mlsanity.com/paper/2607.15330/) (2026)
- [Zero-WAM: In-Context World-Action Modeling from Human Videos for Open-Ended Task Generalization](https://mlsanity.com/paper/2608.26103/) (2026)
- [Flex-π: A Multi-Stream World-Action Model with Compute Flexibility](https://mlsanity.com/paper/2608.10860/) (2026)
- [WorldScape Policy 2.0: Empowering Steerable World Action Modeling with Reasoning-Augmented Memory and In-Context Learning](https://mlsanity.com/paper/2607.18840/) (2026)
- [Data Pyramid for Embodied Manipulation: A Survey](https://mlsanity.com/paper/2607.24744/) (2026)
- [GE-Act 2.0: Pretraining and Scaling a World-Action Model for Robotic Manipulation](https://mlsanity.com/paper/2609.05588/) (2026)
- [ZimaBlue: Evolving Generalizable World Action Models through Scalable Video Pre-training](https://mlsanity.com/paper/2609.00188/) (2026)
- [Enfold: Folding World Model Imagination into Predictive Representations for Ultra-Efficient Embodied Control](https://mlsanity.com/paper/2607.26657/) (2026)
- [AffordanceWAM: Affordance-Aware Joint World-Action Modeling for Robot Manipulation](https://mlsanity.com/paper/2609.22332/) (2026)
- [PhyAI: Real-Time Physical AI at the Edge, Scalable Rollouts in the Cloud](https://mlsanity.com/paper/2608.03682/) (2026)
- [Streaming-WAM: Action-Conditioned World-Action Model for Asynchronous Robot Manipulation](https://mlsanity.com/paper/2609.28927/) (2026)
- [Rolling-WAM: World Action Models with Rolling Imagination](https://mlsanity.com/paper/2609.30247/) (2026)
- [InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Data](https://mlsanity.com/paper/2609.31394/) (2026)
- [Rethinking Representations for World-Action Modeling](https://mlsanity.com/paper/2609.38163/) (2026)
- [Long-WAM: Scaling the Context of World-Action Models](https://mlsanity.com/paper/2610.10528/) (2026)
- [N0-Foundation: Towards the Age of Tactile Intelligence](https://mlsanity.com/paper/2608.29601/) (2026)
- [Acting in Meters: Learning Metric Interactions for Precise Robotic Manipulation](https://mlsanity.com/paper/2609.18243/) (2026)
- [CSWAM: Better Causal Semantic Representations for Out-of-Distribution Generalization in World Action Models](https://mlsanity.com/paper/2609.18462/) (2026)
- [From Rollout to Reset: A Graph-Based Harness for Autonomous Long-Horizon Manipulation Evaluation](https://mlsanity.com/paper/2609.19413/) (2026)
- [What Matters in Designing World Action Models: An Empirical Study](https://mlsanity.com/paper/2609.24048/) (2026)
- [DualWAM: Dual-System World Action Models for Asynchronous Global Planning and Local Refinement](https://mlsanity.com/paper/2609.24868/) (2026)
- [An Action Is Worth One Patch: Unified World-Action Modeling with PatchWAM](https://mlsanity.com/paper/2609.25961/) (2026)
- [WorldGuide: Learning Success-Failure Boundaries in Latent World Models for Vision-Language-Action Policies](https://mlsanity.com/paper/2609.34206/) (2026)
- [Revision, Not Restart: Revisable Visual Plans for Closed-Loop World-Action Models](https://mlsanity.com/paper/2609.35439/) (2026)
- [V-JEPA Policy: Building Effective World-Action Models on Predictive Visual Latents](https://mlsanity.com/paper/2609.37250/) (2026)
- [Direct Experience World-Model Optimization: Learning the World Beyond Action Imitation](https://mlsanity.com/paper/2609.37398/) (2026)
- [CogWAM: Aligning Semantic Cognition with World Action Modeling via Event-Driven Interfaces](https://mlsanity.com/paper/2609.37721/) (2026)
- [LocoWM: High-Precision Locomotion through World-Model-Guided Residual Adaptation](https://mlsanity.com/paper/2609.39179/) (2026)
- [SplineWAM: Adaptive Action Horizons for World Action Models via B-Spline Representations](https://mlsanity.com/paper/2609.39873/) (2026)
- [Native Action-Prior Learning from Videos for World Action Models](https://mlsanity.com/paper/2610.03391/) (2026)

## Abstract (arXiv)

The advent of video-action models offers a promising path for robot control. Nevertheless, we argue that repurposing video generative models designed for digital content creation is inherently inadequate for physical environments. To bridge this gap, we present LingBot-VA 2.0, a video-action foundation model built from the ground up for embodiment. Four core design principles showcase its evolution from LingBot-VA. (1) Departing from traditional reconstruction-focused VAEs, we introduce a semantic visual-action tokenizer, which aligns visual representations with both semantics and actions, improving instruction following and action precision in subsequent policy learning. (2) Given the strictly causal nature of temporal dynamics, we adopt a causal pretraining paradigm, training from scratch to circumvent the catastrophic forgetting that frequently occurs when adapting bidirectional architectures. (3) To meet the demands of high-frequency inference, our model employs a sparse MoE backbone, expanding model capacity without compromising efficiency. (4) Real-time closed-loop control is realized through an enhanced asynchronous inference scheme, which predicts future latents in parallel with action execution while re-grounding each rollout on the latest observation via learned forward dynamics. Real-world deployment validates LingBot-VA 2.0 as a robust foundation model, as evidenced by its few-shot generalization across complex manipulation tasks.