mlsanityData to 14 Oct 2026

Native Video-Action Pretraining for Generalizable Robot Control

arXiv 2607.08639 ↗First posted 9 Jul 2026cs.RO cs.CVcited by 36

Not on the map. Why?

Cited by 31 in World models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

The advent of video-action models offers a promising path for robot control. Nevertheless, we argue that repurposing video generative models designed for digital content creation is inherently inadequate for physical environments. To bridge this gap, we present LingBot-VA 2.0, a video-action foundation model built from the ground up for embodiment. Four core design principles showcase its evolution from LingBot-VA. (1) Departing from traditional reconstruction-focused VAEs, we introduce a semantic visual-action tokenizer, which aligns visual representations with both semantics and actions, improving instruction following and action precision in subsequent policy learning. (2) Given the strictly causal nature of temporal dynamics, we adopt a causal pretraining paradigm, training from scratch to circumvent the catastrophic forgetting that frequently occurs when adapting bidirectional architectures. (3) To meet the demands of high-frequency inference, our model employs a sparse MoE backbone, expanding model capacity without compromising efficiency. (4) Real-time closed-loop control is realized through an enhanced asynchronous inference scheme, which predicts future latents in parallel with action execution while re-grounding each rollout on the latest observation via learned forward dynamics. Real-world deployment validates LingBot-VA 2.0 as a robust foundation model, as evidenced by its few-shot generalization across complex manipulation tasks.

Key facts. Cited by 36 papers in the map (data through 14 Oct 2026). Builds on 115 of its 131 references that are in the map. First posted on arXiv 9 Jul 2026.

Builds on

115 of 131 references.

References · 115

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2022Flow Matching for Generative Modelingcited by 5,702
  3. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  4. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  5. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
  6. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  7. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  8. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
  9. 2023Consistency Modelscited by 1,822
  10. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  11. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
  12. 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
38 more
  1. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
  2. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
  3. 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 879
  4. 2024DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Modelscited by 867
  5. 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
  6. 2024Genie: Generative Interactive Environmentscited by 747
  7. 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
  8. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
  9. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
  10. 2023Learning Universal Policies via Text-Guided Video Generationcited by 522
  11. 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
  12. 2023TD-MPC2: Scalable, Robust World Models for Continuous Controlcited by 512
  13. 2017Deep learning for universal linear embeddings of nonlinear dynamicscited by 494
  14. 2026World Action Models are Zero-shot Policiescited by 465
  15. 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 451
  16. 2025Muon is Scalable for LLM Trainingcited by 428
  17. 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 422
  18. 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 410
  19. 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 405
  20. 2022DayDreamer: World Models for Physical Robot Learningcited by 400
  21. 2024Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robotscited by 394
  22. 2025WorldVLA: Towards Autoregressive Action World Modelcited by 367
  23. 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 364
  24. 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 349
  25. 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?cited by 349
  26. 2022Video PreTraining (VPT): Learning to Act by Watching Unlabeled Online Videoscited by 345
  27. 20243D-VLA: A 3D Vision-Language-Action Generative World Modelcited by 328
  28. 2025Perception Encoder: The best visual embeddings are not at the output of the networkcited by 326
  29. 2024Latent Action Pretraining from Videoscited by 321
  30. 2026Causal World Modeling for Robot Controlcited by 321
  31. 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 303
  32. 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 300
  33. 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 296
  34. 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 289
  35. 2015Embed to Control: A Locally Linear Latent Dynamics Model for Control from Raw Imagescited by 274
  36. 2024Navigation World Modelscited by 272
  37. 2025Motus: A Unified Latent Action World Modelcited by 251
  38. 2025Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasetscited by 240

50 most cited of 115 All 115 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 36.

36 papers.

Sort:

By area:

  1. 2026Xiaomi-Robotics-1: Scaling Vision-Language-Action Models with over 100K Hours of Real-World Trajectoriescited by 29
  2. 2026Zero-WAM: In-Context World-Action Modeling from Human Videos for Open-Ended Task Generalizationcited by 13
  3. 2026Flex-π: A Multi-Stream World-Action Model with Compute Flexibilitycited by 11
  4. 2026WorldScape Policy 2.0: Empowering Steerable World Action Modeling with Reasoning-Augmented Memory and In-Context Learningcited by 6
  5. 2026Data Pyramid for Embodied Manipulation: A Surveycited by 6
  6. 2026GE-Act 2.0: Pretraining and Scaling a World-Action Model for Robotic Manipulationcited by 5
  7. 2026ZimaBlue: Evolving Generalizable World Action Models through Scalable Video Pre-trainingcited by 4
  8. 2026Enfold: Folding World Model Imagination into Predictive Representations for Ultra-Efficient Embodied Controlcited by 3
  9. 2026AffordanceWAM: Affordance-Aware Joint World-Action Modeling for Robot Manipulationcited by 3
  10. 2026PhyAI: Real-Time Physical AI at the Edge, Scalable Rollouts in the Cloudcited by 1
  11. 2026Streaming-WAM: Action-Conditioned World-Action Model for Asynchronous Robot Manipulationcited by 1
  12. 2026Rolling-WAM: World Action Models with Rolling Imaginationcited by 1
24 more
  1. 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Datacited by 1
  2. 2026Rethinking Representations for World-Action Modelingcited by 1
  3. 2026Long-WAM: Scaling the Context of World-Action Modelscited by 1
  4. 2026N0-Foundation: Towards the Age of Tactile Intelligencecited by 0
  5. 2026Acting in Meters: Learning Metric Interactions for Precise Robotic Manipulationcited by 0
  6. 2026CSWAM: Better Causal Semantic Representations for Out-of-Distribution Generalization in World Action Modelscited by 0
  7. 2026From Rollout to Reset: A Graph-Based Harness for Autonomous Long-Horizon Manipulation Evaluationcited by 0
  8. 2026What Matters in Designing World Action Models: An Empirical Studycited by 0
  9. 2026DualWAM: Dual-System World Action Models for Asynchronous Global Planning and Local Refinementcited by 0
  10. 2026An Action Is Worth One Patch: Unified World-Action Modeling with PatchWAMcited by 0
  11. 2026WorldGuide: Learning Success-Failure Boundaries in Latent World Models for Vision-Language-Action Policiescited by 0
  12. 2026Revision, Not Restart: Revisable Visual Plans for Closed-Loop World-Action Modelscited by 0
  13. 2026V-JEPA Policy: Building Effective World-Action Models on Predictive Visual Latentscited by 0
  14. 2026Direct Experience World-Model Optimization: Learning the World Beyond Action Imitationcited by 0
  15. 2026CogWAM: Aligning Semantic Cognition with World Action Modeling via Event-Driven Interfacescited by 0
  16. 2026LocoWM: High-Precision Locomotion through World-Model-Guided Residual Adaptationcited by 0
  17. 2026SplineWAM: Adaptive Action Horizons for World Action Models via B-Spline Representationscited by 0
  18. 2026Native Action-Prior Learning from Videos for World Action Modelscited by 0
  19. 2026OpenWAM: An Open Framework for Composable World-Action Modelscited by 0
  20. 2026WAM-Cache: Staleness-Bounded KV Reuse for Efficient World Action Modelscited by 0
  21. 2026What Visual Representations Do World Action Models Need?cited by 0
  22. 2026BridgeWAM: Bridging Video and Action Experts via Latent Bridge Queriescited by 0
  23. 2026LoopWAM: Closed-Loop Generalist Policy Improvement from Deployment Rolloutscited by 0
  24. 2026VITAL: From Visual Motion to Precise Actioncited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025mimic-video: Video-Action Models for Generalizable Robot Control Beyond VLAs
  2. 2026DeVA: Decoupled Video-Action Model with physical guidance for robot policy learning
  3. 2025Large Video Planner Enables Generalizable Robot Control
  4. 2026Motubrain: An Advanced World Action Model for Robot Control
  5. 2026Rewiring Semantics, Dynamics, and Control: A Simple yet Effective Action-Centric Tri-Stream Transformer
  6. 2026DiT4DiT: Jointly Modeling Video Dynamics and Actions for Generalizable Robot Control
  7. 2026From Human Videos to Robot Manipulation: A Survey on Scalable Vision-Language-Action Learning with Human-Centric Data
  8. 2026ViDAL: A Visual Dynamics-Grounded Action Latent Space for Vision-Language-Action Models