Native Video-Action Pretraining for Generalizable Robot Control
Not on the map. Why?
Cited by 31 in World models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
The advent of video-action models offers a promising path for robot control. Nevertheless, we argue that repurposing video generative models designed for digital content creation is inherently inadequate for physical environments. To bridge this gap, we present LingBot-VA 2.0, a video-action foundation model built from the ground up for embodiment. Four core design principles showcase its evolution from LingBot-VA. (1) Departing from traditional reconstruction-focused VAEs, we introduce a semantic visual-action tokenizer, which aligns visual representations with both semantics and actions, improving instruction following and action precision in subsequent policy learning. (2) Given the strictly causal nature of temporal dynamics, we adopt a causal pretraining paradigm, training from scratch to circumvent the catastrophic forgetting that frequently occurs when adapting bidirectional architectures. (3) To meet the demands of high-frequency inference, our model employs a sparse MoE backbone, expanding model capacity without compromising efficiency. (4) Real-time closed-loop control is realized through an enhanced asynchronous inference scheme, which predicts future latents in parallel with action execution while re-grounding each rollout on the latest observation via learned forward dynamics. Real-world deployment validates LingBot-VA 2.0 as a robust foundation model, as evidenced by its few-shot generalization across complex manipulation tasks.
Key facts. Cited by 36 papers in the map (data through 14 Oct 2026). Builds on 115 of its 131 references that are in the map. First posted on arXiv 9 Jul 2026.
Builds on
115 of 131 references.
References · 115
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2023Consistency Modelscited by 1,822
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
38 more
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
- 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 879
- 2024DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Modelscited by 867
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
- 2024Genie: Generative Interactive Environmentscited by 747
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
- 2023Learning Universal Policies via Text-Guided Video Generationcited by 522
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
- 2023TD-MPC2: Scalable, Robust World Models for Continuous Controlcited by 512
- 2017Deep learning for universal linear embeddings of nonlinear dynamicscited by 494
- 2026World Action Models are Zero-shot Policiescited by 465
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 451
- 2025Muon is Scalable for LLM Trainingcited by 428
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 422
- 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 410
- 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 405
- 2022DayDreamer: World Models for Physical Robot Learningcited by 400
- 2024Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robotscited by 394
- 2025WorldVLA: Towards Autoregressive Action World Modelcited by 367
- 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 364
- 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 349
- 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?cited by 349
- 2022Video PreTraining (VPT): Learning to Act by Watching Unlabeled Online Videoscited by 345
- 20243D-VLA: A 3D Vision-Language-Action Generative World Modelcited by 328
- 2025Perception Encoder: The best visual embeddings are not at the output of the networkcited by 326
- 2024Latent Action Pretraining from Videoscited by 321
- 2026Causal World Modeling for Robot Controlcited by 321
- 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 303
- 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 300
- 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 296
- 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 289
- 2015Embed to Control: A Locally Linear Latent Dynamics Model for Control from Raw Imagescited by 274
- 2024Navigation World Modelscited by 272
- 2025Motus: A Unified Latent Action World Modelcited by 251
- 2025Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasetscited by 240
50 most cited of 115 All 115 (JSON)
Built on by
Citing papers per year: 2026: 36.
36 papers.
Sort:
By area:
- 2026Xiaomi-Robotics-1: Scaling Vision-Language-Action Models with over 100K Hours of Real-World Trajectoriescited by 29
- 2026Zero-WAM: In-Context World-Action Modeling from Human Videos for Open-Ended Task Generalizationcited by 13
- 2026Flex-π: A Multi-Stream World-Action Model with Compute Flexibilitycited by 11
- 2026WorldScape Policy 2.0: Empowering Steerable World Action Modeling with Reasoning-Augmented Memory and In-Context Learningcited by 6
- 2026Data Pyramid for Embodied Manipulation: A Surveycited by 6
- 2026GE-Act 2.0: Pretraining and Scaling a World-Action Model for Robotic Manipulationcited by 5
- 2026ZimaBlue: Evolving Generalizable World Action Models through Scalable Video Pre-trainingcited by 4
- 2026Enfold: Folding World Model Imagination into Predictive Representations for Ultra-Efficient Embodied Controlcited by 3
- 2026AffordanceWAM: Affordance-Aware Joint World-Action Modeling for Robot Manipulationcited by 3
- 2026PhyAI: Real-Time Physical AI at the Edge, Scalable Rollouts in the Cloudcited by 1
- 2026Streaming-WAM: Action-Conditioned World-Action Model for Asynchronous Robot Manipulationcited by 1
- 2026Rolling-WAM: World Action Models with Rolling Imaginationcited by 1
24 more
- 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Datacited by 1
- 2026Rethinking Representations for World-Action Modelingcited by 1
- 2026Long-WAM: Scaling the Context of World-Action Modelscited by 1
- 2026N0-Foundation: Towards the Age of Tactile Intelligencecited by 0
- 2026Acting in Meters: Learning Metric Interactions for Precise Robotic Manipulationcited by 0
- 2026CSWAM: Better Causal Semantic Representations for Out-of-Distribution Generalization in World Action Modelscited by 0
- 2026From Rollout to Reset: A Graph-Based Harness for Autonomous Long-Horizon Manipulation Evaluationcited by 0
- 2026What Matters in Designing World Action Models: An Empirical Studycited by 0
- 2026DualWAM: Dual-System World Action Models for Asynchronous Global Planning and Local Refinementcited by 0
- 2026An Action Is Worth One Patch: Unified World-Action Modeling with PatchWAMcited by 0
- 2026WorldGuide: Learning Success-Failure Boundaries in Latent World Models for Vision-Language-Action Policiescited by 0
- 2026Revision, Not Restart: Revisable Visual Plans for Closed-Loop World-Action Modelscited by 0
- 2026V-JEPA Policy: Building Effective World-Action Models on Predictive Visual Latentscited by 0
- 2026Direct Experience World-Model Optimization: Learning the World Beyond Action Imitationcited by 0
- 2026CogWAM: Aligning Semantic Cognition with World Action Modeling via Event-Driven Interfacescited by 0
- 2026LocoWM: High-Precision Locomotion through World-Model-Guided Residual Adaptationcited by 0
- 2026SplineWAM: Adaptive Action Horizons for World Action Models via B-Spline Representationscited by 0
- 2026Native Action-Prior Learning from Videos for World Action Modelscited by 0
- 2026OpenWAM: An Open Framework for Composable World-Action Modelscited by 0
- 2026WAM-Cache: Staleness-Bounded KV Reuse for Efficient World Action Modelscited by 0
- 2026What Visual Representations Do World Action Models Need?cited by 0
- 2026BridgeWAM: Bridging Video and Action Experts via Latent Bridge Queriescited by 0
- 2026LoopWAM: Closed-Loop Generalist Policy Improvement from Deployment Rolloutscited by 0
- 2026VITAL: From Visual Motion to Precise Actioncited by 0
- 2026VITAL: From Visual Motion to Precise Action14 Oct 2026
- 2026LoopWAM: Closed-Loop Generalist Policy Improvement from Deployment Rollouts13 Oct 2026
- 2026BridgeWAM: Bridging Video and Action Experts via Latent Bridge Queries10 Oct 2026
- 2026What Visual Representations Do World Action Models Need?9 Oct 2026
- 2026WAM-Cache: Staleness-Bounded KV Reuse for Efficient World Action Models8 Oct 2026
- 2026Long-WAM: Scaling the Context of World-Action Models7 Oct 2026
- 2026OpenWAM: An Open Framework for Composable World-Action Models6 Oct 2026
- 2026Native Action-Prior Learning from Videos for World Action Models2 Oct 2026
- 2026SplineWAM: Adaptive Action Horizons for World Action Models via B-Spline Representations30 Sep 2026
- 2026LocoWM: High-Precision Locomotion through World-Model-Guided Residual Adaptation30 Sep 2026
- 2026Rethinking Representations for World-Action Modeling29 Sep 2026
- 2026CogWAM: Aligning Semantic Cognition with World Action Modeling via Event-Driven Interfaces29 Sep 2026
24 more
- 2026Direct Experience World-Model Optimization: Learning the World Beyond Action Imitation29 Sep 2026
- 2026V-JEPA Policy: Building Effective World-Action Models on Predictive Visual Latents29 Sep 2026
- 2026Revision, Not Restart: Revisable Visual Plans for Closed-Loop World-Action Models28 Sep 2026
- 2026WorldGuide: Learning Success-Failure Boundaries in Latent World Models for Vision-Language-Action Policies28 Sep 2026
- 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Data25 Sep 2026
- 2026Rolling-WAM: World Action Models with Rolling Imagination24 Sep 2026
- 2026Streaming-WAM: Action-Conditioned World-Action Model for Asynchronous Robot Manipulation24 Sep 2026
- 2026An Action Is Worth One Patch: Unified World-Action Modeling with PatchWAM22 Sep 2026
- 2026DualWAM: Dual-System World Action Models for Asynchronous Global Planning and Local Refinement21 Sep 2026
- 2026What Matters in Designing World Action Models: An Empirical Study21 Sep 2026
- 2026AffordanceWAM: Affordance-Aware Joint World-Action Modeling for Robot Manipulation16 Sep 2026
- 2026From Rollout to Reset: A Graph-Based Harness for Autonomous Long-Horizon Manipulation Evaluation16 Sep 2026
- 2026CSWAM: Better Causal Semantic Representations for Out-of-Distribution Generalization in World Action Models16 Sep 2026
- 2026Acting in Meters: Learning Metric Interactions for Precise Robotic Manipulation16 Sep 2026
- 2026GE-Act 2.0: Pretraining and Scaling a World-Action Model for Robotic Manipulation4 Sep 2026
- 2026ZimaBlue: Evolving Generalizable World Action Models through Scalable Video Pre-training31 Aug 2026
- 2026N0-Foundation: Towards the Age of Tactile Intelligence30 Aug 2026
- 2026Zero-WAM: In-Context World-Action Modeling from Human Videos for Open-Ended Task Generalization26 Aug 2026
- 2026Flex-π: A Multi-Stream World-Action Model with Compute Flexibility11 Aug 2026
- 2026PhyAI: Real-Time Physical AI at the Edge, Scalable Rollouts in the Cloud4 Aug 2026
- 2026Enfold: Folding World Model Imagination into Predictive Representations for Ultra-Efficient Embodied Control29 Jul 2026
- 2026Data Pyramid for Embodied Manipulation: A Survey27 Jul 2026
- 2026WorldScape Policy 2.0: Empowering Steerable World Action Modeling with Reasoning-Augmented Memory and In-Context Learning21 Jul 2026
- 2026Xiaomi-Robotics-1: Scaling Vision-Language-Action Models with over 100K Hours of Real-World Trajectories16 Jul 2026
- 2026Zero-WAM: In-Context World-Action Modeling from Human Videos for Open-Ended Task Generalizationcited by 13
- 2026Flex-π: A Multi-Stream World-Action Model with Compute Flexibilitycited by 11
- 2026WorldScape Policy 2.0: Empowering Steerable World Action Modeling with Reasoning-Augmented Memory and In-Context Learningcited by 6
- 2026GE-Act 2.0: Pretraining and Scaling a World-Action Model for Robotic Manipulationcited by 5
- 2026ZimaBlue: Evolving Generalizable World Action Models through Scalable Video Pre-trainingcited by 4
- 2026Enfold: Folding World Model Imagination into Predictive Representations for Ultra-Efficient Embodied Controlcited by 3
- 2026AffordanceWAM: Affordance-Aware Joint World-Action Modeling for Robot Manipulationcited by 3
- 2026Streaming-WAM: Action-Conditioned World-Action Model for Asynchronous Robot Manipulationcited by 1
- 2026Rolling-WAM: World Action Models with Rolling Imaginationcited by 1
- 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Datacited by 1
- 2026Rethinking Representations for World-Action Modelingcited by 1
- 2026Long-WAM: Scaling the Context of World-Action Modelscited by 1
12 most cited of 31 All 31 (JSON)
- 2026VITAL: From Visual Motion to Precise Action14 Oct 2026
- 2026LoopWAM: Closed-Loop Generalist Policy Improvement from Deployment Rollouts13 Oct 2026
- 2026BridgeWAM: Bridging Video and Action Experts via Latent Bridge Queries10 Oct 2026
- 2026What Visual Representations Do World Action Models Need?9 Oct 2026
- 2026WAM-Cache: Staleness-Bounded KV Reuse for Efficient World Action Models8 Oct 2026
- 2026Long-WAM: Scaling the Context of World-Action Models7 Oct 2026
- 2026OpenWAM: An Open Framework for Composable World-Action Models6 Oct 2026
- 2026Native Action-Prior Learning from Videos for World Action Models2 Oct 2026
- 2026SplineWAM: Adaptive Action Horizons for World Action Models via B-Spline Representations30 Sep 2026
- 2026LocoWM: High-Precision Locomotion through World-Model-Guided Residual Adaptation30 Sep 2026
- 2026Rethinking Representations for World-Action Modeling29 Sep 2026
- 2026CogWAM: Aligning Semantic Cognition with World Action Modeling via Event-Driven Interfaces29 Sep 2026
12 newest of 31 All 31 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025mimic-video: Video-Action Models for Generalizable Robot Control Beyond VLAs
- 2026DeVA: Decoupled Video-Action Model with physical guidance for robot policy learning
- 2025Large Video Planner Enables Generalizable Robot Control
- 2026Motubrain: An Advanced World Action Model for Robot Control
- 2026Rewiring Semantics, Dynamics, and Control: A Simple yet Effective Action-Centric Tri-Stream Transformer
- 2026DiT4DiT: Jointly Modeling Video Dynamics and Actions for Generalizable Robot Control
- 2026From Human Videos to Robot Manipulation: A Survey on Scalable Vision-Language-Action Learning with Human-Centric Data
- 2026ViDAL: A Visual Dynamics-Grounded Action Latent Space for Vision-Language-Action Models