mlsanityData to 7 Oct 2026

Chain of World: World Model Thinking in Latent Motion

arXiv 2603.03195 ↗First posted 3 Mar 2026cs.CV cs.AI cs.ROcited by 8

On the map: World models → Embodied and robot world models

also in 1 more
Abstract (arXiv)

Vision-Language-Action (VLA) models are a promising path toward embodied intelligence, yet they often overlook the predictive and temporal-causal structure underlying visual dynamics. World-model VLAs address this by predicting future frames, but waste capacity reconstructing redundant backgrounds. Latent-action VLAs encode frame-to-frame transitions compactly, but lack temporally continuous dynamic modeling and world knowledge. To overcome these limitations, we introduce CoWVLA (Chain-of-World VLA), a new "Chain of World" paradigm that unifies world-model temporal reasoning with a disentangled latent motion representation. First, a pretrained video VAE serves as a latent motion extractor, explicitly factorizing video segments into structure and motion latents. Then, during pre-training, the VLA learns from an instruction and an initial frame to infer a continuous latent motion chain and predict the segment's terminal frame. Finally, during co-fine-tuning, this latent dynamic is aligned with discrete action prediction by jointly modeling sparse keyframes and action sequences in a unified autoregressive decoder. This design preserves the world-model benefits of temporal reasoning and world knowledge while retaining the compactness and interpretability of latent actions, enabling efficient visuomotor learning. Extensive experiments on robotic simulation benchmarks show that CoWVLA outperforms existing world-model and latent-action approaches and achieves moderate computational efficiency, highlighting its potential as a more effective VLA pretraining paradigm. The project website can be found at https://fx-hit.github.io/cowvla-io.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 56 of its 60 references that are in the map. First posted on arXiv 3 Mar 2026.

Builds on

56 of 60 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025FlowVLA: Visual Chain of Thought-based Motion Reasoning for Vision-Language-Action Models25 Aug
  2. 2025villa-X: Enhancing Latent Action Modeling in Vision-Language-Action Models31 Jul
  3. 2025WorldVLA: Towards Autoregressive Action World Model26 Jun
  4. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planning11 Jun
  5. 2025AdaWorld: Learning Adaptable World Models with Latent Actions24 Mar
  6. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusion7 Mar

Other references · 50

  1. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  2. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
  3. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  4. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  5. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  6. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  7. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
  8. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  9. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  10. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
  11. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
  12. 2024Emu3: Next-Token Prediction is All You Needcited by 761
38 more
  1. 2018QT-Opt: Scalable Deep Reinforcement Learning for Vision-Based Robotic Manipulationcited by 730
  2. 2024Genie: Generative Interactive Environmentscited by 706
  3. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
  4. 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 634
  5. 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 564
  6. 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
  7. 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 484
  8. 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 440
  9. 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 411
  10. 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 386
  11. 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 353
  12. 2023ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skillscited by 313
  13. 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Drivingcited by 309
  14. 2024Latent Action Pretraining from Videoscited by 302
  15. 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 290
  16. 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 286
  17. 2024Motion-I2V: Consistent and Controllable Image-to-Video Generation with Explicit Motion Modelingcited by 209
  18. 2025DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledgecited by 203
  19. 2025Unified Video Action Modelcited by 195
  20. 2022VIOLA: Imitation Learning for Vision-Based Manipulation with Object Proposal Priorscited by 135
  21. 2025Unified Vision-Language-Action Modelcited by 128
  22. 2024OccLLaMA: An Occupancy-Language-Action Generative World Model for Autonomous Drivingcited by 82
  23. 2022Latent Plans for Task-Agnostic Offline Reinforcement Learningcited by 81
  24. 2025Dita: Scaling Diffusion Transformer for Generalist Vision-Language-Action Policycited by 73
  25. 2023MUTEX: Learning Unified Policies from Multimodal Task Specificationscited by 70
  26. 2023PlayFusion: Skill Acquisition via Diffusion from Language-Annotated Playcited by 48
  27. 2023Train Offline, Test Online: A Real Robot Learning Benchmarkcited by 47
  28. 2024Efficient Video Diffusion Models via Content-Frame Motion-Latent Decompositioncited by 41
  29. 2025VLA-OS: Structuring and Dissecting Planning Representations and Paradigms in Vision-Language-Action Modelscited by 34
  30. 2024MANTA: A Large-Scale Multi-View and Visual-Text Anomaly Detection Dataset for Tiny Objectscited by 26
  31. 2025ViPRA: Video Prediction for Robot Actionscited by 24
  32. 2024Towards Effective Usage of Human-Centric Priors in Diffusion Models for Text-based Human Image Generationcited by 17
  33. 2024Salvaging the Overlooked: Leveraging Class-Aware Contrastive Learning for Multi-Class Anomaly Detectioncited by 15
  34. 2024VidTwin: Video VAE with Decoupled Structure and Dynamicscited by 14
  35. 2024Disentangled Motion Modeling for Video Frame Interpolationcited by 11
  36. 2024DH-FaceVid-1K: A Large-Scale High-Quality Dataset for Face Video Generationcited by 8
  37. 2025LLaPa: A Vision-Language Model Framework for Counterfactual-Aware Procedural Planningcited by 6
  38. 2026HMVLA: Hyperbolic Multimodal Fusion for Vision-Language-Action Modelscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 8.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Seeing Space and Motion: Enhancing Latent Actions with Geometric and Dynamic Awareness for Vision-Language-Action Models
  2. 2026World Tokens: Enhancing Embodied Policies with Training-Time World Modeling
  3. 2026Devol-ONE: One Autoregressive Mixture of Transformers to Unify Vision-Language-Action and Latent World Modeling
  4. 2026World-Language-Action Model for Unified World Modeling, Language Reasoning, and Action Synthesis
  5. 2026UniWAM: Unified World-Action Model
  6. 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Model
  7. 2026Being-H0.7: A Latent World-Action Model from Egocentric Videos
  8. 2026LeapBot-WA: World-Anchor Action Models via Predictive Latent Alignments