Towards Predictive, Aligned, and Scalable Robot Learning
On the map: World models → Embodied and robot world models
Abstract (arXiv)
Learning, at its core, extends beyond memorization to the ability to reason and solve novel problems by navigating a space of possibilities. We introduce Lumo-2, a latent world-action model that generates actions by reasoning over world dynamics in latent space. The learned latent world dynamics capture physically grounded visual transitions, naturally encoding future possibilities and providing a unified substrate for cross-modal alignment. This formulation enables predictive reasoning akin to world modelling while remaining lightweight and focused on physical dynamics relevant to control. Central to our approach is the hypothesis that action generation quality is governed by the geometry of the latent space. We observe that standard reconstruction-based action tokenization objectives induce representations biased toward low-level signal fidelity, leading to misalignment between reconstruction quality and downstream control performance. To address this limitation, we propose a multi-stage modality pre-alignment strategy in which action representations are progressively aligned with latent world dynamics, vision, and language. This process enforces cross-modal consistency, promotes abstraction, and induces a structured latent space for predictive reasoning. We provide a systematic empirical study of latent world modelling and modality alignment, analyzing their roles in scaling laws and out-of-distribution generalization. Results show that Lumo-2 consistently outperforms strong vision-language-action (VLA) and world-action model (WAM) baselines, with gains on challenging real-world tasks requiring temporal reasoning, physical understanding, or high control complexity, including long-horizon and dexterous manipulation. These findings suggest that structured multimodal alignment and predictive reasoning are fundamental principles for advancing embodied intelligence.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 72 of its 117 references that are in the map. First posted on arXiv 13 Jul 2026.
Builds on
72 of 117 references.
Closest ancestors · 10
Same direction, newest first
- 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?17 Mar
- 2026World Guidance: World Modeling in Condition Space for Action Generation25 Feb
- 2026FRAPPE: Infusing World Modeling into Generalist Policies via Multiple Future Representation Alignment19 Feb
- 2026World Action Models are Zero-shot Policies17 Feb
- 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Model10 Feb
- 2026Causal World Modeling for Robot Control29 Jan
- 2025Motus: A Unified Latent Action World Model15 Dec
- 2025FLARE: Robot Learning with Implicit World Modeling21 May
- 2025Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasets3 Apr
- 2024Robotic Control via Embodied Chain-of-Thought Reasoning11 Jul
Other references · 62
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2017Decoupled Weight Decay Regularizationcited by 1,722
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
38 more
- 2024PaliGemma: A versatile 3B VLM for transfercited by 679
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
- 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 550
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 411
- 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 390
- 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 386
- 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planningcited by 357
- 2024LMMs-Eval: Reality Check on the Evaluation of Large Multimodal Modelscited by 344
- 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 279
- 2023What's "up" with vision-language models? Investigating their struggle with spatial reasoningcited by 245
- 2024RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Roboticscited by 242
- 2025Unified Video Action Modelcited by 195
- 2025MolmoAct: Action Reasoning Models that can Reason in Spacecited by 189
- 2025ThinkAct: Vision-Language-Action Reasoning via Reinforced Visual Latent Planningcited by 152
- 2025mimic-video: Video-Action Models for Generalizable Robot Control Beyond VLAscited by 133
- 2026Molmo2: Open Weights and Data for Vision-Language Models with Video Understanding and Groundingcited by 132
- 2025Genie Envisioner: A Unified World Foundation Platform for Robotic Manipulationcited by 129
- 2026π0.7: a Steerable Generalist Robotic Foundation Model with Emergent Capabilitiescited by 127
- 2025Cambrian-S: Towards Spatial Supersensing in Videocited by 123
- 2024VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understandingcited by 113
- 2022EgoTaskQA: Understanding Human Tasks in Egocentric Videoscited by 112
- 2025ViewSpatial-Bench: Evaluating Multi-perspective Spatial Localization in Vision-Language Modelscited by 110
- 2025Galaxea Open-World Dataset and G0 Dual-System VLA Modelcited by 90
- 2025Video Generators are Robot Policiescited by 86
- 2023EgoPlan-Bench: Benchmarking Multimodal Large Language Models for Human-Level Planningcited by 66
- 2025VideoVLA: Video Generators Can Be Generalizable Robot Manipulatorscited by 61
- 2025Vidar: Embodied Video Diffusion Model for Generalist Manipulationcited by 58
- 2025FineVision: Open Data Is All You Needcited by 51
- 2026LDA-1B: Scaling Latent Dynamics Action Model via Universal Embodied Data Ingestioncited by 46
- 2024Emma-X: An Embodied Multimodal Action Model with Grounded Chain of Thought and Look-ahead Spatial Reasoningcited by 45
- 2025ControlVLA: Few-shot Object-centric Adaptation for Pre-trained Vision-Language-Action Modelscited by 43
- 2025Robo2VLM: Visual Question Answering from Large-Scale In-the-Wild Robot Manipulation Datasetscited by 39
- 2026RoboBrain 2.5: Depth in Sight, Time in Mindcited by 38
- 2025Emergence of Human to Robot Transfer in Vision-Language-Action Modelscited by 36
- 2025AlignTok: Aligning Visual Foundation Encoders to Tokenizers for Diffusion Modelscited by 35
- 2025From Seeing to Doing: Bridging Reasoning and Decision for Robotic Manipulationcited by 34
- 2026RynnBrain: Open Embodied Foundation Modelscited by 33
50 most cited of 62 All 62 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Being-H0.7: A Latent World-Action Model from Egocentric Videos
- 2026LaWAM: Latent World Action Models for Efficient Dynamics-Aware Robot Policies
- 2026AcrossWAM1.0:A Modular Latent World-Action Stack for Compact Robot Policies
- 2026ω-EVA: Envision, Verify, and Act with Latent Interactive World Models
- 2026LeapBot-WA: World-Anchor Action Models via Predictive Latent Alignments
- 2026LaWM: Least Action World Models for Long-Horizon Physical Consistency from Visual Observations
- 2026InternVLA-A1.5: Unifying Understanding, Latent Foresight, and Action for Compositional Generalization
- 2026ATI-VLA: Action-Centric Predictive Vision-Language-Action Models via Actionable Alignment Then Adaptive Injection