mlsanityData to 7 Oct 2026

Towards Predictive, Aligned, and Scalable Robot Learning

arXiv 2607.11270 ↗First posted 13 Jul 2026cs.RO cs.AIcited by 2

On the map: World models → Embodied and robot world models

Abstract (arXiv)

Learning, at its core, extends beyond memorization to the ability to reason and solve novel problems by navigating a space of possibilities. We introduce Lumo-2, a latent world-action model that generates actions by reasoning over world dynamics in latent space. The learned latent world dynamics capture physically grounded visual transitions, naturally encoding future possibilities and providing a unified substrate for cross-modal alignment. This formulation enables predictive reasoning akin to world modelling while remaining lightweight and focused on physical dynamics relevant to control. Central to our approach is the hypothesis that action generation quality is governed by the geometry of the latent space. We observe that standard reconstruction-based action tokenization objectives induce representations biased toward low-level signal fidelity, leading to misalignment between reconstruction quality and downstream control performance. To address this limitation, we propose a multi-stage modality pre-alignment strategy in which action representations are progressively aligned with latent world dynamics, vision, and language. This process enforces cross-modal consistency, promotes abstraction, and induces a structured latent space for predictive reasoning. We provide a systematic empirical study of latent world modelling and modality alignment, analyzing their roles in scaling laws and out-of-distribution generalization. Results show that Lumo-2 consistently outperforms strong vision-language-action (VLA) and world-action model (WAM) baselines, with gains on challenging real-world tasks requiring temporal reasoning, physical understanding, or high control complexity, including long-horizon and dexterous manipulation. These findings suggest that structured multimodal alignment and predictive reasoning are fundamental principles for advancing embodied intelligence.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 72 of its 117 references that are in the map. First posted on arXiv 13 Jul 2026.

Builds on

72 of 117 references.

Closest ancestors · 10

Same direction, newest first

  1. 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?17 Mar
  2. 2026World Guidance: World Modeling in Condition Space for Action Generation25 Feb
  3. 2026FRAPPE: Infusing World Modeling into Generalist Policies via Multiple Future Representation Alignment19 Feb
  4. 2026World Action Models are Zero-shot Policies17 Feb
  5. 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Model10 Feb
  6. 2026Causal World Modeling for Robot Control29 Jan
  7. 2025Motus: A Unified Latent Action World Model15 Dec
  8. 2025FLARE: Robot Learning with Implicit World Modeling21 May
  9. 2025Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasets3 Apr
  10. 2024Robotic Control via Embodied Chain-of-Thought Reasoning11 Jul

Other references · 62

  1. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  2. 2025Qwen2.5-VL Technical Reportcited by 5,418
  3. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  4. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  5. 2025Qwen3-VL Technical Reportcited by 2,534
  6. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  7. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
  8. 2017Decoupled Weight Decay Regularizationcited by 1,722
  9. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  10. 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
  11. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
  12. 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
38 more
  1. 2024PaliGemma: A versatile 3B VLM for transfercited by 679
  2. 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
  3. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
  4. 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 550
  5. 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 411
  6. 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 390
  7. 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 386
  8. 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planningcited by 357
  9. 2024LMMs-Eval: Reality Check on the Evaluation of Large Multimodal Modelscited by 344
  10. 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 279
  11. 2023What's "up" with vision-language models? Investigating their struggle with spatial reasoningcited by 245
  12. 2024RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Roboticscited by 242
  13. 2025Unified Video Action Modelcited by 195
  14. 2025MolmoAct: Action Reasoning Models that can Reason in Spacecited by 189
  15. 2025ThinkAct: Vision-Language-Action Reasoning via Reinforced Visual Latent Planningcited by 152
  16. 2025mimic-video: Video-Action Models for Generalizable Robot Control Beyond VLAscited by 133
  17. 2026Molmo2: Open Weights and Data for Vision-Language Models with Video Understanding and Groundingcited by 132
  18. 2025Genie Envisioner: A Unified World Foundation Platform for Robotic Manipulationcited by 129
  19. 2026π0.7: a Steerable Generalist Robotic Foundation Model with Emergent Capabilitiescited by 127
  20. 2025Cambrian-S: Towards Spatial Supersensing in Videocited by 123
  21. 2024VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understandingcited by 113
  22. 2022EgoTaskQA: Understanding Human Tasks in Egocentric Videoscited by 112
  23. 2025ViewSpatial-Bench: Evaluating Multi-perspective Spatial Localization in Vision-Language Modelscited by 110
  24. 2025Galaxea Open-World Dataset and G0 Dual-System VLA Modelcited by 90
  25. 2025Video Generators are Robot Policiescited by 86
  26. 2023EgoPlan-Bench: Benchmarking Multimodal Large Language Models for Human-Level Planningcited by 66
  27. 2025VideoVLA: Video Generators Can Be Generalizable Robot Manipulatorscited by 61
  28. 2025Vidar: Embodied Video Diffusion Model for Generalist Manipulationcited by 58
  29. 2025FineVision: Open Data Is All You Needcited by 51
  30. 2026LDA-1B: Scaling Latent Dynamics Action Model via Universal Embodied Data Ingestioncited by 46
  31. 2024Emma-X: An Embodied Multimodal Action Model with Grounded Chain of Thought and Look-ahead Spatial Reasoningcited by 45
  32. 2025ControlVLA: Few-shot Object-centric Adaptation for Pre-trained Vision-Language-Action Modelscited by 43
  33. 2025Robo2VLM: Visual Question Answering from Large-Scale In-the-Wild Robot Manipulation Datasetscited by 39
  34. 2026RoboBrain 2.5: Depth in Sight, Time in Mindcited by 38
  35. 2025Emergence of Human to Robot Transfer in Vision-Language-Action Modelscited by 36
  36. 2025AlignTok: Aligning Visual Foundation Encoders to Tokenizers for Diffusion Modelscited by 35
  37. 2025From Seeing to Doing: Bridging Reasoning and Decision for Robotic Manipulationcited by 34
  38. 2026RynnBrain: Open Embodied Foundation Modelscited by 33

50 most cited of 62 All 62 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Being-H0.7: A Latent World-Action Model from Egocentric Videos
  2. 2026LaWAM: Latent World Action Models for Efficient Dynamics-Aware Robot Policies
  3. 2026AcrossWAM1.0:A Modular Latent World-Action Stack for Compact Robot Policies
  4. 2026ω-EVA: Envision, Verify, and Act with Latent Interactive World Models
  5. 2026LeapBot-WA: World-Anchor Action Models via Predictive Latent Alignments
  6. 2026LaWM: Least Action World Models for Long-Horizon Physical Consistency from Visual Observations
  7. 2026InternVLA-A1.5: Unifying Understanding, Latent Foresight, and Action for Compositional Generalization
  8. 2026ATI-VLA: Action-Centric Predictive Vision-Language-Action Models via Actionable Alignment Then Adaptive Injection