mlsanityData to 14 Oct 2026

Toward Unified Robot Learning: Bridging Representation, Vision-Language-Action, and World Models

arXiv 2609.03927 ↗First posted 3 Sep 2026cs.ROcited by 0

On the map: World models → Embodied and robot world models

also in 1 more
Abstract (arXiv)

For robots to operate reliably in real-world environments, they need to perceive their surroundings, act, and reason about the consequences of those actions. Rapid progress in the domains of representation learning, VLA models, and world models has significantly enhanced the capabilities of robot learning systems, enabling robots to work in increasingly complex environments. However, these paradigms are typically developed in isolation, resulting in fragmented systems that struggle with generalization, long-horizon temporal reasoning and planning, and deployment in unstructured environments. In this survey, we present a unified perspective on robot learning by organizing the existing methods along three complementary axes: understanding through representation learning, acting through VLA models, and reasoning through world models. We introduce a structured taxonomy that captures key design choices in environment representation, policy learning, and predictive modeling, and summarize the recent progress in these domains. Beyond classifying the existing works, we analyze how these components interact, discuss common limitations, and highlight emerging trends towards more integrated systems. Through this lens, we identify the challenges in the domain of robot learning, including uncertainty quantification, out-of-distribution generalization, cross-embodiment transfer, long-context understanding, and long-horizon planning. We argue that these challenges arise not only from limitations within individual components but also from the lack of integration across perception, action, and reasoning. Building on this analysis, we outline future directions towards unified, physically grounded, and probabilistic robot learning to develop robust robotic systems that maintain consistent internal representations and support decision making over extended interactions in real-world environments.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 138 of its 293 references that are in the map. First posted on arXiv 3 Sep 2026.

Builds on

138 of 293 references.

Closest ancestors · 44

Same direction, newest first

  1. 2026EWAM: An Enhanced World Action Model for Closed-Loop Online Adaptation in Embodied Intelligence10 Jun
  2. 2026Kinema4D: Kinematic 4D World Modeling for Spatiotemporal Embodied Simulation17 Mar
  3. 2026PlayWorld: Learning Robot World Models from Autonomous Play9 Mar
  4. 2026Interactive World Simulator for Robot Policy Training and Evaluation9 Mar
  5. 2026AtomVLA: Scalable Post-Training for Robotic Manipulation via Predictive Latent World Models9 Mar
  6. 2026World Guidance: World Modeling in Condition Space for Action Generation25 Feb
  7. 2026World Action Models are Zero-shot Policies17 Feb
  8. 2026WoVR: World Models as Reliable Simulators for Post-Training VLA Policies with RL15 Feb
  9. 2026Say, Dream, and Act: Learning Video World Models for Instruction-Driven Robot Manipulation11 Feb
  10. 2026World-Gymnast: Training Robots with Reinforcement Learning in a World Model2 Feb
  11. 2026Causal World Modeling for Robot Control29 Jan
  12. 2026Walk through Paintings: Egocentric World Models from Internet Priors21 Jan
32 more
  1. 2026PointWorld: Scaling 3D World Models for In-The-Wild Robotic Manipulation7 Jan
  2. 2025MIND-V: Hierarchical World Model for Long-Horizon Robotic Manipulation with RL-based Physical Alignment7 Dec
  3. 2025RynnVLA-002: A Unified Vision-Language-Action and World Model21 Nov
  4. 2025Towards High-Consistency Embodied World Model with Multi-View Trajectory Videos17 Nov
  5. 2025WMPO: World Model-based Policy Optimization for Vision-Language-Action Models12 Nov
  6. 2025Robot Learning from a Physical World Model10 Nov
  7. 2025Dual-Stream Diffusion for World-Model Augmented Vision-Language-Action Model31 Oct
  8. 2025Ctrl-World: A Controllable Generative World Model for Robot Manipulation11 Oct
  9. 2025RoDyn: Taming Interactive Robot-Dynamic 2.5D World Model for Robotic Manipulation10 Oct
  10. 2025World-Env: Leveraging World Model as a Virtual Environment for VLA Post-Training29 Sep
  11. 2025MoWM: Mixture-of-World-Models for Embodied Planning via Latent-to-Pixel Feature Modulation26 Sep
  12. 2025LongScape: Advancing Long-Horizon Embodied World Models with Context-Aware MoE26 Sep
  13. 2025KeyWorld: Key Frame Reasoning Enables Effective and Efficient World Models25 Sep
  14. 2025World4RL: Diffusion World Models for Policy Refinement with Reinforcement Learning for Robotic Manipulation23 Sep
  15. 2025GWM: Towards Scalable Gaussian World Models for Robotic Manipulation25 Aug
  16. 2025villa-X: Enhancing Latent Action Modeling in Vision-Language-Action Models31 Jul
  17. 2025EmbodieDreamer: Advancing Real2Sim2Real Transfer for Policy Training via Embodied World Modeling7 Jul
  18. 2025RoboScape: Physics-informed Embodied World Model29 Jun
  19. 2025WorldVLA: Towards Autoregressive Action World Model26 Jun
  20. 2025MinD: Learning A Dual-System World Model for Real-Time Planning and Implicit Risk Analysis23 Jun
  21. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planning11 Jun
  22. 2025FLARE: Robot Learning with Implicit World Modeling21 May
  23. 2025DreamGen: Unlocking Generalization in Robot Learning through Video World Models19 May
  24. 2025FlowDreamer: A RGB-D World Model with Flow-based Motion Representations for Robot Manipulation15 May
  25. 2025LaDi-WM: A Latent Diffusion-based World Model for Predictive Manipulation13 May
  26. 2025TesserAct: Learning 4D Embodied World Models29 Apr
  27. 2025ManipDreamer: Boosting Robotic Manipulation World Model with Action Tree and Visual Guidance23 Apr
  28. 2025Aether: Geometric-Aware Unified World Modeling24 Mar
  29. 2025RoboHorizon: An LLM-Assisted Multi-View World Model for Long-Horizon Robotic Manipulation11 Jan
  30. 2025EnerVerse: Envisioning Embodied Future Space for Robotics Manipulation3 Jan
  31. 2024IRASim: A Fine-Grained World Model for Robot Manipulation20 Jun
  32. 2023DITTO: Offline Imitation Learning with World Models6 Feb

Other references · 94

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  3. 2022Flow Matching for Generative Modelingcited by 5,702
  4. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  5. 2015Continuous control with deep reinforcement learningcited by 3,407
  6. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  7. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  8. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  9. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
  10. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
  11. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  12. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
38 more
  1. 2018World Modelscited by 1,513
  2. 2023Mastering Diverse Domains through World Modelscited by 1,253
  3. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
  4. 2020Mastering Atari with Discrete World Modelscited by 1,007
  5. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
  6. 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
  7. 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
  8. 2022A Generalist Agentcited by 808
  9. 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 750
  10. 2022R3M: A Universal Visual Representation for Robot Manipulationcited by 694
  11. 2021VideoGPT: Video Generation using VQ-VAE and Transformerscited by 658
  12. 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 422
  13. 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 410
  14. 2023Robots That Ask For Help: Uncertainty Alignment for Large Language Model Plannerscited by 308
  15. 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 303
  16. 2025LIBERO-Plus: In-depth Robustness Analysis of Vision-Language-Action Modelscited by 303
  17. 2018Visual Foresight: Model-Based Deep Reinforcement Learning for Vision-Based Robotic Controlcited by 230
  18. 2015Contextual Markov Decision Processescited by 220
  19. 2025DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledgecited by 213
  20. 2018Generative Adversarial Imitation from Observationcited by 184
  21. 2024Gen2Act: Human Video Generation in Novel Scenarios enables Generalizable Robot Manipulationcited by 153
  22. 2025Genie Envisioner: A Unified World Foundation Platform for Robotic Manipulationcited by 137
  23. 2025Training Agents Inside of Scalable World Modelscited by 136
  24. 2025Cosmos-Transfer1: Conditional World Generation with Adaptive Multimodal Controlcited by 106
  25. 2024Pandora: Towards General World Model with Natural Language Actions and Video Statescited by 86
  26. 2024Beyond the Limits: A Survey of Techniques to Extend the Context Length in Large Language Modelscited by 76
  27. 2023Advancing Transformer Architecture in Long-Context Large Language Models: A Comprehensive Surveycited by 72
  28. 2025GeoVLA: Empowering 3D Representations in Vision-Language-Action Modelscited by 70
  29. 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Surveycited by 69
  30. 2025A Comprehensive Survey on World Models for Embodied AIcited by 68
  31. 2025Back to the Features: DINO as a Foundation for Video World Modelscited by 58
  32. 2024MineDreamer: Learning to Follow Instructions via Chain-of-Imagination for Simulated-World Controlcited by 53
  33. 2025Robotic World Model: A Neural Network Simulator for Robust Policy Optimization in Roboticscited by 51
  34. 2025Interleave-VLA: Enhancing Robot Manipulation with Interleaved Image-Text Instructionscited by 51
  35. 2025ManiFlow: A General Robot Manipulation Policy via Consistency Flow Trainingcited by 49
  36. 2025Pure Vision Language Action (VLA) Models: A Comprehensive Surveycited by 49
  37. 2025HAMLET: Switch your Vision-Language-Action Model into a History-Aware Policycited by 46
  38. 2025DepthVLA: Enhancing Vision-Language-Action Models with Depth-Aware Spatial Reasoningcited by 46

50 most cited of 94 All 94 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026World-Action Models for Robot Learning and Control: A Survey
  2. 2026Think Like a World Model, Act Like a VLA: Distilling World-Model Representations into Compact Robot Policies
  3. 2025An Anatomy of Vision-Language-Action Models: From Modules to Milestones and Challenges
  4. 2025Vision-Language-Action Models for Robotics: A Review Towards Real-World Applications
  5. 2025From Intention to Execution: Probing the Generalization Boundaries of Vision-Language-Action Models
  6. 2026Do World Action Models Generalize Better than VLAs? A Robustness Study
  7. 2025Robot Control Stack: A Lean Ecosystem for Robot Learning at Scale
  8. 2026Rethinking Visual-Language-Action Model Scaling: Alignment, Mixture, and Regularization