Toward Unified Robot Learning: Bridging Representation, Vision-Language-Action, and World Models
On the map: World models → Embodied and robot world models
also in 1 more
Abstract (arXiv)
For robots to operate reliably in real-world environments, they need to perceive their surroundings, act, and reason about the consequences of those actions. Rapid progress in the domains of representation learning, VLA models, and world models has significantly enhanced the capabilities of robot learning systems, enabling robots to work in increasingly complex environments. However, these paradigms are typically developed in isolation, resulting in fragmented systems that struggle with generalization, long-horizon temporal reasoning and planning, and deployment in unstructured environments. In this survey, we present a unified perspective on robot learning by organizing the existing methods along three complementary axes: understanding through representation learning, acting through VLA models, and reasoning through world models. We introduce a structured taxonomy that captures key design choices in environment representation, policy learning, and predictive modeling, and summarize the recent progress in these domains. Beyond classifying the existing works, we analyze how these components interact, discuss common limitations, and highlight emerging trends towards more integrated systems. Through this lens, we identify the challenges in the domain of robot learning, including uncertainty quantification, out-of-distribution generalization, cross-embodiment transfer, long-context understanding, and long-horizon planning. We argue that these challenges arise not only from limitations within individual components but also from the lack of integration across perception, action, and reasoning. Building on this analysis, we outline future directions towards unified, physically grounded, and probabilistic robot learning to develop robust robotic systems that maintain consistent internal representations and support decision making over extended interactions in real-world environments.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 138 of its 293 references that are in the map. First posted on arXiv 3 Sep 2026.
Builds on
138 of 293 references.
Closest ancestors · 44
Same direction, newest first
- 2026EWAM: An Enhanced World Action Model for Closed-Loop Online Adaptation in Embodied Intelligence10 Jun
- 2026Kinema4D: Kinematic 4D World Modeling for Spatiotemporal Embodied Simulation17 Mar
- 2026PlayWorld: Learning Robot World Models from Autonomous Play9 Mar
- 2026Interactive World Simulator for Robot Policy Training and Evaluation9 Mar
- 2026AtomVLA: Scalable Post-Training for Robotic Manipulation via Predictive Latent World Models9 Mar
- 2026World Guidance: World Modeling in Condition Space for Action Generation25 Feb
- 2026World Action Models are Zero-shot Policies17 Feb
- 2026WoVR: World Models as Reliable Simulators for Post-Training VLA Policies with RL15 Feb
- 2026Say, Dream, and Act: Learning Video World Models for Instruction-Driven Robot Manipulation11 Feb
- 2026World-Gymnast: Training Robots with Reinforcement Learning in a World Model2 Feb
- 2026Causal World Modeling for Robot Control29 Jan
- 2026Walk through Paintings: Egocentric World Models from Internet Priors21 Jan
32 more
- 2026PointWorld: Scaling 3D World Models for In-The-Wild Robotic Manipulation7 Jan
- 2025MIND-V: Hierarchical World Model for Long-Horizon Robotic Manipulation with RL-based Physical Alignment7 Dec
- 2025RynnVLA-002: A Unified Vision-Language-Action and World Model21 Nov
- 2025Towards High-Consistency Embodied World Model with Multi-View Trajectory Videos17 Nov
- 2025WMPO: World Model-based Policy Optimization for Vision-Language-Action Models12 Nov
- 2025Robot Learning from a Physical World Model10 Nov
- 2025Dual-Stream Diffusion for World-Model Augmented Vision-Language-Action Model31 Oct
- 2025Ctrl-World: A Controllable Generative World Model for Robot Manipulation11 Oct
- 2025RoDyn: Taming Interactive Robot-Dynamic 2.5D World Model for Robotic Manipulation10 Oct
- 2025World-Env: Leveraging World Model as a Virtual Environment for VLA Post-Training29 Sep
- 2025MoWM: Mixture-of-World-Models for Embodied Planning via Latent-to-Pixel Feature Modulation26 Sep
- 2025LongScape: Advancing Long-Horizon Embodied World Models with Context-Aware MoE26 Sep
- 2025KeyWorld: Key Frame Reasoning Enables Effective and Efficient World Models25 Sep
- 2025World4RL: Diffusion World Models for Policy Refinement with Reinforcement Learning for Robotic Manipulation23 Sep
- 2025GWM: Towards Scalable Gaussian World Models for Robotic Manipulation25 Aug
- 2025villa-X: Enhancing Latent Action Modeling in Vision-Language-Action Models31 Jul
- 2025EmbodieDreamer: Advancing Real2Sim2Real Transfer for Policy Training via Embodied World Modeling7 Jul
- 2025RoboScape: Physics-informed Embodied World Model29 Jun
- 2025WorldVLA: Towards Autoregressive Action World Model26 Jun
- 2025MinD: Learning A Dual-System World Model for Real-Time Planning and Implicit Risk Analysis23 Jun
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planning11 Jun
- 2025FLARE: Robot Learning with Implicit World Modeling21 May
- 2025DreamGen: Unlocking Generalization in Robot Learning through Video World Models19 May
- 2025FlowDreamer: A RGB-D World Model with Flow-based Motion Representations for Robot Manipulation15 May
- 2025LaDi-WM: A Latent Diffusion-based World Model for Predictive Manipulation13 May
- 2025TesserAct: Learning 4D Embodied World Models29 Apr
- 2025ManipDreamer: Boosting Robotic Manipulation World Model with Action Tree and Visual Guidance23 Apr
- 2025Aether: Geometric-Aware Unified World Modeling24 Mar
- 2025RoboHorizon: An LLM-Assisted Multi-View World Model for Long-Horizon Robotic Manipulation11 Jan
- 2025EnerVerse: Envisioning Embodied Future Space for Robotics Manipulation3 Jan
- 2024IRASim: A Fine-Grained World Model for Robot Manipulation20 Jun
- 2023DITTO: Offline Imitation Learning with World Models6 Feb
Other references · 94
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2015Continuous control with deep reinforcement learningcited by 3,407
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
38 more
- 2018World Modelscited by 1,513
- 2023Mastering Diverse Domains through World Modelscited by 1,253
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2020Mastering Atari with Discrete World Modelscited by 1,007
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
- 2022A Generalist Agentcited by 808
- 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 750
- 2022R3M: A Universal Visual Representation for Robot Manipulationcited by 694
- 2021VideoGPT: Video Generation using VQ-VAE and Transformerscited by 658
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 422
- 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 410
- 2023Robots That Ask For Help: Uncertainty Alignment for Large Language Model Plannerscited by 308
- 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 303
- 2025LIBERO-Plus: In-depth Robustness Analysis of Vision-Language-Action Modelscited by 303
- 2018Visual Foresight: Model-Based Deep Reinforcement Learning for Vision-Based Robotic Controlcited by 230
- 2015Contextual Markov Decision Processescited by 220
- 2025DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledgecited by 213
- 2018Generative Adversarial Imitation from Observationcited by 184
- 2024Gen2Act: Human Video Generation in Novel Scenarios enables Generalizable Robot Manipulationcited by 153
- 2025Genie Envisioner: A Unified World Foundation Platform for Robotic Manipulationcited by 137
- 2025Training Agents Inside of Scalable World Modelscited by 136
- 2025Cosmos-Transfer1: Conditional World Generation with Adaptive Multimodal Controlcited by 106
- 2024Pandora: Towards General World Model with Natural Language Actions and Video Statescited by 86
- 2024Beyond the Limits: A Survey of Techniques to Extend the Context Length in Large Language Modelscited by 76
- 2023Advancing Transformer Architecture in Long-Context Large Language Models: A Comprehensive Surveycited by 72
- 2025GeoVLA: Empowering 3D Representations in Vision-Language-Action Modelscited by 70
- 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Surveycited by 69
- 2025A Comprehensive Survey on World Models for Embodied AIcited by 68
- 2025Back to the Features: DINO as a Foundation for Video World Modelscited by 58
- 2024MineDreamer: Learning to Follow Instructions via Chain-of-Imagination for Simulated-World Controlcited by 53
- 2025Robotic World Model: A Neural Network Simulator for Robust Policy Optimization in Roboticscited by 51
- 2025Interleave-VLA: Enhancing Robot Manipulation with Interleaved Image-Text Instructionscited by 51
- 2025ManiFlow: A General Robot Manipulation Policy via Consistency Flow Trainingcited by 49
- 2025Pure Vision Language Action (VLA) Models: A Comprehensive Surveycited by 49
- 2025HAMLET: Switch your Vision-Language-Action Model into a History-Aware Policycited by 46
- 2025DepthVLA: Enhancing Vision-Language-Action Models with Depth-Aware Spatial Reasoningcited by 46
50 most cited of 94 All 94 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026World-Action Models for Robot Learning and Control: A Survey
- 2026Think Like a World Model, Act Like a VLA: Distilling World-Model Representations into Compact Robot Policies
- 2025An Anatomy of Vision-Language-Action Models: From Modules to Milestones and Challenges
- 2025Vision-Language-Action Models for Robotics: A Review Towards Real-World Applications
- 2025From Intention to Execution: Probing the Generalization Boundaries of Vision-Language-Action Models
- 2026Do World Action Models Generalize Better than VLAs? A Robustness Study
- 2025Robot Control Stack: A Lean Ecosystem for Robot Learning at Scale
- 2026Rethinking Visual-Language-Action Model Scaling: Alignment, Mixture, and Regularization