mlsanityData to 7 Oct 2026

XR-1: Towards Versatile Vision-Language-Action Models via Learning Unified Vision-Motion Representations

arXiv 2511.02776 ↗First posted 4 Nov 2025cs.ROcited by 15

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

also in 1 more
Abstract (arXiv)

Recent progress in large-scale robotic datasets and vision-language models (VLMs) has advanced research on vision-language-action (VLA) models. However, existing VLA models still face two fundamental challenges: (i) producing precise low-level actions from high-dimensional observations, (ii) bridging domain gaps across heterogeneous data sources, including diverse robot embodiments and human demonstrations. Existing methods often encode latent variables from either visual dynamics or robotic actions to guide policy learning, but they fail to fully exploit the complementary multi-modal knowledge present in large-scale, heterogeneous datasets. In this work, we present X Robotic Model 1 (XR-1), a novel framework for versatile and scalable VLA learning across diverse robots, tasks, and environments. XR-1 introduces the Unified Vision-Motion Codes (UVMC), a discrete latent representation learned via a dual-branch VQ-VAE that jointly encodes visual dynamics and robotic motion. UVMC addresses these challenges by (i) serving as an intermediate representation between the observations and actions, and (ii) aligning multimodal dynamic information from heterogeneous data sources to capture complementary knowledge. To effectively exploit UVMC, we propose a three-stage training paradigm: (i) self-supervised UVMC learning, (ii) UVMC-guided pretraining on large-scale cross-embodiment robotic datasets, and (iii) task-specific post-training. We validate XR-1 through extensive real-world experiments with more than 14,000 rollouts on six different robot embodiments, spanning over 120 diverse manipulation tasks. XR-1 consistently outperforms state-of-the-art baselines such as π0.5, π0, RDT, UniVLA, and GR00T-N1.5 while demonstrating strong generalization to novel objects, background variations, distractors, and illumination changes. Our project is at https://xr-1-vla.github.io/.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 96 of its 114 references that are in the map. First posted on arXiv 4 Nov 2025.

Builds on

96 of 114 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025MLA: A Multisensory Language-Action Model for Multimodal Understanding and Forecasting in Robotic Manipulation30 Sep
  2. 2025From Seeing to Doing: Bridging Reasoning and Decision for Robotic Manipulation13 May
  3. 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Models27 Mar
  4. 2025DexVLA: Vision-Language Model with Plug-In Diffusion Expert for General Robot Control9 Feb
  5. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control28 Jul
  6. 2023PaLM-E: An Embodied Multimodal Language Model6 Mar

Other references · 90

  1. 2023Visual Instruction Tuningcited by 7,792
  2. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  3. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  4. 2017Neural Discrete Representation Learningcited by 4,650
  5. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  6. 2023Qwen Technical Reportcited by 3,273
  7. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  8. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  9. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
  10. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  11. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
  12. 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
38 more
  1. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  2. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
  3. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
  4. 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
  5. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
  6. 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 849
  7. 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
  8. 2018QT-Opt: Scalable Deep Reinforcement Learning for Vision-Based Robotic Manipulationcited by 730
  9. 2024PaliGemma: A versatile 3B VLM for transfercited by 679
  10. 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
  11. 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 634
  12. 2023LLaMA-Adapter V2: Parameter-Efficient Visual Instruction Modelcited by 602
  13. 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 573
  14. 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 564
  15. 2022BC-Z: Zero-Shot Task Generalization with Robotic Imitation Learningcited by 517
  16. 2023Learning Universal Policies via Text-Guided Video Generationcited by 506
  17. 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
  18. 2023Florence-2: Advancing a Unified Representation for a Variety of Vision Taskscited by 403
  19. 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 390
  20. 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 386
  21. 2024Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperationcited by 377
  22. 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulationcited by 331
  23. 2024Latent Action Pretraining from Videoscited by 302
  24. 2022Behavior Transformers: Cloning k modes with one stonecited by 299
  25. 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 290
  26. 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 285
  27. 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 279
  28. 2021Bridge Data: Boosting Generalization of Robotic Skills with Cross-Domain Datasetscited by 248
  29. 2022Real-World Robot Learning with Masked Visual Pre-trainingcited by 241
  30. 2023Affordances from Human Videos as a Versatile Representation for Roboticscited by 221
  31. 2022Interactive Language: Talking to Robots in Real Timecited by 217
  32. 2025Unified Video Action Modelcited by 195
  33. 2025MolmoAct: Action Reasoning Models that can Reason in Spacecited by 189
  34. 2025HybridVLA: Collaborative Diffusion and Autoregression in a Unified Vision-Language-Action Modelcited by 176
  35. 2023RoboAgent: Generalization and Efficiency in Robot Manipulation via Semantic Augmentations and Action Chunkingcited by 167
  36. 2024RoboMIND: Benchmark on Multi-embodiment Intelligence Normative Data for Robot Manipulationcited by 166
  37. 2024Behavior Generation with Latent Actionscited by 159
  38. 2021The Surprising Effectiveness of Representation Learning for Visual Imitationcited by 149

50 most cited of 90 All 90 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 13.

15 papers.

Sort:

By area:

  1. 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Modelcited by 104
  2. 2026TwinBrainVLA: Unleashing the Potential of Generalist VLMs for Embodied Tasks via Asymmetric Mixture-of-Transformerscited by 14
  3. 2026UniT: Toward a Unified Physical Language for Human-to-Humanoid Policy Learning and World Modelingcited by 9
  4. 2025An Anatomy of Vision-Language-Action Models: From Modules to Milestones and Challengescited by 4
  5. 2026MOTIF: Learning Action Motifs for Few-shot Cross-Embodiment Transfercited by 3
  6. 2026From Imagined Futures to Executable Actions: Mixture of Latent Actions for Robot Manipulationcited by 2
  7. 2026RoboGene: Boosting VLA Pre-training via Diversity-Driven Agentic Framework for Real-World Task Generationcited by 1
  8. 2026X-DiffVLA: X-Embodied Diffusion Action Heads for Vision-Language-Action Modelscited by 1
  9. 2026Translation as a Bridging Action: Transferring Manipulation Skills from Humans to Robotscited by 1
  10. 2026GeoProp: Grounding Robot State in Vision for Generalist Manipulationcited by 1
  11. 2025Freeze, Share, Shrink: Rethinking the Action Backbone in Diffusion Policiescited by 0
  12. 2026Robo-ValueRL: Reliable Value Estimation for Offline-to-Online Reinforcement Learningcited by 0
3 more
  1. 2026VistaVLA: Geometry- and Semantic-Aware 3D Gaussian-Grounded VLA for Robotic Manipulationcited by 0
  2. 2026Decoupling Intention from Trajectory: A Representational Deduction Framework for World Action Modelscited by 0
  3. 2026Self-Evolving Coding Agents: From Digital Programs to Physical-World Intelligencecited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Vision-Language-Action Models for Robotics: A Review Towards Real-World Applications
  2. 2026Beyond Data Scaling: Representation-Centric Continued Pre-training for Vision-Language-Action Models
  3. 2025VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Model
  4. 2025A Survey on Efficient Vision-Language-Action Models
  5. 2026Rethinking Visual-Language-Action Model Scaling: Alignment, Mixture, and Regularization
  6. 2026QuoVLA: Quotient Space for Vision-Language-Action Models
  7. 2026Two Bridges, One Pathway: From VLMs to Generalizable VLAs with Embodied Trajectory-Coupled Data
  8. 2026Vision-Language-Action in Robotics: A Survey of Datasets, Benchmarks, and Data Engines