mlsanityData to 7 Oct 2026

Cross-Hand Latent Representation for Vision-Language-Action Models

arXiv 2603.10158 ↗First posted 10 Mar 2026cs.ROcited by 5

On the map: Vision-language-action models → Human-video and latent-action pretraining

Abstract (arXiv)

Dexterous manipulation is essential for real-world robot autonomy, mirroring the central role of human hand coordination in daily activity. Humans rely on rich multimodal perception--vision, sound, and language-guided intent--to perform dexterous actions, motivating vision-based, language-conditioned manipulation systems for robots. However, training reliable vision-language-action (VLA) models for dexterous manipulation requires large-scale demonstrations across many robotic hands. In addition, as new dexterous embodiments appear rapidly, collecting data for each becomes costly and impractical, creating a need for scalable cross-embodiment learning. We introduce XL-VLA, a vision-language-action framework integrated with a unified latent action space shared across diverse dexterous hands. This embodiment-invariant latent space is directly pluggable into standard VLA architectures, enabling seamless cross-embodiment training and efficient reuse of both existing and newly collected data. Experimental results demonstrate that XL-VLA consistently outperforms baseline VLA models operating in raw joint spaces, establishing it as an effective solution for scalable cross-embodiment dexterous manipulation.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Human-video and latent-action pretraining, one of 13 directions in Vision-language-action models. Builds on 66 of its 70 references that are in the map. First posted on arXiv 10 Mar 2026.

Builds on

66 of 70 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Scalable Vision-Language-Action Model Pretraining for Robotic Manipulation with Real-Life Human Activity Videos24 Oct
  2. 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actions9 May

Other references · 64

  1. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  2. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  3. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  4. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
  5. 2024PaliGemma: A versatile 3B VLM for transfercited by 679
  6. 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulationcited by 331
  7. 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 285
  8. 2025DexVLA: Vision-Language Model with Plug-In Diffusion Expert for General Robot Controlcited by 191
  9. 2024Scaling Cross-Embodied Learning: One Policy for Manipulation, Navigation, Locomotion and Aviationcited by 108
  10. 2021XIRL: Cross-embodiment Inverse Reinforcement Learningcited by 101
  11. 2025ForceVLA: Enhancing VLA Models with a Force-aware MoE for Contact-rich Manipulationcited by 87
  12. 2025Universal Actions for Enhanced Embodied Foundation Modelscited by 80
38 more
  1. 2025Dita: Scaling Diffusion Transformer for Generalist Vision-Language-Action Policycited by 73
  2. 2024Bunny-VisionPro: Real-Time Bimanual Dexterous Teleoperation for Imitation Learningcited by 69
  3. 2025HOMIE: Humanoid Loco-Manipulation with Isomorphic Exoskeleton Cockpitcited by 65
  4. 2025DexUMI: Using Human Hand as the Universal Manipulation Interface for Dexterous Manipulationcited by 58
  5. 2025Motion Tracks: A Unified Representation for Human-Robot Transfer in Few-Shot Imitation Learningcited by 57
  6. 2023Diffusion Reward: Learning Rewards via Conditional Video Diffusioncited by 56
  7. 2025CEED-VLA: Consistency Vision-Language-Action Model with Early-Exit Decodingcited by 38
  8. 2025CoMo: Learning Continuous Latent Motion from Internet Videos for Scalable Robot Learningcited by 37
  9. 20253DFlowAction: Learning Cross-Embodiment Manipulation from 3D Flow World Modelcited by 36
  10. 2025UniSkill: Imitating Human Videos via Cross-Embodiment Skill Representationscited by 30
  11. 2025DexMachina: Functional Retargeting for Bimanual Dexterous Manipulationcited by 30
  12. 2025Digital Twin Catalog: A Large-Scale Photorealistic 3D Object Digital Twin Datasetcited by 29
  13. 2025EgoBridge: Domain Adaptation for Generalizable Imitation from Egocentric Human Datacited by 27
  14. 2025X-Sim: Cross-Embodiment Learning via Real-to-Sim-to-Realcited by 25
  15. 2024Robots Pre-train Robots: Manipulation-Centric Robotic Representation from Large-Scale Robot Datasetscited by 23
  16. 2025Latent Action Diffusion for Cross-Embodiment Manipulationcited by 20
  17. 2024LEGATO: Cross-Embodiment Imitation Using a Grasping Toolcited by 18
  18. 2025Align-Then-stEer: Adapting the Vision-Language Action Models through Unified Latent Guidancecited by 18
  19. 2024Cross-Embodiment Robot Manipulation Skill Transfer using Latent Space Alignmentcited by 17
  20. 2025GSWorld: Closed-Loop Photo-Realistic Simulation Suite for Robotic Manipulationcited by 16
  21. 2024The One RING: a Robotic Indoor Navigation Generalistcited by 15
  22. 2025DEXOP: A Device for Robotic Transfer of Dexterous Human Manipulationcited by 15
  23. 2025Geometric Retargeting: A Principled, Ultrafast Neural Hand Retargeting Algorithmcited by 12
  24. 2024Kinematic Motion Retargeting for Contact-Rich Anthropomorphic Manipulationscited by 9
  25. 2025Dexterous Teleoperation of 20-DoF ByteDexter Hand via Human Motion Retargetingcited by 9
  26. 2025Dexplore: Scalable Neural Control for Dexterous Manipulation from Reference-Scoped Explorationcited by 9
  27. 2025CEDex: Cross-Embodiment Dexterous Grasp Generation at Scale from Human-like Contact Representationscited by 9
  28. 2025Human2LocoMan: Learning Versatile Quadrupedal Manipulation with Human Pretrainingcited by 8
  29. 2025DexNDM: Closing the Reality Gap for Dexterous In-Hand Rotation via Joint-Wise Neural Dynamics Modelcited by 8
  30. 2025T(R,O) Grasp: Efficient Graph Diffusion of Robot-Object Spatial Transformation for Cross-Embodiment Dexterous Graspingcited by 6
  31. 2025VAMOS: A Hierarchical Vision-Language-Action Model for Capability-Modulated and Steerable Navigationcited by 6
  32. 2025Multi-Loco: Unifying Multi-Embodiment Legged Locomotion via Reinforcement Learning Augmented Diffusioncited by 5
  33. 2025OmniDexGrasp: Generalizable Dexterous Grasping via Foundation Model and Force Feedbackcited by 4
  34. 2025Multi-Embodiment Robotic Retargeting via Guided Diffusion Modelcited by 3
  35. 2025Analyzing Key Objectives in Human-to-Robot Retargeting for Dexterous Manipulationcited by 3
  36. 2025TypeTele: Releasing Dexterity in Teleoperation by Dexterous Manipulation Typescited by 3
  37. 2025Tenma: Robust Cross-Embodiment Robot Manipulation with Diffusion Transformercited by 3
  38. 2026Contact-Aware Neural Dynamicscited by 3

50 most cited of 64 All 64 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Towards High-DoF Dexterous Manipulation through VLA Post-Training ↗
  2. 2026Joint-Aligned Latent Action: Towards Scalable VLA Pretraining in the Wild
  3. 2025METIS: Multi-Source Egocentric Training for Integrated Dexterous Vision-Language-Action Model
  4. 2026InDex: Empowering VLA Models with Intent-Conditioned Arm-Hand Coordination for Dexterous Manipulation
  5. 2026Learning Action Priors for Cross-embodiment Robot Manipulation
  6. 2026SG-VLA: Learning Spatially-Grounded Vision-Language-Action Models for Mobile Manipulation
  7. 2025villa-X: Enhancing Latent Action Modeling in Vision-Language-Action Models
  8. 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Survey