Cross-Hand Latent Representation for Vision-Language-Action Models
On the map: Vision-language-action models → Human-video and latent-action pretraining
Abstract (arXiv)
Dexterous manipulation is essential for real-world robot autonomy, mirroring the central role of human hand coordination in daily activity. Humans rely on rich multimodal perception--vision, sound, and language-guided intent--to perform dexterous actions, motivating vision-based, language-conditioned manipulation systems for robots. However, training reliable vision-language-action (VLA) models for dexterous manipulation requires large-scale demonstrations across many robotic hands. In addition, as new dexterous embodiments appear rapidly, collecting data for each becomes costly and impractical, creating a need for scalable cross-embodiment learning. We introduce XL-VLA, a vision-language-action framework integrated with a unified latent action space shared across diverse dexterous hands. This embodiment-invariant latent space is directly pluggable into standard VLA architectures, enabling seamless cross-embodiment training and efficient reuse of both existing and newly collected data. Experimental results demonstrate that XL-VLA consistently outperforms baseline VLA models operating in raw joint spaces, establishing it as an effective solution for scalable cross-embodiment dexterous manipulation.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Human-video and latent-action pretraining, one of 13 directions in Vision-language-action models. Builds on 66 of its 70 references that are in the map. First posted on arXiv 10 Mar 2026.
Builds on
66 of 70 references.
Closest ancestors · 2
Same direction, newest first
- 2025Scalable Vision-Language-Action Model Pretraining for Robotic Manipulation with Real-Life Human Activity Videos24 Oct
- 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actions9 May
Other references · 64
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
- 2024PaliGemma: A versatile 3B VLM for transfercited by 679
- 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulationcited by 331
- 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 285
- 2025DexVLA: Vision-Language Model with Plug-In Diffusion Expert for General Robot Controlcited by 191
- 2024Scaling Cross-Embodied Learning: One Policy for Manipulation, Navigation, Locomotion and Aviationcited by 108
- 2021XIRL: Cross-embodiment Inverse Reinforcement Learningcited by 101
- 2025ForceVLA: Enhancing VLA Models with a Force-aware MoE for Contact-rich Manipulationcited by 87
- 2025Universal Actions for Enhanced Embodied Foundation Modelscited by 80
38 more
- 2025Dita: Scaling Diffusion Transformer for Generalist Vision-Language-Action Policycited by 73
- 2024Bunny-VisionPro: Real-Time Bimanual Dexterous Teleoperation for Imitation Learningcited by 69
- 2025HOMIE: Humanoid Loco-Manipulation with Isomorphic Exoskeleton Cockpitcited by 65
- 2025DexUMI: Using Human Hand as the Universal Manipulation Interface for Dexterous Manipulationcited by 58
- 2025Motion Tracks: A Unified Representation for Human-Robot Transfer in Few-Shot Imitation Learningcited by 57
- 2023Diffusion Reward: Learning Rewards via Conditional Video Diffusioncited by 56
- 2025CEED-VLA: Consistency Vision-Language-Action Model with Early-Exit Decodingcited by 38
- 2025CoMo: Learning Continuous Latent Motion from Internet Videos for Scalable Robot Learningcited by 37
- 20253DFlowAction: Learning Cross-Embodiment Manipulation from 3D Flow World Modelcited by 36
- 2025UniSkill: Imitating Human Videos via Cross-Embodiment Skill Representationscited by 30
- 2025DexMachina: Functional Retargeting for Bimanual Dexterous Manipulationcited by 30
- 2025Digital Twin Catalog: A Large-Scale Photorealistic 3D Object Digital Twin Datasetcited by 29
- 2025EgoBridge: Domain Adaptation for Generalizable Imitation from Egocentric Human Datacited by 27
- 2025X-Sim: Cross-Embodiment Learning via Real-to-Sim-to-Realcited by 25
- 2024Robots Pre-train Robots: Manipulation-Centric Robotic Representation from Large-Scale Robot Datasetscited by 23
- 2025Latent Action Diffusion for Cross-Embodiment Manipulationcited by 20
- 2024LEGATO: Cross-Embodiment Imitation Using a Grasping Toolcited by 18
- 2025Align-Then-stEer: Adapting the Vision-Language Action Models through Unified Latent Guidancecited by 18
- 2024Cross-Embodiment Robot Manipulation Skill Transfer using Latent Space Alignmentcited by 17
- 2025GSWorld: Closed-Loop Photo-Realistic Simulation Suite for Robotic Manipulationcited by 16
- 2024The One RING: a Robotic Indoor Navigation Generalistcited by 15
- 2025DEXOP: A Device for Robotic Transfer of Dexterous Human Manipulationcited by 15
- 2025Geometric Retargeting: A Principled, Ultrafast Neural Hand Retargeting Algorithmcited by 12
- 2024Kinematic Motion Retargeting for Contact-Rich Anthropomorphic Manipulationscited by 9
- 2025Dexterous Teleoperation of 20-DoF ByteDexter Hand via Human Motion Retargetingcited by 9
- 2025Dexplore: Scalable Neural Control for Dexterous Manipulation from Reference-Scoped Explorationcited by 9
- 2025CEDex: Cross-Embodiment Dexterous Grasp Generation at Scale from Human-like Contact Representationscited by 9
- 2025Human2LocoMan: Learning Versatile Quadrupedal Manipulation with Human Pretrainingcited by 8
- 2025DexNDM: Closing the Reality Gap for Dexterous In-Hand Rotation via Joint-Wise Neural Dynamics Modelcited by 8
- 2025T(R,O) Grasp: Efficient Graph Diffusion of Robot-Object Spatial Transformation for Cross-Embodiment Dexterous Graspingcited by 6
- 2025VAMOS: A Hierarchical Vision-Language-Action Model for Capability-Modulated and Steerable Navigationcited by 6
- 2025Multi-Loco: Unifying Multi-Embodiment Legged Locomotion via Reinforcement Learning Augmented Diffusioncited by 5
- 2025OmniDexGrasp: Generalizable Dexterous Grasping via Foundation Model and Force Feedbackcited by 4
- 2025Multi-Embodiment Robotic Retargeting via Guided Diffusion Modelcited by 3
- 2025Analyzing Key Objectives in Human-to-Robot Retargeting for Dexterous Manipulationcited by 3
- 2025TypeTele: Releasing Dexterity in Teleoperation by Dexterous Manipulation Typescited by 3
- 2025Tenma: Robust Cross-Embodiment Robot Manipulation with Diffusion Transformercited by 3
- 2026Contact-Aware Neural Dynamicscited by 3
50 most cited of 64 All 64 (JSON)
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026UniSteer: Unified Noise Steering for Efficient Human-Guided VLA Adaptationcited by 5
- 2026FACT: Failure-Aware Causal Training for World-Action Modelscited by 3
- 2026UniDexTok: A Unified Dexterous Hand Tokenizer from Real Datacited by 0
- 2026ZETA: A Controlled Study of Zero-Shot Cross-Embodiment VLA Transfer for Tabletop Manipulationcited by 0
- 2026GALA: Geometry-Aware Latent Action Modeling for Vision-Language-Action Model Pretraining across Embodimentscited by 0
- 2026GALA: Geometry-Aware Latent Action Modeling for Vision-Language-Action Model Pretraining across Embodiments18 Sep 2026
- 2026ZETA: A Controlled Study of Zero-Shot Cross-Embodiment VLA Transfer for Tabletop Manipulation2 Sep 2026
- 2026FACT: Failure-Aware Causal Training for World-Action Models10 Aug 2026
- 2026UniDexTok: A Unified Dexterous Hand Tokenizer from Real Data9 Jun 2026
- 2026UniSteer: Unified Noise Steering for Efficient Human-Guided VLA Adaptation11 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026Towards High-DoF Dexterous Manipulation through VLA Post-Training ↗
- 2026Joint-Aligned Latent Action: Towards Scalable VLA Pretraining in the Wild
- 2025METIS: Multi-Source Egocentric Training for Integrated Dexterous Vision-Language-Action Model
- 2026InDex: Empowering VLA Models with Intent-Conditioned Arm-Hand Coordination for Dexterous Manipulation
- 2026Learning Action Priors for Cross-embodiment Robot Manipulation
- 2026SG-VLA: Learning Spatially-Grounded Vision-Language-Action Models for Mobile Manipulation
- 2025villa-X: Enhancing Latent Action Modeling in Vision-Language-Action Models
- 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Survey