ZETA: A Controlled Study of Zero-Shot Cross-Embodiment VLA Transfer for Tabletop Manipulation
On the map: Vision-language-action models → Human-video and latent-action pretraining
Abstract (arXiv)
Zero-shot generalization to unseen embodiments is important for generalizable vision-language-action (VLA) models as robot hardware evolves and task-specific data collection remains costly. However, a systematic understanding of this problem remains limited, in part because the literature lacks a unified zero-shot transfer definition and controlled evaluation settings that isolate embodiment changes from differences in tasks, scenes, or protocols. To address this gap, we first distinguish strict zero-shot transfer, where the target embodiment is absent from all training data, from pretrain-exposed zero-shot transfer, where it appears only during pretraining. We then introduce a controlled benchmark spanning 14 held-out target embodiments across simulation and real-world validation. Within this framework, we conduct a controlled analysis of four factors: state-action representations, pretraining embodiment diversity, auxiliary co-training objectives, and target-embodiment exposure. Experimental results show that local end-effector (EEF) state-action representations, the source embodiment diversity, and auxiliary co-training improve cross-embodiment transfer by around 15, 18, and 7 percentage points, respectively. We further find that adding only 5% target-embodiment data during pretraining improves average target-embodiment progress by 13.4 percentage points, showing that strict and pretrain-exposed zero-shot transfer are distinct and should be reported separately. Together, these findings provide practical guidance for evaluating and improving cross-embodiment VLA transfer in stationary tabletop manipulation with two-finger grippers, while motivating future investigation of broader settings including mobile-base control, dexterous hands, and long-horizon tasks.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Human-video and latent-action pretraining, one of 13 directions in Vision-language-action models. Builds on 55 of its 62 references that are in the map. First posted on arXiv 2 Sep 2026.
Builds on
55 of 62 references.
Closest ancestors · 9
Same direction, newest first
- 2026Cloak: Zero-Shot Cross-Embodiment Manipulation by Masking the End-Effector from the VLA22 Jun
- 2026Cross-Hand Latent Representation for Vision-Language-Action Models10 Mar
- 2026MOTIF: Learning Action Motifs for Few-shot Cross-Embodiment Transfer14 Feb
- 2026A Systematic Study of Data Modalities and Strategies for Co-training Large Behavior Models for Robot Manipulation1 Feb
- 2026Being-H0.5: Scaling Human-Centric Robot Learning for Cross-Embodiment Generalization19 Jan
- 2025EgoVLA: Learning Vision-Language-Action Models from Egocentric Human Videos16 Jul
- 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actions9 May
- 2025GraspVLA: a Grasping Foundation Model Pre-trained on Billion-scale Synthetic Action Data6 May
- 2024Latent Action Pretraining from Videos15 Oct
Other references · 46
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 440
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 411
- 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 353
- 2024Robotic Control via Embodied Chain-of-Thought Reasoningcited by 340
34 more
- 2024TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policiescited by 298
- 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 285
- 2025DexVLA: Vision-Language Model with Plug-In Diffusion Expert for General Robot Controlcited by 191
- 2023RH20T: A Comprehensive Robotic Dataset for Learning Diverse Skills in One-Shotcited by 173
- 2024RoboMIND: Benchmark on Multi-embodiment Intelligence Normative Data for Robot Manipulationcited by 166
- 2024Scaling Proprioceptive-Visual Learning with Heterogeneous Pre-trained Transformerscited by 145
- 2026π0.7: a Steerable Generalist Robotic Foundation Model with Emergent Capabilitiescited by 127
- 2024Scaling Cross-Embodied Learning: One Policy for Manipulation, Navigation, Locomotion and Aviationcited by 108
- 2025OneTwoVLA: A Unified Vision-Language-Action Model with Adaptive Reasoningcited by 105
- 2025InternVLA-M1: A Spatially Guided Vision-Language-Action Framework for Generalist Robot Policycited by 83
- 2025Universal Actions for Enhanced Embodied Foundation Modelscited by 80
- 2025Phantom: Training Robots Without Robots Using Only Human Videoscited by 64
- 2024Pushing the Limits of Cross-Embodiment Learning for Manipulation and Navigationcited by 60
- 2025Motion Tracks: A Unified Representation for Human-Robot Transfer in Few-Shot Imitation Learningcited by 57
- 2025Sim-and-Real Co-Training: A Simple Recipe for Vision-Based Robotic Manipulationcited by 42
- 2024Mirage: Cross-Embodiment Zero-Shot Policy Transfer with Cross-Paintingcited by 35
- 2024One Policy to Run Them All: an End-to-end Learning Approach to Multi-Embodiment Locomotioncited by 34
- 2025UniSkill: Imitating Human Videos via Cross-Embodiment Skill Representationscited by 30
- 2025EO-1: An Open Unified Embodied Foundation Model for General Robot Controlcited by 30
- 2026RDT2: Exploring the Scaling Limit of UMI Data Towards Zero-Shot Cross-Embodiment Generalizationcited by 29
- 2024Cross-Embodiment Dexterous Grasping with Reinforcement Learningcited by 24
- 2025Latent Action Diffusion for Cross-Embodiment Manipulationcited by 20
- 2025Is Diversity All You Need for Scalable Robotic Manipulation?cited by 19
- 2024LEGATO: Cross-Embodiment Imitation Using a Grasping Toolcited by 18
- 2025Align-Then-stEer: Adapting the Vision-Language Action Models through Unified Latent Guidancecited by 18
- 2024Cross-Embodiment Robot Manipulation Skill Transfer using Latent Space Alignmentcited by 17
- 2025Do You Need Proprioceptive States in Visuomotor Policies?cited by 16
- 2025Shadow: Leveraging Segmentation Masks for Cross-Embodiment Policy Transfercited by 13
- 2026Genie Sim 3.0 : A High-Fidelity Comprehensive Simulation Platform for Humanoid Robotcited by 13
- 2026One-Policy-Fits-All: Geometry-Aware Action Latents for Cross-Embodiment Manipulationcited by 5
- 2025AnyBody: A Benchmark Suite for Cross-Embodiment Manipulationcited by 4
- 2026CEI: A Unified Interface for Cross-Embodiment Visuomotor Policy Learning in 3D Spacecited by 3
- 2026Learning a Unified Latent Space for Cross-Embodiment Robot Controlcited by 2
- 2026Learning Adaptive Cross-Embodiment Visuomotor Policy with Contrastive Prompt Orchestrationcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026LAP: Language-Action Pre-Training Enables Zero-shot Cross-Embodiment Transfer
- 2026Towards Zero-Shot Transfer Across Embodiments For Driving VLAs
- 2025Embodiment Transfer Learning for Vision-Language-Action Models
- 2025Exploring the Limits of Vision-Language-Action Manipulations in Cross-task Generalization
- 2025Goal-VLA: Image-Generative VLMs as Object-Centric World Models Empowering Zero-shot Robot Manipulation
- 2026DyPES-VLA: Learning Shared Dynamics Priors and Embodiment-Specific Control for Cross-Embodiment Manipulation
- 2026Cross-Embodiment Transfer via Behavior-Aligned Representations
- 2026Training Vision-Language-Action Models with Dense Embodied Chain-of-Thought Supervision