LAP: Language-Action Pre-Training Enables Zero-shot Cross-Embodiment Transfer
On the map: Vision-language-action models → Human-video and latent-action pretraining
Abstract (arXiv)
A long-standing goal in robotics is a generalist policy that can be deployed zero-shot on new robot embodiments without per-embodiment adaptation. Despite large-scale multi-embodiment pre-training, existing Vision-Language-Action models (VLAs) remain tightly coupled to their training embodiments and typically require costly fine-tuning. We introduce Language-Action Pre-training (LAP), a simple recipe that represents low-level robot actions directly in natural language, aligning action supervision with the pre-trained vision-language model's input-output distribution. LAP requires no learned tokenizer, no costly annotation, and no embodiment-specific architectural design. Based on LAP, we present LAP-3B, which to the best of our knowledge is the first VLA to achieve substantial zero-shot transfer to previously unseen robot embodiments without any embodiment-specific fine-tuning. Across multiple novel robots and manipulation tasks, LAP-3B attains over 50% average zero-shot success, delivering roughly a 2x improvement over the strongest prior VLAs. We further show that LAP enables efficient adaptation and favorable scaling, while unifying action prediction and VQA in a shared language-action format that yields additional gains through co-training.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Placed in Human-video and latent-action pretraining, one of 13 directions in Vision-language-action models. Builds on 86 of its 98 references that are in the map. First posted on arXiv 11 Feb 2026.
Builds on
86 of 98 references.
Closest ancestors · 5
Same direction, newest first
- 2026Being-H0.5: Scaling Human-Centric Robot Learning for Cross-Embodiment Generalization19 Jan
- 2025Toward Embodiment Equivariant Vision-Language-Action Policy18 Sep
- 2025EgoVLA: Learning Vision-Language-Action Models from Egocentric Human Videos16 Jul
- 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actions9 May
- 2024Latent Action Pretraining from Videos15 Oct
Other references · 81
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,172
38 more
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
- 2024PaliGemma: A versatile 3B VLM for transfercited by 679
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
- 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 634
- 2022BC-Z: Zero-Shot Task Generalization with Robotic Imitation Learningcited by 517
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 440
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 411
- 2024Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robotscited by 373
- 2024ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulationcited by 305
- 2024TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policiescited by 298
- 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 285
- 2019RoboNet: Large-Scale Multi-Robot Learningcited by 268
- 2021Bridge Data: Boosting Generalization of Robotic Skills with Cross-Domain Datasetscited by 248
- 2020The EPIC-KITCHENS Dataset: Collection, Challenges and Baselinescited by 221
- 2023ViNT: A Foundation Model for Visual Navigationcited by 210
- 2024RT-H: Action Hierarchies Using Languagecited by 204
- 2025DexVLA: Vision-Language Model with Plug-In Diffusion Expert for General Robot Controlcited by 191
- 2025EgoDex: Learning Dexterous Manipulation from Large-Scale Egocentric Videocited by 191
- 2025MolmoAct: Action Reasoning Models that can Reason in Spacecited by 189
- 2023RH20T: A Comprehensive Robotic Dataset for Learning Diverse Skills in One-Shotcited by 173
- 2024RoboMIND: Benchmark on Multi-embodiment Intelligence Normative Data for Robot Manipulationcited by 166
- 2022GNM: A General Navigation Model to Drive Any Robotcited by 161
- 2023HoloAssist: an Egocentric Human Interaction Dataset for Interactive AI Assistants in the Real Worldcited by 159
- 2024Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Modelscited by 151
- 2024Scaling Proprioceptive-Visual Learning with Heterogeneous Pre-trained Transformerscited by 145
- 2024Data Scaling Laws in Imitation Learning for Robotic Manipulationcited by 144
- 2025Knowledge Insulating Vision-Language-Action Models: Train Fast, Run Fast, Generalize Bettercited by 142
- 2022VIOLA: Imitation Learning for Vision-Based Manipulation with Object Proposal Priorscited by 135
- 2023FurnitureBench: Reproducible Real-World Benchmark for Long-Horizon Complex Manipulationcited by 132
- 2024MOKA: Open-World Robotic Manipulation through Mark-Based Visual Promptingcited by 126
- 2024HOT3D: Hand and Object Tracking in 3D from Egocentric Multi-View Videoscited by 122
- 2020One Policy to Control Them All: Shared Modular Policies for Agent-Agnostic Controlcited by 114
- 2025ChatVLA: Unified Multimodal Understanding and Robot Control with Vision-Language-Action Modelcited by 112
- 2024Scaling Cross-Embodied Learning: One Policy for Manipulation, Navigation, Locomotion and Aviationcited by 108
- 2022Grounding Language with Visual Affordances over Unstructured Datacited by 101
50 most cited of 81 All 81 (JSON)
Built on by
Citing papers per year: 2026: 17.
17 papers.
Sort:
By area:
- 2026π0.7: a Steerable Generalist Robotic Foundation Model with Emergent Capabilitiescited by 127
- 2026MolmoAct2: Action Reasoning Models for Real-world Deploymentcited by 45
- 2026Flex-π: A Multi-Stream World-Action Model with Compute Flexibilitycited by 9
- 2026LA4VLA: Learning to Act without Seeing via Language-Action Pretrainingcited by 5
- 2026Revisiting Embodied Chain-of-Thought for Generalizable Robot Manipulationcited by 4
- 2026Generalizable VLA Finetuning via Representation Anchoring and Language-Action Alignmentcited by 4
- 2026Adapting Generalist Robot Policies with Semantic Reinforcement Learningcited by 3
- 2026VLAFlow: A Unified Training Framework for Vision-Language-Action Models via Co-training and Future Latent Alignmentcited by 2
- 2026StellaVLA: In-Context Structured Demonstration for Generalizable Vision-Language-Action Modelscited by 1
- 2026Learning to Act While Waiting: RL Finetuning of Generalist Robot Policies Under Inference Latencycited by 1
- 2026UniDexTok: A Unified Dexterous Hand Tokenizer from Real Datacited by 0
- 2026The Embodiment Gap in Robot Foundation Modelscited by 0
5 more
- 2026Fine-Tuning VLAs with Self-Demonstrated Generative Control for Multi-Task Manipulationcited by 0
- 2026CLAP: Cross-Embodiment Video World Models are Zero-Shot Physical Simulatorscited by 0
- 2026Intelligence Across Embodimentscited by 0
- 2026CrossSafe: Towards Cross-Embodiment Latent Safety Filterscited by 0
- 2026Rho: A Foundation for Efficiently Adaptable VLA Modelscited by 0
- 2026Rho: A Foundation for Efficiently Adaptable VLA Models29 Sep 2026
- 2026CrossSafe: Towards Cross-Embodiment Latent Safety Filters24 Sep 2026
- 2026Intelligence Across Embodiments22 Sep 2026
- 2026CLAP: Cross-Embodiment Video World Models are Zero-Shot Physical Simulators27 Aug 2026
- 2026Learning to Act While Waiting: RL Finetuning of Generalist Robot Policies Under Inference Latency24 Aug 2026
- 2026Fine-Tuning VLAs with Self-Demonstrated Generative Control for Multi-Task Manipulation19 Aug 2026
- 2026The Embodiment Gap in Robot Foundation Models19 Aug 2026
- 2026StellaVLA: In-Context Structured Demonstration for Generalizable Vision-Language-Action Models12 Aug 2026
- 2026Flex-π: A Multi-Stream World-Action Model with Compute Flexibility11 Aug 2026
- 2026Generalizable VLA Finetuning via Representation Anchoring and Language-Action Alignment15 Jul 2026
- 2026VLAFlow: A Unified Training Framework for Vision-Language-Action Models via Co-training and Future Latent Alignment2 Jul 2026
- 2026Adapting Generalist Robot Policies with Semantic Reinforcement Learning30 Jun 2026
5 more
- 2026LA4VLA: Learning to Act without Seeing via Language-Action Pretraining25 Jun 2026
- 2026UniDexTok: A Unified Dexterous Hand Tokenizer from Real Data9 Jun 2026
- 2026Revisiting Embodied Chain-of-Thought for Generalizable Robot Manipulation2 Jun 2026
- 2026MolmoAct2: Action Reasoning Models for Real-world Deployment4 May 2026
- 2026π0.7: a Steerable Generalist Robotic Foundation Model with Emergent Capabilities16 Apr 2026
- 2026LA4VLA: Learning to Act without Seeing via Language-Action Pretrainingcited by 5
- 2026Adapting Generalist Robot Policies with Semantic Reinforcement Learningcited by 3
- 2026VLAFlow: A Unified Training Framework for Vision-Language-Action Models via Co-training and Future Latent Alignmentcited by 2
- 2026StellaVLA: In-Context Structured Demonstration for Generalizable Vision-Language-Action Modelscited by 1
- 2026Learning to Act While Waiting: RL Finetuning of Generalist Robot Policies Under Inference Latencycited by 1
- 2026The Embodiment Gap in Robot Foundation Modelscited by 0
- 2026Fine-Tuning VLAs with Self-Demonstrated Generative Control for Multi-Task Manipulationcited by 0
- 2026CrossSafe: Towards Cross-Embodiment Latent Safety Filterscited by 0
- 2026Rho: A Foundation for Efficiently Adaptable VLA Modelscited by 0
- 2026Rho: A Foundation for Efficiently Adaptable VLA Models29 Sep 2026
- 2026CrossSafe: Towards Cross-Embodiment Latent Safety Filters24 Sep 2026
- 2026Learning to Act While Waiting: RL Finetuning of Generalist Robot Policies Under Inference Latency24 Aug 2026
- 2026Fine-Tuning VLAs with Self-Demonstrated Generative Control for Multi-Task Manipulation19 Aug 2026
- 2026The Embodiment Gap in Robot Foundation Models19 Aug 2026
- 2026StellaVLA: In-Context Structured Demonstration for Generalizable Vision-Language-Action Models12 Aug 2026
- 2026VLAFlow: A Unified Training Framework for Vision-Language-Action Models via Co-training and Future Latent Alignment2 Jul 2026
- 2026Adapting Generalist Robot Policies with Semantic Reinforcement Learning30 Jun 2026
- 2026LA4VLA: Learning to Act without Seeing via Language-Action Pretraining25 Jun 2026
- 2026π0.7: a Steerable Generalist Robotic Foundation Model with Emergent Capabilitiescited by 127
- 2026UniDexTok: A Unified Dexterous Hand Tokenizer from Real Datacited by 0
- 2026Intelligence Across Embodimentscited by 0
- 2026Intelligence Across Embodiments22 Sep 2026
- 2026UniDexTok: A Unified Dexterous Hand Tokenizer from Real Data9 Jun 2026
- 2026π0.7: a Steerable Generalist Robotic Foundation Model with Emergent Capabilities16 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026ZETA: A Controlled Study of Zero-Shot Cross-Embodiment VLA Transfer for Tabletop Manipulation
- 2025Embodiment Transfer Learning for Vision-Language-Action Models
- 2025Emergence of Human to Robot Transfer in Vision-Language-Action Models
- 2026Decoupling Vision, Language, and Action for Efficient Multi-Task Robot Policies
- 2026Learning to Move Before Learning to Do: Task-Agnostic pretraining for VLAs
- 2026Learning Action Priors for Cross-embodiment Robot Manipulation
- 2023Bridging Language and Action: A Survey of Language-Conditioned Robot Manipulation
- 2024ZeroCAP: Zero-Shot Multi-Robot Context Aware Pattern Formation via Large Language Models