MOTIF: Learning Action Motifs for Few-shot Cross-Embodiment Transfer
On the map: Vision-language-action models → Human-video and latent-action pretraining
Abstract (arXiv)
While vision-language-action (VLA) models have advanced generalist robotic learning, cross-embodiment transfer remains challenging due to kinematic heterogeneity and the high cost of collecting sufficient real-world demonstrations to support fine-tuning. Existing cross-embodiment policies typically rely on shared-private architectures, which suffer from limited capacity of private parameters and lack explicit adaptation mechanisms. To address these limitations, we introduce MOTIF for efficient few-shot cross-embodiment transfer that decouples embodiment-agnostic spatiotemporal patterns, termed action motifs, from heterogeneous action data. Specifically, MOTIF first learns unified motifs via vector quantization with progress-aware alignment and embodiment adversarial constraints to ensure temporal and cross-embodiment consistency. We then design a lightweight predictor that predicts these motifs from real-time inputs to guide a flow-matching policy, fusing them with robot-specific states to enable action generation on new embodiments. Evaluations across both simulation and real-world environments validate the superiority of MOTIF, which significantly outperforms strong baselines in few-shot transfer scenarios by 6.5% in simulation and 43.7% in real-world settings. Code is available at https://github.com/buduz/MOTIF.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Human-video and latent-action pretraining, one of 13 directions in Vision-language-action models. Builds on 38 of its 40 references that are in the map. First posted on arXiv 14 Feb 2026.
Builds on
38 of 40 references.
Closest ancestors · 1
Same direction, newest first
Other references · 37
- 2023GPT-4 Technical Reportcited by 18,132
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2023Visual Instruction Tuningcited by 7,792
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2017Neural Discrete Representation Learningcited by 4,650
- 2015Domain-Adversarial Training of Neural Networkscited by 3,023
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
25 more
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2014Unsupervised Domain Adaptation by Backpropagationcited by 1,906
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2021Perceiver: General Perception with Iterative Attentioncited by 1,089
- 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 849
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
- 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 390
- 2023A Survey on Multimodal Large Language Models for Autonomous Drivingcited by 288
- 2024ManiSkill3: GPU Parallelized Robotics Simulation and Rendering for Generalizable Embodied AIcited by 216
- 2021ManiSkill: Generalizable Manipulation Skill Benchmark with Large-Scale Demonstrationscited by 193
- 2024Behavior Generation with Latent Actionscited by 159
- 2024Scaling Proprioceptive-Visual Learning with Heterogeneous Pre-trained Transformerscited by 145
- 2024Multimodal Diffusion Transformer: Learning Versatile Behavior from Multimodal Goalscited by 131
- 2024Scaling Cross-Embodied Learning: One Policy for Manipulation, Navigation, Locomotion and Aviationcited by 108
- 2025A Survey on Vision-Language-Action Models: An Action Tokenization Perspectivecited by 96
- 2024Large Language Models for Robotics: Opportunities, Challenges, and Perspectivescited by 88
- 2025Vision-Language-Action Models for Robotics: A Review Towards Real-World Applicationscited by 82
- 2025Universal Actions for Enhanced Embodied Foundation Modelscited by 80
- 2024QueST: Self-Supervised Skill Abstractions for Learning Continuous Controlcited by 51
- 2025VITA: Vision-to-Action Flow Matching Policycited by 23
- 2024Cross-Embodiment Robot Manipulation Skill Transfer using Latent Space Alignmentcited by 17
- 2025XR-1: Towards Versatile Vision-Language-Action Models via Learning Unified Vision-Motion Representationscited by 15
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Cross-Embodiment Transfer via Behavior-Aligned Representations
- 2026Learning Action Priors for Cross-embodiment Robot Manipulation
- 2025Toward Embodiment Equivariant Vision-Language-Action Policy
- 2026X-DiffVLA: X-Embodied Diffusion Action Heads for Vision-Language-Action Models
- 2026DyPES-VLA: Learning Shared Dynamics Priors and Embodiment-Specific Control for Cross-Embodiment Manipulation
- 2025Embodiment Transfer Learning for Vision-Language-Action Models
- 2026CLAP: Cross-Embodiment Video World Models are Zero-Shot Physical Simulators
- 2026LAP: Language-Action Pre-Training Enables Zero-shot Cross-Embodiment Transfer