MiVLA: Towards Generalizable Vision-Language-Action Model with Human-Robot Mutual Imitation Pre-training
On the map: Vision-language-action models → Human-video and latent-action pretraining
Abstract (arXiv)
While leveraging abundant human videos and simulated robot data poses a scalable solution to the scarcity of real-world robot data, the generalization capability of existing vision-language-action models (VLAs) remains limited by mismatches in camera views, visual appearance, and embodiment morphologies. To overcome this limitation, we propose MiVLA, a generalizable VLA empowered by human-robot mutual imitation pre-training, which leverages inherent behavioral similarity between human hands and robotic arms to build a foundation of strong behavioral priors for both human actions and robotic control. Specifically, our method utilizes kinematic rules with left/right hand coordinate systems for bidirectional alignment between human and robot action spaces. Given human or simulated robot demonstrations, MiVLA is trained to forecast behavior trajectories for one embodiment, and imitate behaviors for another one unseen in the demonstration. Based on this mutual imitation, it integrates the behavioral fidelity of real-world human data with the manipulative diversity of simulated robot data into a unified model, thereby enhancing the generalization capability for downstream tasks. Extensive experiments conducted on both simulation and real-world platforms with three robots (ARX, PiPer and LocoMan), demonstrate that MiVLA achieves strong improved generalization capability, outperforming state-of-the-art VLAs (e.g., boldsymbolπ0, boldsymbolπ0.5 and H-RDT) by 25% in simulation, and 14% in real-world robot control tasks.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Human-video and latent-action pretraining, one of 13 directions in Vision-language-action models. Builds on 31 of its 33 references that are in the map. First posted on arXiv 17 Dec 2025.
Builds on
31 of 33 references.
Closest ancestors · 1
Same direction, newest first
Other references · 30
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
18 more
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 477
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 440
- 2024PaliGemma 2: A Family of Versatile VLMs for Transfercited by 204
- 2021ManiSkill: Generalizable Manipulation Skill Benchmark with Large-Scale Demonstrationscited by 193
- 2025DexVLA: Vision-Language Model with Plug-In Diffusion Expert for General Robot Controlcited by 191
- 2025EgoDex: Learning Dexterous Manipulation from Large-Scale Egocentric Videocited by 191
- 2024HumanPlus: Humanoid Shadowing and Imitation from Humanscited by 164
- 2024Precise and Dexterous Robotic Manipulation via Human-in-the-Loop Reinforcement Learningcited by 153
- 2024RoboSpatial: Teaching Spatial Understanding to 2D and 3D Vision-Language Models for Roboticscited by 133
- 2025RoboTwin: Dual-Arm Robot Benchmark with Generative Digital Twinscited by 117
- 2025H-RDT: Human Manipulation Enhanced Bimanual Robotic Manipulationcited by 41
- 2024Mitigating the Human-Robot Domain Discrepancy in Visual Pre-training for Robotic Manipulationcited by 22
- 2025ImMimic: Cross-Domain Imitation from Human Videos via Mapping and Interpolationcited by 19
- 2024RoboPEPP: Vision-Based Robot Pose and Joint Angle Estimation through Embedding Predictive Pre-Trainingcited by 10
- 2025Human2LocoMan: Learning Versatile Quadrupedal Manipulation with Human Pretrainingcited by 8
- 2025Scale-Aware Pre-Training for Human-Centric Visual Perception: Enabling Lightweight and Generalizable Modelscited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Emergence of Human to Robot Transfer in Vision-Language-Action Models
- 2025From Intention to Execution: Probing the Generalization Boundaries of Vision-Language-Action Models
- 2026Generalizable VLA Finetuning via Representation Anchoring and Language-Action Alignment
- 2026Joint-Aligned Latent Action: Towards Scalable VLA Pretraining in the Wild
- 2026HARP-VLA: Human-Robot Aligned Representation Learning for Vision-Language-Action Model
- 2024OpenVLA: An Open-Source Vision-Language-Action Model
- 2025Enhancing Generalization in Vision-Language-Action Models by Preserving Pretrained Representations
- 2026Beyond Data Scaling: Representation-Centric Continued Pre-training for Vision-Language-Action Models