METIS: Multi-Source Egocentric Training for Integrated Dexterous Vision-Language-Action Model
On the map: Vision-language-action models → Human-video and latent-action pretraining
Abstract (arXiv)
Building a generalist robot that can perceive, reason, and act across diverse tasks remains an open challenge, especially for dexterous manipulation. A major bottleneck lies in the scarcity of large-scale, action-annotated data for dexterous skills, as teleoperation is difficult and costly. Human data, with its vast scale and diverse manipulation behaviors, provides rich priors for learning robotic actions. While prior works have explored leveraging human demonstrations, they are often constrained by limited scenarios and a large visual gap between human and robots. To eliminate these limitations, we propose METIS, a vision-language-action (VLA) model for dexterous manipulation pretrained on multi-source egocentric datasets. We first construct EgoAtlas, which integrates large-scale human and robotic data from multiple sources, all unified under a consistent action space. We further extract motion-aware dynamics, a compact and discretized motion representation, which provides efficient and expressive supervision for VLA training. Built upon them, METIS integrates reasoning and acting into a unified framework, enabling effective deployment to downstream dexterous manipulation tasks. Our method demonstrates exceptional dexterous manipulation capabilities, achieving highest average success rate in six real-world tasks. Experimental results also highlight the superior generalization and robustness to out-of-distribution scenarios. These findings emphasize METIS as a promising step toward a generalist model for dexterous manipulation.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Human-video and latent-action pretraining, one of 13 directions in Vision-language-action models. Builds on 60 of its 66 references that are in the map. First posted on arXiv 21 Nov 2025.
Builds on
60 of 66 references.
Closest ancestors · 5
Same direction, newest first
- 2025Being-H0: Vision-Language-Action Pretraining from Large-Scale Human Videos21 Jul
- 2025EgoVLA: Learning Vision-Language-Action Models from Egocentric Human Videos16 Jul
- 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actions9 May
- 2024Latent Action Pretraining from Videos15 Oct
- 2024Bi-VLA: Vision-Language-Action Model-Based System for Bimanual Robotic Dexterous Manipulations9 May
Other references · 55
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2017Neural Discrete Representation Learningcited by 4,650
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 849
38 more
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
- 2022Autoregressive Image Generation using Residual Quantizationcited by 706
- 2016Temporal Convolutional Networks for Action Segmentation and Detectioncited by 504
- 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 390
- 2023An Embodied Generalist Agent in 3D Worldcited by 355
- 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 344
- 2024Prismatic VLMs: Investigating the Design Space of Visually-Conditioned Language Modelscited by 336
- 2022HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object Interactioncited by 321
- 2022ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulationcited by 306
- 2021H2O: Two Hands Manipulating Objects for First Person Interaction Recognitioncited by 251
- 2023Affordances from Human Videos as a Versatile Representation for Roboticscited by 221
- 2025DexVLA: Vision-Language Model with Plug-In Diffusion Expert for General Robot Controlcited by 191
- 2025EgoDex: Learning Dexterous Manipulation from Large-Scale Egocentric Videocited by 191
- 2025HybridVLA: Collaborative Diffusion and Autoregression in a Unified Vision-Language-Action Modelcited by 176
- 2024RoboMIND: Benchmark on Multi-embodiment Intelligence Normative Data for Robot Manipulationcited by 166
- 2023HoloAssist: an Egocentric Human Interaction Dataset for Interactive AI Assistants in the Real Worldcited by 159
- 2024DexCap: Scalable and Portable Mocap Data Collection System for Dexterous Manipulationcited by 149
- 2025Magma: A Foundation Model for Multimodal AI Agentscited by 138
- 2023AnyTeleop: A General Vision-Based Dexterous Robot Arm-Hand Teleoperation Systemcited by 136
- 2022OakInk: A Large-scale Knowledge Repository for Understanding Hand-Object Interactioncited by 129
- 2022DexGraspNet: A Large-Scale Robotic Dexterous Grasp Dataset for General Objects Based on Simulationcited by 129
- 2023UniDexGrasp: Universal Robotic Dexterous Grasping via Learning Diverse Proposal Generation and Goal-Conditioned Policycited by 117
- 2025OneTwoVLA: A Unified Vision-Language-Action Model with Adaptive Reasoningcited by 105
- 2022In-Hand Object Rotation via Rapid Motor Adaptationcited by 102
- 2023UniDexGrasp++: Improving Dexterous Grasping Policy Learning via Geometry-aware Curriculum and Iterative Generalist-Specialist Learningcited by 101
- 2025RoboBrain 2.0 Technical Reportcited by 87
- 2024General Flow as Foundation Affordance for Scalable Robot Learningcited by 80
- 2025Humanoid Policy ~ Human Policycited by 65
- 2024RAM: Retrieval-Based Affordance Transfer for Generalizable Zero-Shot Robotic Manipulationcited by 55
- 2025VTLA: Vision-Tactile-Language-Action Model with Preference Learning for Insertion Manipulationcited by 54
- 2025H-RDT: Human Manipulation Enhanced Bimanual Robotic Manipulationcited by 41
- 2023Ego-Only: Egocentric Action Detection without Exocentric Transferringcited by 30
- 2025DexterityGen: Foundation Controller for Unprecedented Dexteritycited by 26
- 2024Bimanual Dexterity for Complex Taskscited by 22
- 2025MotionTrans: Human VR Data Enable Motion-Level Learning for Robotic Manipulation Policiescited by 22
- 2022Goal-conditioned dual-action imitation learning for dexterous dual-arm robot manipulationcited by 21
- 2023Dextrous Tactile In-Hand Manipulation Using a Modular Reinforcement Learning Architecturecited by 17
50 most cited of 55 All 55 (JSON)
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026Being-H0.5: Scaling Human-Centric Robot Learning for Cross-Embodiment Generalizationcited by 61
- 2026LangForce: Bayesian Decomposition of Vision Language Action Models via Latent Action Queriescited by 24
- 2026UniT: Toward a Unified Physical Language for Human-to-Humanoid Policy Learning and World Modelingcited by 9
- 2026Motus2: A Self-Evolving General World Model for Dexterous Manipulationcited by 6
- 2026Data Pyramid for Embodied Manipulation: A Surveycited by 4
- 2026LABSHIELD: A Multimodal Benchmark for Safety-Critical Reasoning and Planning in Scientific Laboratoriescited by 3
- 2026DeCAL: Towards Physically-Grounded Dexterous Vision-Language-Action Models via Contact-Aware Latent Co-Imaginationcited by 0
- 2026GALA: Geometry-Aware Latent Action Modeling for Vision-Language-Action Model Pretraining across Embodimentscited by 0
- 2026UniWAM: Unified World-Action Modelcited by 0
- 2026UniWAM: Unified World-Action Model1 Oct 2026
- 2026GALA: Geometry-Aware Latent Action Modeling for Vision-Language-Action Model Pretraining across Embodiments18 Sep 2026
- 2026DeCAL: Towards Physically-Grounded Dexterous Vision-Language-Action Models via Contact-Aware Latent Co-Imagination8 Sep 2026
- 2026Motus2: A Self-Evolving General World Model for Dexterous Manipulation31 Aug 2026
- 2026Data Pyramid for Embodied Manipulation: A Survey27 Jul 2026
- 2026UniT: Toward a Unified Physical Language for Human-to-Humanoid Policy Learning and World Modeling21 Apr 2026
- 2026LABSHIELD: A Multimodal Benchmark for Safety-Critical Reasoning and Planning in Scientific Laboratories12 Mar 2026
- 2026LangForce: Bayesian Decomposition of Vision Language Action Models via Latent Action Queries21 Jan 2026
- 2026Being-H0.5: Scaling Human-Centric Robot Learning for Cross-Embodiment Generalization19 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2026Cross-Hand Latent Representation for Vision-Language-Action Models
- 2026DexHiL: A Human-in-the-Loop Framework for Vision-Language-Action Model Post-Training in Dexterous Manipulation
- 2026EgoScale: Scaling Dexterous Manipulation with Diverse Egocentric Human Data
- 2025Scalable Vision-Language-Action Model Pretraining for Robotic Manipulation with Real-Life Human Activity Videos
- 2026JoyAI-RA 0.5: Scaling Robot Manipulation Learning via Dual Action Alignment
- 2026IronMind: Scaling Humanoid Dexterous Manipulation via Camera-Space Ego-Centric Pretraining ↗
- 2026CometVLA: Co-Training on an Embodied Data Pyramid towards Physical Understanding
- 2026From Human Videos to Robot Manipulation: A Survey on Scalable Vision-Language-Action Learning with Human-Centric Data