mlsanityData to 7 Oct 2026

METIS: Multi-Source Egocentric Training for Integrated Dexterous Vision-Language-Action Model

arXiv 2511.17366 ↗First posted 21 Nov 2025cs.RO cs.CVcited by 9

On the map: Vision-language-action models → Human-video and latent-action pretraining

Abstract (arXiv)

Building a generalist robot that can perceive, reason, and act across diverse tasks remains an open challenge, especially for dexterous manipulation. A major bottleneck lies in the scarcity of large-scale, action-annotated data for dexterous skills, as teleoperation is difficult and costly. Human data, with its vast scale and diverse manipulation behaviors, provides rich priors for learning robotic actions. While prior works have explored leveraging human demonstrations, they are often constrained by limited scenarios and a large visual gap between human and robots. To eliminate these limitations, we propose METIS, a vision-language-action (VLA) model for dexterous manipulation pretrained on multi-source egocentric datasets. We first construct EgoAtlas, which integrates large-scale human and robotic data from multiple sources, all unified under a consistent action space. We further extract motion-aware dynamics, a compact and discretized motion representation, which provides efficient and expressive supervision for VLA training. Built upon them, METIS integrates reasoning and acting into a unified framework, enabling effective deployment to downstream dexterous manipulation tasks. Our method demonstrates exceptional dexterous manipulation capabilities, achieving highest average success rate in six real-world tasks. Experimental results also highlight the superior generalization and robustness to out-of-distribution scenarios. These findings emphasize METIS as a promising step toward a generalist model for dexterous manipulation.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Human-video and latent-action pretraining, one of 13 directions in Vision-language-action models. Builds on 60 of its 66 references that are in the map. First posted on arXiv 21 Nov 2025.

Builds on

60 of 66 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025Being-H0: Vision-Language-Action Pretraining from Large-Scale Human Videos21 Jul
  2. 2025EgoVLA: Learning Vision-Language-Action Models from Egocentric Human Videos16 Jul
  3. 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actions9 May
  4. 2024Latent Action Pretraining from Videos15 Oct
  5. 2024Bi-VLA: Vision-Language-Action Model-Based System for Bimanual Robotic Dexterous Manipulations9 May

Other references · 55

  1. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  3. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  4. 2017Neural Discrete Representation Learningcited by 4,650
  5. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  6. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  7. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  8. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  9. 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
  10. 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
  11. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
  12. 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 849
38 more
  1. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
  2. 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
  3. 2022Autoregressive Image Generation using Residual Quantizationcited by 706
  4. 2016Temporal Convolutional Networks for Action Segmentation and Detectioncited by 504
  5. 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 390
  6. 2023An Embodied Generalist Agent in 3D Worldcited by 355
  7. 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 344
  8. 2024Prismatic VLMs: Investigating the Design Space of Visually-Conditioned Language Modelscited by 336
  9. 2022HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object Interactioncited by 321
  10. 2022ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulationcited by 306
  11. 2021H2O: Two Hands Manipulating Objects for First Person Interaction Recognitioncited by 251
  12. 2023Affordances from Human Videos as a Versatile Representation for Roboticscited by 221
  13. 2025DexVLA: Vision-Language Model with Plug-In Diffusion Expert for General Robot Controlcited by 191
  14. 2025EgoDex: Learning Dexterous Manipulation from Large-Scale Egocentric Videocited by 191
  15. 2025HybridVLA: Collaborative Diffusion and Autoregression in a Unified Vision-Language-Action Modelcited by 176
  16. 2024RoboMIND: Benchmark on Multi-embodiment Intelligence Normative Data for Robot Manipulationcited by 166
  17. 2023HoloAssist: an Egocentric Human Interaction Dataset for Interactive AI Assistants in the Real Worldcited by 159
  18. 2024DexCap: Scalable and Portable Mocap Data Collection System for Dexterous Manipulationcited by 149
  19. 2025Magma: A Foundation Model for Multimodal AI Agentscited by 138
  20. 2023AnyTeleop: A General Vision-Based Dexterous Robot Arm-Hand Teleoperation Systemcited by 136
  21. 2022OakInk: A Large-scale Knowledge Repository for Understanding Hand-Object Interactioncited by 129
  22. 2022DexGraspNet: A Large-Scale Robotic Dexterous Grasp Dataset for General Objects Based on Simulationcited by 129
  23. 2023UniDexGrasp: Universal Robotic Dexterous Grasping via Learning Diverse Proposal Generation and Goal-Conditioned Policycited by 117
  24. 2025OneTwoVLA: A Unified Vision-Language-Action Model with Adaptive Reasoningcited by 105
  25. 2022In-Hand Object Rotation via Rapid Motor Adaptationcited by 102
  26. 2023UniDexGrasp++: Improving Dexterous Grasping Policy Learning via Geometry-aware Curriculum and Iterative Generalist-Specialist Learningcited by 101
  27. 2025RoboBrain 2.0 Technical Reportcited by 87
  28. 2024General Flow as Foundation Affordance for Scalable Robot Learningcited by 80
  29. 2025Humanoid Policy ~ Human Policycited by 65
  30. 2024RAM: Retrieval-Based Affordance Transfer for Generalizable Zero-Shot Robotic Manipulationcited by 55
  31. 2025VTLA: Vision-Tactile-Language-Action Model with Preference Learning for Insertion Manipulationcited by 54
  32. 2025H-RDT: Human Manipulation Enhanced Bimanual Robotic Manipulationcited by 41
  33. 2023Ego-Only: Egocentric Action Detection without Exocentric Transferringcited by 30
  34. 2025DexterityGen: Foundation Controller for Unprecedented Dexteritycited by 26
  35. 2024Bimanual Dexterity for Complex Taskscited by 22
  36. 2025MotionTrans: Human VR Data Enable Motion-Level Learning for Robotic Manipulation Policiescited by 22
  37. 2022Goal-conditioned dual-action imitation learning for dexterous dual-arm robot manipulationcited by 21
  38. 2023Dextrous Tactile In-Hand Manipulation Using a Modular Reinforcement Learning Architecturecited by 17

50 most cited of 55 All 55 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 9.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Cross-Hand Latent Representation for Vision-Language-Action Models
  2. 2026DexHiL: A Human-in-the-Loop Framework for Vision-Language-Action Model Post-Training in Dexterous Manipulation
  3. 2026EgoScale: Scaling Dexterous Manipulation with Diverse Egocentric Human Data
  4. 2025Scalable Vision-Language-Action Model Pretraining for Robotic Manipulation with Real-Life Human Activity Videos
  5. 2026JoyAI-RA 0.5: Scaling Robot Manipulation Learning via Dual Action Alignment
  6. 2026IronMind: Scaling Humanoid Dexterous Manipulation via Camera-Space Ego-Centric Pretraining ↗
  7. 2026CometVLA: Co-Training on an Embodied Data Pyramid towards Physical Understanding
  8. 2026From Human Videos to Robot Manipulation: A Survey on Scalable Vision-Language-Action Learning with Human-Centric Data