Dexora: Open-source VLA for High-DoF Bimanual Dexterity
On the map: Vision-language-action models → Human-video and latent-action pretraining
Abstract (arXiv)
Vision-Language-Action (VLA) models have recently become a central direction in embodied AI, but current systems are restricted to either dual-gripper control or single-arm dexterous hand manipulation. While low-dimensional gripper control can often be handled with simpler methods, high-dimensional dexterous hand control benefits greatly from full end-to-end VLA learning. In this work, we introduce Dexora, the first open-source VLA system that natively targets dual-arm, dual-hand high-DoF manipulation. We design a hybrid teleoperation pipeline that decouples gross arm kinematics (captured with a custom exoskeleton backpack) from fine finger motion (markerless hand tracking via Apple Vision Pro), and that drives both a physical dual-arm dual-hand platform and an identical MuJoCo digital twin. Using that interface, we assemble a large training corpus: an embodiment-matched synthetic corpus (100K simulated trajectories, 6.5M frames) and a real-world dataset of 10K teleoperated episodes (2.92M frames). To mitigate noisy teleoperation demonstrations, we propose a data-quality-aware training recipe: an offline discriminator provides clip-level weights for diffusion-transformer policy training, down-weighting low-quality demonstrations. Empirically, Dexora outperforms competitive VLA baselines on both basic and dexterous benchmarks (e.g., average dexterous success 66.7% vs. 51.7%), attains 90% success on basic tasks, and shows robust out-of-distribution and cross-embodiment generalization. Ablations confirm the importance of real data and the discriminator for dexterity.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Human-video and latent-action pretraining, one of 13 directions in Vision-language-action models. Builds on 42 of its 44 references that are in the map. First posted on arXiv 18 May 2026.
Builds on
42 of 44 references.
Closest ancestors · 4
Same direction, newest first
- 2025Being-H0: Vision-Language-Action Pretraining from Large-Scale Human Videos21 Jul
- 2025EgoVLA: Learning Vision-Language-Action Models from Egocentric Human Videos16 Jul
- 2025GraspVLA: a Grasping Foundation Model Pre-trained on Billion-scale Synthetic Action Data6 May
- 2025DexGraspVLA: A Vision-Language-Action Framework Towards General Dexterous Grasping28 Feb
Other references · 38
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
26 more
- 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 390
- 2023GELLO: A General, Low-Cost, and Intuitive Teleoperation Framework for Robot Manipulatorscited by 180
- 2023AnyTeleop: A General Vision-Based Dexterous Robot Arm-Hand Teleoperation Systemcited by 136
- 2023UniDexGrasp: Universal Robotic Dexterous Grasping via Learning Diverse Proposal Generation and Goal-Conditioned Policycited by 117
- 2025GR-3 Technical Reportcited by 110
- 2024DexMimicGen: Automated Data Generation for Bimanual Dexterous Manipulation via Imitation Learningcited by 104
- 2022Discriminator-Weighted Offline Imitation Learning from Suboptimal Demonstrationscited by 89
- 2024Bunny-VisionPro: Real-Time Bimanual Dexterous Teleoperation for Imitation Learningcited by 69
- 2024OPEN TEACH: A Versatile Teleoperation System for Robotic Manipulationcited by 67
- 2024ALOHA 2: An Enhanced Low-Cost Hardware for Bimanual Teleoperationcited by 61
- 2025DexUMI: Using Human Hand as the Universal Manipulation Interface for Dexterous Manipulationcited by 58
- 2025ManipTrans: Efficient Dexterous Bimanual Manipulation Transfer via Residual Learningcited by 56
- 2023AirExo: Low-Cost Exoskeletons for Learning Whole-Arm Manipulation in the Wildcited by 46
- 2024G-HOP: Generative Hand-Object Prior for Interaction Reconstruction and Grasp Synthesiscited by 43
- 2024DexGraspNet 2.0: Learning Generative Dexterous Grasping in Large-scale Synthetic Cluttered Scenescited by 41
- 2024RealDex: Towards Human-like Grasping for Robotic Dexterous Handcited by 33
- 2025TA-VLA: Elucidating the Design Space of Torque-aware Vision-Language-Action Modelscited by 30
- 2024SemGrasp: Semantic Grasp Generation via Language Aligned Discretizationcited by 29
- 2025DexGrasp Anything: Towards Universal Robotic Dexterous Grasping with Physics Awarenesscited by 25
- 2025Dex1B: Learning with 1B Demonstrations for Dexterous Manipulationcited by 23
- 2018Vision-based Teleoperation of Shadow Dexterous Hand using End-to-End Deep Neural Networkcited by 19
- 2025Dexonomy: Synthesizing All Dexterous Grasp Types in a Grasp Taxonomycited by 19
- 2025RobustDexGrasp: Robust Dexterous Grasping of General Objectscited by 16
- 2025How to Train Your Robots? The Impact of Demonstration Modality on Imitation Learningcited by 11
- 2025RoboChemist: Long-Horizon and Safety-Compliant Robotic Chemical Experimentationcited by 9
- 2025SPARK-Remote: A Cost-Effective System for Remote Bimanual Robot Teleoperationcited by 1
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026RoboDojo: A Unified Sim-and-Real Benchmark for Comprehensive Evaluation of Generalist Robot Manipulation Policiescited by 35
- 2026LIBERO-Safety: A Comprehensive Benchmark for Physical and Semantic Safety in Vision-Language-Action Modelscited by 8
- 2026Motus2: A Self-Evolving General World Model for Dexterous Manipulationcited by 6
- 2026Ambient Diffusion Policy: Imitation Learning from Suboptimal Data in Roboticscited by 4
- 2026Data Pyramid for Embodied Manipulation: A Surveycited by 4
- 2026SA-VLA: State-aware tokenizer for improving Vision-Language-Action Models' performancecited by 1
- 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Datacited by 1
- 2026UniDexTok: A Unified Dexterous Hand Tokenizer from Real Datacited by 0
- 2026Cooperative Multi-Agent Vision-Language-Action Models via Reinforced Fine Tuningcited by 0
- 2026Cooperative Multi-Agent Vision-Language-Action Models via Reinforced Fine Tuning29 Sep 2026
- 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Data25 Sep 2026
- 2026Motus2: A Self-Evolving General World Model for Dexterous Manipulation31 Aug 2026
- 2026Data Pyramid for Embodied Manipulation: A Survey27 Jul 2026
- 2026RoboDojo: A Unified Sim-and-Real Benchmark for Comprehensive Evaluation of Generalist Robot Manipulation Policies5 Jul 2026
- 2026SA-VLA: State-aware tokenizer for improving Vision-Language-Action Models' performance29 Jun 2026
- 2026LIBERO-Safety: A Comprehensive Benchmark for Physical and Semantic Safety in Vision-Language-Action Models22 Jun 2026
- 2026Ambient Diffusion Policy: Imitation Learning from Suboptimal Data in Robotics10 Jun 2026
- 2026UniDexTok: A Unified Dexterous Hand Tokenizer from Real Data9 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026Towards High-DoF Dexterous Manipulation through VLA Post-Training ↗
- 2026DexHiL: A Human-in-the-Loop Framework for Vision-Language-Action Model Post-Training in Dexterous Manipulation
- 2026Cross-Hand Latent Representation for Vision-Language-Action Models
- 2025GR-Dexter Technical Report
- 2025End-to-End Dexterous Arm-Hand VLA Policies via Shared Autonomy: VR Teleoperation Augmented by Autonomous Hand VLA Policy for Efficient Data Collection
- 2026Towards Human-Like Manipulation through RL-Augmented Teleoperation and Mixture-of-Dexterous-Experts VLA
- 2026InDex: Empowering VLA Models with Intent-Conditioned Arm-Hand Coordination for Dexterous Manipulation
- 2026Learning Panorama-Aware VLA for Mobile Manipulation with Whole-Body Teleoperation