MILE: A Mechanically Isomorphic Hand Exoskeleton and Visuotactile Robotic Hand for Data Collection in Dexterous Manipulation
Not on the map. Why?
Abstract (arXiv)
Dexterous robotic hands perform complex, contact-rich manipulation. Imitation learning provides a route to such skills, but collecting human demonstrations with accurate hand actions and rich tactile information remains a key bottleneck. We present MILE, a teleoperation-based data-collection system comprising the wearable MILE exoskeleton and the mechanically corresponding MILE-Tac robotic hand. Because human-hand anatomy and wearability place tighter constraints on the high-DoF wearable, our human-first design begins with the MILE exoskeleton, equipped with custom modular joint encoders for accurate joint-angle acquisition. We then design the MILE-Tac robotic hand to share the exoskeleton's selected kinematic topology and joint-axis arrangement while satisfying robot-side implementation constraints, and equip its fingertips with compact visuotactile sensor modules. This correspondence enables direct exoskeleton-to-robot joint-space command transfer without online task-space inverse-kinematics retargeting. During teleoperation, the system synchronously records task-specific visual observations, four fingertip visuotactile streams, robot-hand proprioception, and exoskeleton-derived action commands. In a four-task teleoperation benchmark, MILE achieved a mean success rate of 76%, compared with 28% and 8% for glove-based and vision-based baselines, respectively. For downstream imitation learning, we trained paired ACT and DP policies with and without tactile input on MILE-collected demonstrations. The tactile-input variants achieved higher success rates in all paired evaluations.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 28 of its 37 references that are in the map. First posted on arXiv 29 Nov 2025.
Builds on
28 of 37 references.
References · 28
- 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,885
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
- 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,498
- 2018Learning Dexterous In-Hand Manipulationcited by 687
- 2024Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robotscited by 394
- 2023GELLO: A General, Low-Cost, and Intuitive Teleoperation Framework for Robot Manipulatorscited by 189
- 2024DexCap: Scalable and Portable Mocap Data Collection System for Dexterous Manipulationcited by 160
- 2023AnyTeleop: A General Vision-Based Dexterous Robot Arm-Hand Teleoperation Systemcited by 152
- 2024Open-TeleVision: Teleoperation with Immersive Active Visual Feedbackcited by 145
- 2022Visual Dexterity: In-Hand Reorientation of Novel and Complex Object Shapescited by 101
- 2023LEAP Hand: Low-Cost, Efficient, and Anthropomorphic Hand for Robot Learningcited by 79
16 more
- 2025HOMIE: Humanoid Loco-Manipulation with Isomorphic Exoskeleton Cockpitcited by 76
- 20243D-ViTac: Learning Fine-Grained Manipulation with Visuo-Tactile Sensingcited by 72
- 2025DexUMI: Using Human Hand as the Universal Manipulation Interface for Dexterous Manipulationcited by 66
- 2021Transformer-based deep imitation learning for dual-arm robot manipulationcited by 32
- 2025DexterityGen: Foundation Controller for Unprecedented Dexteritycited by 29
- 2024Lessons from Learning to Spin "Pens"cited by 26
- 2022Robot Cooking with Stir-fry: Bimanual Non-prehensile Manipulation of Semi-fluid Objectscited by 25
- 2024Bimanual Dexterity for Complex Taskscited by 25
- 2025DOGlove: Dexterous Manipulation with a Low-Cost Open-Source Haptic Force Feedback Glovecited by 19
- 2025DEXOP: A Device for Robotic Transfer of Dexterous Human Manipulationcited by 19
- 2025PolyTouch: A Robust Multi-Modal Tactile Sensor for Contact-rich Manipulation Using Tactile-Diffusion Policiescited by 14
- 2025ORCA: An Open-Source, Reliable, Cost-Effective, Anthropomorphic Robotic Hand for Uninterrupted Dexterous Task Learningcited by 12
- 2025VT-Refine: Learning Bimanual Assembly with Visuo-Tactile Feedback via Simulation Fine-Tuningcited by 11
- 2025Tactile Robotics: An Outlookcited by 7
- 2024DexiTac: Soft Dexterous Tactile Grippingcited by 2
- 2023Tactile-Reactive Roller Graspercited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026UniDex-ViTac: Learning Unified Visuo-Tactile Dexterous Manipulation Policy from Human Video Data ↗
- 2026A Visuo-Tactile Data Collection System with Haptic Feedback for Coarse-to-Fine Imitation Learning
- 2025Exo-ViHa: A Cross-Platform Exoskeleton System with Visual and Haptic Feedback for Efficient Dexterous Skill Learning
- 2025Grasp Like Humans: Learning Generalizable Multi-Fingered Grasping from Human Proprioceptive Sensorimotor Integration
- 2025ViTacFormer: Learning Cross-Modal Representation for Visuo-Tactile Dexterous Manipulation
- 2026SEED-UMI: Sharing the Exoskeleton between human and robot for onE-to-one Dexterous demonstration ↗
- 2025ExoStart: Efficient learning for dexterous manipulation with sensorized exoskeleton demonstrations
- 2026Bench2Dex: Benchmarking Visuo-Tactile Bimanual Dexterous Manipulation Across Dexterous Hands