OSMO: Open-Source Tactile Glove for Human-to-Robot Skill Transfer
Not on the map. Why?
Abstract (arXiv)
Human video demonstrations provide abundant training data for learning robot policies, but video alone cannot capture the rich contact signals critical for mastering manipulation. We introduce OSMO, an open-source wearable tactile glove designed for human-to-robot skill transfer. The glove features 12 three-axis tactile sensors across the fingertips and palm and is designed to be compatible with state-of-the-art hand-tracking methods for in-the-wild data collection. We demonstrate that a robot policy trained exclusively on human demonstrations collected with OSMO, without any real robot data, is capable of executing a challenging contact-rich manipulation task. By equipping both the human and the robot with the same glove, OSMO minimizes the visual and tactile embodiment gap, enabling the transfer of continuous shear and normal force feedback while avoiding the need for image inpainting or other vision-based force inference. On a real-world wiping task requiring sustained contact pressure, our tactile-aware policy achieves a 72% success rate, outperforming vision-only baselines by eliminating contact-related failure modes. We release complete hardware designs, firmware, and assembly instructions to support community adoption.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 55 of its 68 references that are in the map. First posted on arXiv 9 Dec 2025.
Builds on
55 of 68 references.
References · 55
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
- 2024Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robotscited by 394
- 2024Latent Action Pretraining from Videoscited by 321
- 2023Reconstructing Hands in 3D with Transformerscited by 306
- 2023MimicPlay: Long-Horizon Imitation Learning by Watching Human Playcited by 223
38 more
- 2024EgoMimic: Scaling Imitation Learning via Egocentric Videocited by 175
- 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 173
- 2020DIGIT: A Novel Design for a Low-Cost Compact High-Resolution Tactile Sensor with Application to In-Hand Manipulationcited by 167
- 2022Human-to-Robot Imitation in the Wildcited by 161
- 2024Gen2Act: Human Video Generation in Novel Scenarios enables Generalizable Robot Manipulationcited by 153
- 2024HOT3D: Hand and Object Tracking in 3D from Egocentric Multi-View Videoscited by 129
- 2025A Careful Examination of Large Behavior Models for Multitask Dexterous Manipulationcited by 129
- 2024OAKINK2: A Dataset of Bimanual Hands-Object Manipulation in Complex Task Completioncited by 82
- 20243D-ViTac: Learning Fine-Grained Manipulation with Visuo-Tactile Sensingcited by 72
- 2024OKAMI: Teaching Humanoid Robots Manipulation Skills through Single Video Imitationcited by 67
- 2025DexUMI: Using Human Hand as the Universal Manipulation Interface for Dexterous Manipulationcited by 66
- 2025Motion Tracks: A Unified Representation for Human-Robot Transfer in Few-Shot Imitation Learningcited by 59
- 2018GelSlim: A High-Resolution, Compact, Robust, and Calibrated Tactile-sensing Fingercited by 52
- 2021Human Hands as Probes for Interactive Object Understandingcited by 52
- 2023Towards Generalizable Zero-Shot Manipulation via Translating Human Interaction Planscited by 52
- 2024Dyn-HaMR: Recovering 4D Interacting Hand Motion from a Dynamic Cameracited by 51
- 2021GelSlim3.0: High-Resolution Measurement of Shape, Force and Slip in a Compact Tactile-Sensing Fingercited by 41
- 2025DexWild: Dexterous Human Interactions for In-the-Wild Robot Policiescited by 38
- 2021ReSkin: versatile, replaceable, lasting tactile skinscited by 35
- 2025UniSkill: Imitating Human Videos via Cross-Embodiment Skill Representationscited by 35
- 2023MimicTouch: Leveraging Multi-modal Human Tactile Demonstrations for Contact-rich Manipulationcited by 34
- 2024GigaHands: A Massive Annotated Dataset of Bimanual Hand Activitiescited by 33
- 2025EgoZero: Robot Learning from Smart Glassescited by 33
- 2025ZeroMimic: Distilling Robotic Manipulation Skills from Web Videoscited by 32
- 2025SPIDER: Scalable Physics-Informed Dexterous Retargetingcited by 32
- 2025DexterityGen: Foundation Controller for Unprecedented Dexteritycited by 29
- 2025Touch in the Wild: Learning Fine-Grained Manipulation with a Portable Visuo-Tactile Grippercited by 29
- 2025DexForce: Extracting Force-informed Actions from Kinesthetic Demonstrations for Dexterous Manipulationcited by 24
- 2024AnySkin: Plug-and-play Skin Sensing for Robotic Touchcited by 23
- 2024Digitizing Touch with an Artificial Multimodal Fingertipcited by 20
- 2025DOGlove: Dexterous Manipulation with a Low-Cost Open-Source Haptic Force Feedback Glovecited by 19
- 2025DEXOP: A Device for Robotic Transfer of Dexterous Human Manipulationcited by 19
- 2025Dexterity from Smart Lenses: Multi-Fingered Robot Manipulation with In-the-Wild Human Demonstrationscited by 19
- 2025Geometric Retargeting: A Principled, Ultrafast Neural Hand Retargeting Algorithmcited by 14
- 2023GelSight Svelte: A Human Finger-shaped Single-camera Tactile Robot Finger with Large Sensing Coverage and Proprioceptive Sensingcited by 11
- 2025RUKA: Rethinking the Design of Humanoid Hands with Learningcited by 8
- 2025Feel the Force: Contact-Driven Learning from Humanscited by 8
- 2024EyeSight Hand: Design of a Fully-Actuated Dexterous Robot Hand with Integrated Vision-Based Tactile Sensors and Compliant Actuationcited by 7
50 most cited of 55 All 55 (JSON)
Built on by
Citing papers per year: 2026: 10.
10 papers.
- 2026EgoVerse: An Egocentric Human Dataset for Robot Learning from Around the Worldcited by 57
- 2026Human-Centric Transferable Tactile Pre-Training for Dexterous Robotic Manipulationcited by 5
- 2026Tactile-based Multimodal Fusion in Embodied Intelligence: A Survey of Vision, Language, and Contact-Driven Paradigmscited by 2
- 2026Asynchronous Multimodal Diffusion Policy Composition via Latency-Aware Guidance Fusioncited by 1
- 2026HandelBot: Real-World Piano Playing via Fast Adaptation of Dexterous Robot Policiescited by 0
- 2026Touch2Robot: Robot Touch in the Human Demonstration Loopcited by 0
- 2026SoTa: Soft Tactile Skins for Dexterous Manipulationcited by 0
- 2026TACROSS: An Efficient and Low-Cost Scalable Human Touch System Across Heterogeneous Tactile Sensors for Dexterous Robot Learningcited by 0
- 2026Chronos Policy: Learning Robot Policies on Physical Timecited by 0
- 2026Force-Modulated Dexterity: Unified Compliance for Contact-Rich Manipulationcited by 0
- 2026Force-Modulated Dexterity: Unified Compliance for Contact-Rich Manipulation12 Oct 2026
- 2026Chronos Policy: Learning Robot Policies on Physical Time9 Oct 2026
- 2026TACROSS: An Efficient and Low-Cost Scalable Human Touch System Across Heterogeneous Tactile Sensors for Dexterous Robot Learning8 Oct 2026
- 2026SoTa: Soft Tactile Skins for Dexterous Manipulation1 Oct 2026
- 2026Touch2Robot: Robot Touch in the Human Demonstration Loop21 Sep 2026
- 2026Asynchronous Multimodal Diffusion Policy Composition via Latency-Aware Guidance Fusion19 Jul 2026
- 2026Human-Centric Transferable Tactile Pre-Training for Dexterous Robotic Manipulation1 Jul 2026
- 2026Tactile-based Multimodal Fusion in Embodied Intelligence: A Survey of Vision, Language, and Contact-Driven Paradigms17 May 2026
- 2026EgoVerse: An Egocentric Human Dataset for Robot Learning from Around the World8 Apr 2026
- 2026HandelBot: Real-World Piano Playing via Fast Adaptation of Dexterous Robot Policies12 Mar 2026