Built Different: Tactile Perception to Overcome Cross-Embodiment Capability Differences in Collaborative Manipulation
Not on the map. Why?
Abstract (arXiv)
Tactile sensing is a widely-studied means of implicit communication between robot and human. In this paper, we investigate how tactile sensing can help bridge differences between robotic embodiments in the context of collaborative manipulation. For a robot, learning and executing force-rich collaboration require compliance to human interaction. While compliance is often achieved with admittance control, many commercial robots lack the joint torque monitoring needed for such control. To address this challenge, we present an approach that uses tactile sensors and behavior cloning to transfer policies from robots with these capabilities to those without. We train a single policy that demonstrates positive transfer across embodiments, including robots without torque sensing. We demonstrate this positive transfer on four different tactile-enabled embodiments using the same policy trained on force-controlled robot data. Across multiple proposed metrics, the best performance came from a decomposed tactile shear-field representation combined with a pre-trained encoder, which improved success rates over alternative representations.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 21 of its 36 references that are in the map. First posted on arXiv 23 Sep 2024.
Builds on
21 of 36 references.
References · 21
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2019Making Sense of Vision and Touch: Learning Multimodal Representations for Contact-Rich Taskscited by 80
- 2024Learning Visuotactile Skills with Two Multifingered Handscited by 71
- 2021Tactile-RL for Insertion: Generalization to Objects of Unknown Geometrycited by 45
- 2021GelSlim3.0: High-Resolution Measurement of Shape, Force and Slip in a Compact Tactile-Sensing Fingercited by 39
- 2024Mirage: Cross-Embodiment Zero-Shot Policy Transfer with Cross-Paintingcited by 35
- 2024Cross-Embodiment Robot Manipulation Skill Transfer using Latent Space Alignmentcited by 17
- 2021Active Extrinsic Contact Sensing: Application to General Peg-in-Hole Insertioncited by 16
9 more
- 2024A Comprehensive Survey of Cross-Domain Policy Transfer for Embodied Agentscited by 16
- 2022VIRDO++: Real-World, Visuo-tactile Dynamics and Perception of Deformable Objectscited by 13
- 2022DelTact: A Vision-based Tactile Sensor Using Dense Color Patterncited by 7
- 2018FingerVision Tactile Sensor Design and Slip Detection Using Convolutional LSTM Networkcited by 6
- 2024Tactile-Driven Non-Prehensile Object Manipulation via Extrinsic Contact Mode Controlcited by 6
- 2023Integrated Object Deformation and Contact Patch Estimation from Visuo-Tactile Feedbackcited by 3
- 2019Effective Estimation of Contact Force and Torque for Vision-based Tactile Sensor with Helmholtz-Hodge Decompositioncited by 2
- 2023GelFlow: Self-supervised Learning of Optical Flow for Vision-Based Tactile Sensor Displacement Measurementcited by 2
- 2024Optical Tactile Sensing for Aerial Multi-Contact Interaction: Design, Integration, and Evaluationcited by 1
Built on by
Citing papers per year: 2025: 2; 2026: 4.
6 papers.
- 2025Reactive Diffusion Policy: Slow-Fast Visual-Tactile Policy Learning for Contact-Rich Manipulationcited by 103
- 2025TA-VLA: Elucidating the Design Space of Torque-aware Vision-Language-Action Modelscited by 30
- 2026Seeing Touch from Motion: A Unified Modality-Aware Visuo-Tactile Policy with Tactile Motion Correlationcited by 2
- 2026CoStream: Composing Simple Behaviors for Generalizable Complex Manipulationcited by 0
- 2026TAP-VLA: Tactile Annotation Prompting for Vision Language Action Modelscited by 0
- 2026The Embodiment Gap in Robot Foundation Modelscited by 0
- 2026The Embodiment Gap in Robot Foundation Models19 Aug 2026
- 2026Seeing Touch from Motion: A Unified Modality-Aware Visuo-Tactile Policy with Tactile Motion Correlation29 Jun 2026
- 2026TAP-VLA: Tactile Annotation Prompting for Vision Language Action Models27 Jun 2026
- 2026CoStream: Composing Simple Behaviors for Generalizable Complex Manipulation24 Jun 2026
- 2025TA-VLA: Elucidating the Design Space of Torque-aware Vision-Language-Action Models9 Sep 2025
- 2025Reactive Diffusion Policy: Slow-Fast Visual-Tactile Policy Learning for Contact-Rich Manipulation4 Mar 2025