mlsanityData to 7 Oct 2026

Built Different: Tactile Perception to Overcome Cross-Embodiment Capability Differences in Collaborative Manipulation

arXiv 2409.14896 ↗First posted 23 Sep 2024cs.RO cs.LGcited by 6

Not on the map. Why?

Abstract (arXiv)

Tactile sensing is a widely-studied means of implicit communication between robot and human. In this paper, we investigate how tactile sensing can help bridge differences between robotic embodiments in the context of collaborative manipulation. For a robot, learning and executing force-rich collaboration require compliance to human interaction. While compliance is often achieved with admittance control, many commercial robots lack the joint torque monitoring needed for such control. To address this challenge, we present an approach that uses tactile sensors and behavior cloning to transfer policies from robots with these capabilities to those without. We train a single policy that demonstrates positive transfer across embodiments, including robots without torque sensing. We demonstrate this positive transfer on four different tactile-enabled embodiments using the same policy trained on force-controlled robot data. Across multiple proposed metrics, the best performance came from a decomposed tactile shear-field representation combined with a pre-trained encoder, which improved success rates over alternative representations.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 21 of its 36 references that are in the map. First posted on arXiv 23 Sep 2024.

Builds on

21 of 36 references.

References · 21

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2020Denoising Diffusion Implicit Modelscited by 9,655
  4. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  5. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
  6. 2019Making Sense of Vision and Touch: Learning Multimodal Representations for Contact-Rich Taskscited by 80
  7. 2024Learning Visuotactile Skills with Two Multifingered Handscited by 71
  8. 2021Tactile-RL for Insertion: Generalization to Objects of Unknown Geometrycited by 45
  9. 2021GelSlim3.0: High-Resolution Measurement of Shape, Force and Slip in a Compact Tactile-Sensing Fingercited by 39
  10. 2024Mirage: Cross-Embodiment Zero-Shot Policy Transfer with Cross-Paintingcited by 35
  11. 2024Cross-Embodiment Robot Manipulation Skill Transfer using Latent Space Alignmentcited by 17
  12. 2021Active Extrinsic Contact Sensing: Application to General Peg-in-Hole Insertioncited by 16
9 more
  1. 2024A Comprehensive Survey of Cross-Domain Policy Transfer for Embodied Agentscited by 16
  2. 2022VIRDO++: Real-World, Visuo-tactile Dynamics and Perception of Deformable Objectscited by 13
  3. 2022DelTact: A Vision-based Tactile Sensor Using Dense Color Patterncited by 7
  4. 2018FingerVision Tactile Sensor Design and Slip Detection Using Convolutional LSTM Networkcited by 6
  5. 2024Tactile-Driven Non-Prehensile Object Manipulation via Extrinsic Contact Mode Controlcited by 6
  6. 2023Integrated Object Deformation and Contact Patch Estimation from Visuo-Tactile Feedbackcited by 3
  7. 2019Effective Estimation of Contact Force and Torque for Vision-based Tactile Sensor with Helmholtz-Hodge Decompositioncited by 2
  8. 2023GelFlow: Self-supervised Learning of Optical Flow for Vision-Based Tactile Sensor Displacement Measurementcited by 2
  9. 2024Optical Tactile Sensing for Aerial Multi-Contact Interaction: Design, Integration, and Evaluationcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 4.

6 papers.