mlsanityData to 14 Oct 2026

Let Robots Feel Your Touch: Visuo-Tactile Cortical Alignment for Embodied Mirror Resonance

arXiv 2605.14571 ↗First posted 14 May 2026cs.RO cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Observing touch on another's body can elicit corresponding tactile sensations in the observer, a phenomenon termed mirror touch that supports empathy and social perception. This visuo-tactile resonance is thought to rely on structural correspondence between visual and somatosensory cortices, yet robotic systems lack computational frameworks that instantiate this principle. Here we demonstrate that cortical correspondence can be operationalized to endow robots with mirror touch. We introduce Mirror Touch Net, which imposes semantic, distributional and geometric alignment between visual and tactile representations through multi-level constraints, enabling prediction of millimetre-scale tactile signals across 1,140 taxels on a robotic hand from RGB images. Manifold analysis reveals that these constraints reshape visual representations into geometry consistent with the tactile manifold, reducing the complexity of cross-modal mapping. Extending this alignment framework to cross-domain observations of human hands enables tactile prediction and reflexive responses to observed human touch. Our results link a neural principle of visuo-tactile resonance to robotic perception, providing an explainable route towards anticipatory touch and empathic human-robot interaction. Code is available at https://github.com/fun0515/Mirror-Touch-Net.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 38 references that are in the map. First posted on arXiv 14 May 2026.

Builds on

12 of 38 references.

References · 12

  1. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  2. 2020DIGIT: A Novel Design for a Low-Cost Compact High-Resolution Tactile Sensor with Application to In-Hand Manipulationcited by 167
  3. 20243D-ViTac: Learning Fine-Grained Manipulation with Visuo-Tactile Sensingcited by 72
  4. 2024Sparsh: Self-supervised touch representations for vision-based tactile sensingcited by 64
  5. 2025AnyTouch: Learning Unified Static-Dynamic Representation across Multiple Visuo-tactile Sensorscited by 48
  6. 2022Visuo-Tactile Transformers for Manipulationcited by 47
  7. 2025VLA-Touch: Enhancing Vision-Language-Action Models with Dual-Level Tactile Feedbackcited by 38
  8. 2026OmniVTA: Visuo-Tactile World Modeling for Contact-Rich Robotic Manipulationcited by 36
  9. 2024VITaL Pretraining: Visuo-Tactile Pretraining for Tactile and Non-Tactile Manipulation Policiescited by 15
  10. 2024CushSense: Soft, Stretchable, and Comfortable Tactile-Sensing Skin for Physical Human-Robot Interactioncited by 8
  11. 2024Embedding high-resolution touch across robotic hands enables adaptive human-like graspingcited by 8
  12. 2025Simultaneous Tactile-Visual Perception for Learning Multimodal Robot Manipulationcited by 6

Built on by

Not cited yet.