mlsanityData to 14 Oct 2026

BiView-Touch: Learning Bimanual Tactile Representations by Cross-Hand Completion

arXiv 2609.23352 ↗First posted 20 Sep 2026cs.CV cs.ROcited by 0

Not on the map. Why?

Abstract (arXiv)

Bimanual interaction produces complementary tactile views of the same physical process, yet existing tactile representation learning largely models the two hands independently or combines them only for downstream prediction, leaving their cross-hand relationship unexplored. To exploit this overlooked structure, we introduce BiView-Touch, a tactile-only framework that completes masked target-hand latents from the remaining visible target-hand regions and the synchronized full contralateral hand. A student encoder with a geometry-conditioned directional decoder predicts full-view EMA latent targets, while temporal and layout counterfactuals encourage sensitivity to synchronized and anatomically organized source information. Controlled ablations and source-context interventions show that BiView-Touch learns structured cross-hand dependence on temporally aligned and anatomically organized contralateral tactile context, rather than benefiting from bilateral input alone. On the public HumanTouch dataset, its frozen representations consistently outperform representative self-supervised baselines across low-label settings. With only 5% downstream labels, BiView-Touch achieves relative balanced-accuracy gains of 7.1% on bilateral wrist-motion recognition and 14.1% on force-derived interaction-phase recognition. We further introduce BVT-20, a 20-task bilateral tactile dataset, and demonstrate transfer across recording sessions and pretraining corpora, including transfer to a held-out bimanual task. Our code and dataset details are available on the anonymous project page: https://anonymous.4open.science/w/biview-touch-review-site-050C/.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 49 references that are in the map. First posted on arXiv 20 Sep 2026.

Builds on

17 of 49 references.

References · 17

  1. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  2. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  3. 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 1,039
  4. 2022CroCo: Self-Supervised Pre-training for 3D Vision Tasks by Cross-View Completioncited by 160
  5. 20243D-ViTac: Learning Fine-Grained Manipulation with Visuo-Tactile Sensingcited by 72
  6. 2025AnyTouch: Learning Unified Static-Dynamic Representation across Multiple Visuo-tactile Sensorscited by 48
  7. 2017Improved GelSight Tactile Sensor for Measuring Geometry and Slipcited by 28
  8. 2023Bi-Touch: Bimanual Tactile Manipulation with Sim-to-Real Deep Reinforcement Learningcited by 17
  9. 2024VITaL Pretraining: Visuo-Tactile Pretraining for Tactile and Non-Tactile Manipulation Policiescited by 15
  10. 2025exUMI: Extensible Robot Teaching System with Action-aware Task-agnostic Tactile Representationcited by 14
  11. 2024Canonical Representation and Force-Based Pretraining of 3D Tactile for Dexterous Visuo-Tactile Policy Learningcited by 11
  12. 2021Dynamic Modeling of Hand-Object Interactions via Tactile Sensingcited by 8
5 more
  1. 2023Learn from Incomplete Tactile Data: Tactile Representation Learning with Masked Autoencoderscited by 8
  2. 2026TouchAnything: A Dataset and Framework for Bimanual Tactile Estimation from Egocentric Videocited by 7
  3. 2025VTAO-BiManip: Masked Visual-Tactile-Action Pre-training with Object Understanding for Bimanual Dexterous Manipulationcited by 3
  4. 2026Blind Dexterous Grasping via Real2Sim2Real Tactile Policy Learningcited by 3
  5. 2026STAR: Sparse Tactile Representation Learning in Vision-Tactile-Language-Action Models for Dexterous Manipulationcited by 1

Built on by

Not cited yet.