mlsanityData to 7 Oct 2026

BIDETA: Brain-Inspired Data-Efficient Tactile Adaptation for Unseen Sensors

arXiv 2609.08673 ↗First posted 8 Sep 2026cs.RO cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Vision-based tactile sensors provide high-resolution contact information for robotic perception and contact-rich manipulation, advancing embodied intelligence through more reliable physical interaction. However, device-specific sensing mechanisms cause tactile foundation models to degrade on unfamiliar hardware. Existing cross-sensor methods often require calibration data, paired observations, or iterative training. To address this problem, we propose Brain-Inspired Data-Efficient Tactile Adaptation (BIDETA), a gradient-free framework that uses a frozen tactile encoder and a few labeled target contacts to jointly predict labels for an unlabeled query batch. Inspired by the brain's rapid sensory adaptation, BIDETA combines rapid support memory, support-conditioned spectral graphs, and reliability-gated recurrence to preserve pretrained representations, repair sensor-dependent feature neighborhoods, and integrate reliable cross-query evidence. Experiments on SITR, TacVerse Shape, and TacQuad show that BIDETA substantially improves adaptation to unknown sensors: with only 10% labeled target data on SITR, it raises mean Sparsh accuracy from 6.86% for the frozen source classifier to 87.09%, exceeding the strongest implemented prior comparison by 47.22 percentage points, and these gains generalize across datasets, pretrained backbones, and tactile tasks. In the SITR timing benchmark with TVL, BIDETA also achieves approximately 20x faster target-sensor adaptation than the best baseline. BIDETA thus offers a gradient-free, data-efficient route to deploying tactile models on new hardware.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 25 of its 44 references that are in the map. First posted on arXiv 8 Sep 2026.

Builds on

25 of 44 references.

References · 25

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  3. 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,277
  4. 2022Tip-Adapter: Training-free Adaption of CLIP for Few-shot Classificationcited by 355
  5. 2019SimpleShot: Revisiting Nearest-Neighbor Classification for Few-Shot Learningcited by 194
  6. 2020DIGIT: A Novel Design for a Low-Cost Compact High-Resolution Tactile Sensor with Application to In-Hand Manipulationcited by 164
  7. 2024Efficient Test-Time Adaptation of Vision-Language Modelscited by 138
  8. 2024Binding Touch to Everything: Learning Unified Multimodal Tactile Representationscited by 94
  9. 2020Laplacian Regularized Few-Shot Learningcited by 90
  10. 2022Touch and Go: Learning from Human-Collected Vision and Touchcited by 84
  11. 2022Toward Next-Generation Artificial Intelligence: Catalyzing the NeuroAI Revolutioncited by 78
  12. 2024A Touch, Vision, and Language Dataset for Multimodal Alignmentcited by 68
13 more
  1. 2024Sparsh: Self-supervised touch representations for vision-based tactile sensingcited by 61
  2. 2021Attractor and integrator networks in the braincited by 60
  3. 2025AnyTouch: Learning Unified Static-Dynamic Representation across Multiple Visuo-tactile Sensorscited by 46
  4. 2024Transductive Zero-Shot and Few-Shot CLIPcited by 31
  5. 2023ViT-Lens: Towards Omni-modal Representationscited by 29
  6. 2025Tactile Beyond Pixels: Multisensory Touch Representations for Robot Manipulationcited by 10
  7. 2025Sensor-Invariant Tactile Representationcited by 8
  8. 2025Tactile Robotics: An Outlookcited by 7
  9. 2025Self-supervised perception for tactile skin covered dexterous handscited by 4
  10. 2026Seeing Through Touch: Tactile-Driven Visual Localization of Material Regionscited by 2
  11. 2026TacVerse: A Multi-Sensor Dataset and Benchmark for Cross-Sensor Vision-Based Tactile Perceptioncited by 2
  12. 2025TacEva: A Performance Evaluation Framework For Vision-Based Tactile Sensorscited by 1
  13. 2026Multimodality as Supervision: Self-Supervised Specialization to the Test Environment via Multimodalitycited by 1

Built on by

Not cited yet.