mlsanityData to 14 Oct 2026

Tactus: Open-Vocabulary Object Recognition from Low-Cost Pressure Arrays

arXiv 2608.04043 ↗First posted 4 Aug 2026cs.LG cs.ROcited by 0

Not on the map. Why?

Abstract (arXiv)

Resistive pressure arrays are the cheapest and most widely shipped tactile sensors, yet tactile representation learning has concentrated on optical sensors that image a deforming gel. We present Tactus, an open model that answers text queries from pressure data alone: on the STAG benchmark (27 objects, held-out recordings), it reaches 0.771 +/- 0.062 top-1 over four runs (top-3 0.935), matching, and at best exceeding, the dataset's supervised closed-set CNN at 0.76, with no trained classifier head. The recipe is small-data: 187 training recordings, masked-autoencoder pretraining on 144k unlabeled same-sensor frames, and the sensor's own calibration affine, which recovered more accuracy than every architecture change combined. The released model's errors concentrate in a few contact-ambiguous classes, are uncorrelated with text-target geometry (Spearman rho <= 0.05 over 702 class pairs), and survive paraphrased and even bare-name queries within one point; two diverse frames recover 89% of eight-frame accuracy. Failures are reported with equal precision: cross-sensor pretraining pooling gave no gain, vision co-training degraded touch, and a mis-normalized input pipeline silently discarded 97% of the sensor's dynamic range while producing plausible intermediate results. Weights, code, and the memory layer the model plugs into are released openly.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 14 references that are in the map. First posted on arXiv 4 Aug 2026.

Builds on

10 of 14 references.

References · 10

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  3. 2024Binding Touch to Everything: Learning Unified Multimodal Tactile Representationscited by 95
  4. 2024A Touch, Vision, and Language Dataset for Multimodal Alignmentcited by 69
  5. 2024Sparsh: Self-supervised touch representations for vision-based tactile sensingcited by 64
  6. 2024Transferable Tactile Transformers for Representation Learning Across Diverse Sensors and Taskscited by 45
  7. 2025TouchFormer: A Robust Transformer-based Framework for Multimodal Material Perceptioncited by 4
  8. 2024Jointly Modeling Spatio-Temporal Features of Tactile Signals for Action Classificationcited by 3
  9. 2026Fusion Embedding: A Unified Embedding Space for Text, Image, Video, and Audiocited by 3
  10. 2026TacVerse: A Multi-Sensor Dataset and Benchmark for Cross-Sensor Vision-Based Tactile Perceptioncited by 2

Built on by

Not cited yet.