mlsanityData to 7 Oct 2026

The Potential of Haptic Foundation Models

arXiv 2608.28664 ↗First posted 23 Aug 2026cs.RO cs.CV cs.MMcited by 0

Not on the map. Why?

Abstract (arXiv)

Despite the success of foundation models in language and vision, their expansion into embodied AI is bottlenecked by a lack of generalized touch sensing. This limitation is especially relevant to consumer electronics, where smartphones, wearables, VR controllers, home robots, and health monitoring devices require safe and adaptive physical interaction. Constrained by hardware heterogeneity and the necessity of active physical data collection, current haptic models remain rigidly task-specific. To overcome these limitations, this article explores the transformative potential and developmental trajectory of Haptic Foundation Models (HFMs). We detail the paradigm shift required to transition from passive Large Language Models and Vision Language Models into active HFMs across four core dimensions: action coupling, physical dynamical representation space, continuous time-series data granularity, and action-conditioned future state prediction. Furthermore, we synthesize existing large-scale tactile datasets and benchmark UniTouch, AnyTouch, T3, and Sparsh on TacBench for force estimation, slip detection, and relative pose estimation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 14 references that are in the map. First posted on arXiv 23 Aug 2026.

Builds on

10 of 14 references.

References · 10

  1. 2024Binding Touch to Everything: Learning Unified Multimodal Tactile Representationscited by 94
  2. 2025AnyTouch: Learning Unified Static-Dynamic Representation across Multiple Visuo-tactile Sensorscited by 46
  3. 2021ReSkin: versatile, replaceable, lasting tactile skinscited by 33
  4. 2024Touch100k: A Large-Scale Touch-Language-Vision Dataset for Touch-Centric Multimodal Representationcited by 27
  5. 2025FreeTacMan: Robot-free Visuo-Tactile Data Collection System for Contact-rich Manipulationcited by 21
  6. 2025exUMI: Extensible Robot Teaching System with Action-aware Task-agnostic Tactile Representationcited by 14
  7. 2026AnyTouch 2: General Optical Tactile Representation Learning For Dynamic Tactile Perceptioncited by 11
  8. 2025Tactile Beyond Pixels: Multisensory Touch Representations for Robot Manipulationcited by 10
  9. 2025World In Your Hands: A Large-Scale and Open-Source Ecosystem for Learning Human-Centric Manipulation in the Wildcited by 3
  10. 2024Bringing Robots Home: The Rise of AI Robots in Consumer Electronicscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026ME-Dex 1.0: Bringing Heterogeneous Tactile Sensing into World Action Modeling
  2. 2025Towards Forceful Robotic Foundation Models: a Literature Survey
  3. 2026τ: Learning Touch-Augmented Vision-Language-Action Models from Future Visual Supervision
  4. 2026HapTile: A Haptic-Informed Vision-Tactile-Language-Action Dataset for Contact-Rich Imitation Learning
  5. 2026HiTac-WAM: A Hierarchical Tactile World Action Model for Contact-Rich Robot Manipulation
  6. 2023Multi-Modal World Model for Physical Robot Interactions: Simultaneous Visual and Tactile Predictions for Enhanced Accuracy
  7. 2026HapticWAM: Distilling Imagined Touch into a World-Action Model without Inference-Time Tactile Sensing
  8. 2026TacDyn-WAM: Learning Implicit Tactile Dynamics in a Heterogeneous Visuo-Tactile World Action Model