mlsanityData to 7 Oct 2026

Human-Centric Transferable Tactile Pre-Training for Dexterous Robotic Manipulation

arXiv 2607.01067 ↗First posted 1 Jul 2026cs.RO cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

As an essential modality for dexterous and contact-rich tasks, tactile sensing provides precise force feedback that cannot be reliably inferred from vision. However, limited by hardware and data collection systems, existing datasets with tactility remain small in scale and narrow in contact coverage. Meanwhile, Vision-Language-Action (VLA) models with tactile modality are constrained on dynamics-agnostic post-training, which limits the performance ceiling on downstream tasks. In this paper, we present H-Tac, a large-scale tactile-action dataset with 160-hour egocentric human videos containing more than 300 tasks and 135k episodes. Building upon this, we propose Transferable Tactile Pre-Training (TTP), a system of tactile-based pre-training on human data for fine-grained robotic tasks. To bridge the gap between humans and robots, we use unified tactile and action spaces throughout the pre-training and post-training phases, preserving prior knowledge during human-to-robot transfer. By leveraging a tactile expert for future tactile prediction, our framework explicitly models the contact dynamics and precise physical interactions. Extensive experiments in simulation and on real robots demonstrate that our model achieves superior performance, exhibiting robust generalization and fine-grained manipulation capabilities. TTP paves the way for scalable tactile pre-training via human-to-robot transfer.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 69 of its 77 references that are in the map. First posted on arXiv 1 Jul 2026.

Builds on

69 of 77 references.

References · 69

  1. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  2. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
  3. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  4. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  5. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
  6. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
  7. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  8. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
  9. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
  10. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
  11. 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
  12. 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 440
38 more
  1. 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 391
  2. 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 386
  3. 2024Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robotscited by 373
  4. 2025WorldVLA: Towards Autoregressive Action World Modelcited by 351
  5. 2022HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object Interactioncited by 321
  6. 2021DexYCB: A Benchmark for Capturing Hand Grasping of Objectscited by 320
  7. 2022ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulationcited by 306
  8. 2019Resolving 3D Human Pose Ambiguities with 3D Scene Constraintscited by 294
  9. 20243D Diffuser Actor: Policy Diffusion with 3D Scene Representationscited by 278
  10. 2025LIBERO-Plus: In-depth Robustness Analysis of Vision-Language-Action Modelscited by 278
  11. 2021H2O: Two Hands Manipulating Objects for First Person Interaction Recognitioncited by 251
  12. 2020InterHand2.6M: A Dataset and Baseline for 3D Interacting Hand Pose Estimation from a Single RGB Imagecited by 244
  13. 2019Generalized Sliced Wasserstein Distancescited by 205
  14. 2025EgoDex: Learning Dexterous Manipulation from Large-Scale Egocentric Videocited by 191
  15. 2022Capturing and Inferring Dense Full-Body Human-Scene Contactcited by 176
  16. 2024EgoMimic: Scaling Imitation Learning via Egocentric Videocited by 160
  17. 2024Gen2Act: Human Video Generation in Novel Scenarios enables Generalizable Robot Manipulationcited by 142
  18. 2022OakInk: A Large-scale Knowledge Repository for Understanding Hand-Object Interactioncited by 129
  19. 2025Interactive Post-Training for Vision-Language-Action Modelscited by 129
  20. 2021Keypoint Transformer: Solving Joint Identification in Challenging Hands and Object Interactions for Accurate 3D Pose Estimationcited by 122
  21. 2024HOT3D: Hand and Object Tracking in 3D from Egocentric Multi-View Videoscited by 122
  22. 2025NORA: A Small Open-Sourced Generalist Vision Language Action Model for Embodied Taskscited by 119
  23. 2025EgoVLA: Learning Vision-Language-Action Models from Egocentric Human Videoscited by 116
  24. 2025Reactive Diffusion Policy: Slow-Fast Visual-Tactile Policy Learning for Contact-Rich Manipulationcited by 103
  25. 2025Being-H0: Vision-Language-Action Pretraining from Large-Scale Human Videoscited by 94
  26. 2025Discrete Diffusion VLA: Bringing Discrete Diffusion to Action Decoding in Vision-Language-Action Policiescited by 90
  27. 2025F1: A Vision-Language-Action Model Bridging Understanding and Generation to Actionscited by 85
  28. 2025InternVLA-M1: A Spatially Guided Vision-Language-Action Framework for Generalist Robot Policycited by 83
  29. 2024OAKINK2: A Dataset of Bimanual Hands-Object Manipulation in Complex Task Completioncited by 78
  30. 2026EgoScale: Scaling Dexterous Manipulation with Diverse Egocentric Human Datacited by 77
  31. 2026Being-H0.5: Scaling Human-Centric Robot Learning for Cross-Embodiment Generalizationcited by 61
  32. 2025VTLA: Vision-Tactile-Language-Action Model with Preference Learning for Insertion Manipulationcited by 54
  33. 2025TLA: Tactile-Language-Action Model for Contact-Rich Manipulationcited by 46
  34. 2025InternData-A1: Pioneering High-Fidelity Synthetic Data for Pre-training Generalist Policycited by 46
  35. 2025OmniVTLA: Vision-Tactile-Language-Action Models with Semantic-Aligned Tactile Sensingcited by 37
  36. 2025GWM: Towards Scalable Gaussian World Models for Robotic Manipulationcited by 37
  37. 2026OmniVTA: Visuo-Tactile World Modeling for Contact-Rich Robotic Manipulationcited by 33
  38. 2025UniSkill: Imitating Human Videos via Cross-Embodiment Skill Representationscited by 30

50 most cited of 69 All 69 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026ME-Dex 1.0: Bringing Heterogeneous Tactile Sensing into World Action Modeling
  2. 2026DexTouch-WM: Learning Action-Conditioned Tactile World Models from Human Touch for Dexterous Robot Manipulation
  3. 2026UniTacVLA: Unified Tactile Understanding and Prediction in Vision Language Action Models
  4. 2026τ: Learning Touch-Augmented Vision-Language-Action Models from Future Visual Supervision
  5. 2025exUMI: Extensible Robot Teaching System with Action-aware Task-agnostic Tactile Representation
  6. 2026N0-TWAM: Scaling Tactile-Native World-Action Model for Contact-Rich Manipulation
  7. 2026SimpleTouch: Can Vision-Language-Action Models Master Contact-Rich Manipulation Without Tactile Policy Pretraining?
  8. 2026ViTacWorld: Scaling Visuo-Tactile World Models for Contact-Rich Robot Manipulation