Human-Centric Transferable Tactile Pre-Training for Dexterous Robotic Manipulation
Not on the map. Why?
Abstract (arXiv)
As an essential modality for dexterous and contact-rich tasks, tactile sensing provides precise force feedback that cannot be reliably inferred from vision. However, limited by hardware and data collection systems, existing datasets with tactility remain small in scale and narrow in contact coverage. Meanwhile, Vision-Language-Action (VLA) models with tactile modality are constrained on dynamics-agnostic post-training, which limits the performance ceiling on downstream tasks. In this paper, we present H-Tac, a large-scale tactile-action dataset with 160-hour egocentric human videos containing more than 300 tasks and 135k episodes. Building upon this, we propose Transferable Tactile Pre-Training (TTP), a system of tactile-based pre-training on human data for fine-grained robotic tasks. To bridge the gap between humans and robots, we use unified tactile and action spaces throughout the pre-training and post-training phases, preserving prior knowledge during human-to-robot transfer. By leveraging a tactile expert for future tactile prediction, our framework explicitly models the contact dynamics and precise physical interactions. Extensive experiments in simulation and on real robots demonstrate that our model achieves superior performance, exhibiting robust generalization and fine-grained manipulation capabilities. TTP paves the way for scalable tactile pre-training via human-to-robot transfer.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 69 of its 77 references that are in the map. First posted on arXiv 1 Jul 2026.
Builds on
69 of 77 references.
References · 69
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 440
38 more
- 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 391
- 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 386
- 2024Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robotscited by 373
- 2025WorldVLA: Towards Autoregressive Action World Modelcited by 351
- 2022HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object Interactioncited by 321
- 2021DexYCB: A Benchmark for Capturing Hand Grasping of Objectscited by 320
- 2022ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulationcited by 306
- 2019Resolving 3D Human Pose Ambiguities with 3D Scene Constraintscited by 294
- 20243D Diffuser Actor: Policy Diffusion with 3D Scene Representationscited by 278
- 2025LIBERO-Plus: In-depth Robustness Analysis of Vision-Language-Action Modelscited by 278
- 2021H2O: Two Hands Manipulating Objects for First Person Interaction Recognitioncited by 251
- 2020InterHand2.6M: A Dataset and Baseline for 3D Interacting Hand Pose Estimation from a Single RGB Imagecited by 244
- 2019Generalized Sliced Wasserstein Distancescited by 205
- 2025EgoDex: Learning Dexterous Manipulation from Large-Scale Egocentric Videocited by 191
- 2022Capturing and Inferring Dense Full-Body Human-Scene Contactcited by 176
- 2024EgoMimic: Scaling Imitation Learning via Egocentric Videocited by 160
- 2024Gen2Act: Human Video Generation in Novel Scenarios enables Generalizable Robot Manipulationcited by 142
- 2022OakInk: A Large-scale Knowledge Repository for Understanding Hand-Object Interactioncited by 129
- 2025Interactive Post-Training for Vision-Language-Action Modelscited by 129
- 2021Keypoint Transformer: Solving Joint Identification in Challenging Hands and Object Interactions for Accurate 3D Pose Estimationcited by 122
- 2024HOT3D: Hand and Object Tracking in 3D from Egocentric Multi-View Videoscited by 122
- 2025NORA: A Small Open-Sourced Generalist Vision Language Action Model for Embodied Taskscited by 119
- 2025EgoVLA: Learning Vision-Language-Action Models from Egocentric Human Videoscited by 116
- 2025Reactive Diffusion Policy: Slow-Fast Visual-Tactile Policy Learning for Contact-Rich Manipulationcited by 103
- 2025Being-H0: Vision-Language-Action Pretraining from Large-Scale Human Videoscited by 94
- 2025Discrete Diffusion VLA: Bringing Discrete Diffusion to Action Decoding in Vision-Language-Action Policiescited by 90
- 2025F1: A Vision-Language-Action Model Bridging Understanding and Generation to Actionscited by 85
- 2025InternVLA-M1: A Spatially Guided Vision-Language-Action Framework for Generalist Robot Policycited by 83
- 2024OAKINK2: A Dataset of Bimanual Hands-Object Manipulation in Complex Task Completioncited by 78
- 2026EgoScale: Scaling Dexterous Manipulation with Diverse Egocentric Human Datacited by 77
- 2026Being-H0.5: Scaling Human-Centric Robot Learning for Cross-Embodiment Generalizationcited by 61
- 2025VTLA: Vision-Tactile-Language-Action Model with Preference Learning for Insertion Manipulationcited by 54
- 2025TLA: Tactile-Language-Action Model for Contact-Rich Manipulationcited by 46
- 2025InternData-A1: Pioneering High-Fidelity Synthetic Data for Pre-training Generalist Policycited by 46
- 2025OmniVTLA: Vision-Tactile-Language-Action Models with Semantic-Aligned Tactile Sensingcited by 37
- 2025GWM: Towards Scalable Gaussian World Models for Robotic Manipulationcited by 37
- 2026OmniVTA: Visuo-Tactile World Modeling for Contact-Rich Robotic Manipulationcited by 33
- 2025UniSkill: Imitating Human Videos via Cross-Embodiment Skill Representationscited by 30
50 most cited of 69 All 69 (JSON)
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026HiTac-WAM: A Hierarchical Tactile World Action Model for Contact-Rich Robot Manipulationcited by 2
- 2026DexMani: Human-Derived Manipulability Guidance for Dexterous Rotationcited by 1
- 2026Unified Visual-Tactile-Action Modeling from Human Demonstrations for Dexterous Manipulationcited by 0
- 2026TouchScale: 500 Hours of Human Vision and Touch for Visual-Tactile Learningcited by 0
- 2026TouchScale: 500 Hours of Human Vision and Touch for Visual-Tactile Learning7 Oct 2026
- 2026Unified Visual-Tactile-Action Modeling from Human Demonstrations for Dexterous Manipulation28 Sep 2026
- 2026HiTac-WAM: A Hierarchical Tactile World Action Model for Contact-Rich Robot Manipulation20 Aug 2026
- 2026DexMani: Human-Derived Manipulability Guidance for Dexterous Rotation1 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026ME-Dex 1.0: Bringing Heterogeneous Tactile Sensing into World Action Modeling
- 2026DexTouch-WM: Learning Action-Conditioned Tactile World Models from Human Touch for Dexterous Robot Manipulation
- 2026UniTacVLA: Unified Tactile Understanding and Prediction in Vision Language Action Models
- 2026τ: Learning Touch-Augmented Vision-Language-Action Models from Future Visual Supervision
- 2025exUMI: Extensible Robot Teaching System with Action-aware Task-agnostic Tactile Representation
- 2026N0-TWAM: Scaling Tactile-Native World-Action Model for Contact-Rich Manipulation
- 2026SimpleTouch: Can Vision-Language-Action Models Master Contact-Rich Manipulation Without Tactile Policy Pretraining?
- 2026ViTacWorld: Scaling Visuo-Tactile World Models for Contact-Rich Robot Manipulation