HiTac-WAM: A Hierarchical Tactile World Action Model for Contact-Rich Robot Manipulation
On the map: World models → Embodied and robot world models
Abstract (arXiv)
World action models jointly predict future visual observations and actions, whereas existing tactile-aware variants typically represent future touch as an image or latent stream without modeling the physical dependencies that organize tactile states hierarchically. We present HiTac-WAM, a hierarchical tactile world action model that forecasts a sequence of future tactile states for each candidate action chunk before execution. The forecast factorizes into contact state, a 3D deformation field, and slip risk, organized as a directed hierarchy in which each downstream stage is conditioned on stop-gradient signals from preceding stages. A directed attention mask allows tactile queries to attend to the video-action context of each candidate while preventing video and action queries from attending to tactile tokens. For planning, HiTac-WAM ranks candidate action chunks using tactile forecasts and task-progress estimates. For execution, the selected tactile forecast is retained as a reference; persistent discrepancies between predicted and observed tactile states trigger corrective replanning. HiTac-WAM achieves a mean contact F1 of 0.921; under matched training budgets, the directed hierarchy reduces 3D displacement L2 error by 17.6% relative to the deformation-only predictor and improves slip AUPRC by 60.4% relative to the slip-only predictor. Across chip grasping, blackboard erasing, and USB insertion, selection guided by the hierarchical forecasts increases the average real-robot success rate from 31.1% to 61.1%, while the full system attains 72.2%.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 13 of its 34 references that are in the map. First posted on arXiv 20 Aug 2026.
Builds on
13 of 34 references.
Closest ancestors · 6
Same direction, newest first
- 2026ViTacWorld: Scaling Visuo-Tactile World Models for Contact-Rich Robot Manipulation24 Jul
- 2026VT-WAM: Visual-Tactile World Action Model for Contact-Rich Manipulation2 Jul
- 2026Dream-Tac: A Unified Tactile World Action Model for Contact-Rich Robot Manipulation7 Jun
- 2026OmniVTA: Visuo-Tactile World Modeling for Contact-Rich Robotic Manipulation19 Mar
- 2026World Action Models are Zero-shot Policies17 Feb
- 2026Visuo-Tactile World Models5 Feb
Other references · 7
- 2025ViTacFormer: Learning Cross-Modal Representation for Visuo-Tactile Dexterous Manipulationcited by 38
- 2025ViTaMIn: Learning Contact-Rich Tasks Through Robot-Free Visuo-Tactile Manipulation Interfacecited by 23
- 2018Endowing Robots with Longer-term Autonomy by Recovering from External Disturbances in Manipulation through Grounded Anomaly Classification and Recovery Policiescited by 6
- 2026UniTacVLA: Unified Tactile Understanding and Prediction in Vision Language Action Modelscited by 5
- 2026Human-Centric Transferable Tactile Pre-Training for Dexterous Robotic Manipulationcited by 5
- 2025KDPE: A Kernel Density Estimation Strategy for Diffusion Policy Trajectory Selectioncited by 4
- 2024Imagine2touch: Predictive Tactile Sensing for Robotic Manipulation using Efficient Low-Dimensional Signalscited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026TacPAC: Tactile Prediction and Real-Time Action Correction in World-Action Models for Contact-Rich Manipulation
- 2026TacDyn-WAM: Learning Implicit Tactile Dynamics in a Heterogeneous Visuo-Tactile World Action Model
- 2026TacWAM: Anchor-Guided World Action Model with Mechanics-Aware Tactile Prediction
- 2026N0-TWAM: Scaling Tactile-Native World-Action Model for Contact-Rich Manipulation
- 2026Agile-WAM: An Agile Tactile World Action Model for Contact-Rich Robot Control
- 2026TacForeSight: Force-Guided Tactile World Model for Contact-Rich Manipulation
- 2026TouchWorld: A Predictive and Reactive Tactile Foundation Model for Dexterous Manipulation
- 2026Tactile-WAM: Touch-Aware World Action Model with Tactile Asymmetric Attention