Tactile-WAM: Touch-Aware World Action Model with Tactile Asymmetric Attention
On the map: World models → Embodied and robot world models
Abstract (arXiv)
World Action Models (WAMs) jointly predict future visual observations and actions, but visual futures alone often miss slip, jamming, contact-direction changes, and subtle misalign- ment in contact-rich manipulation. Tactile signals reveal these hidden physical states, yet naive tactile-token injection can disrupt visual dynamics modeling due to the limited scale of tactile data, a phenomenon we term tactile pollution. We in- troduce Tactile-WAM, which uses asymmetric attention to block video queries from tactile keys while preserving tac- tile access for action queries. A contact-change-aware bias further strengthens action attention to touch. Because tactile pixel changes do not reliably reflect contact changes, we derive Observed proxy changes drive the attention bias, while future- proxy supervision preserves action-relevant contact dynamics in predicted tactile representations. On ManiFeel, visual-path isolation reduces deviation from the RGB-only trajectory by 21.8% in MSE at the step-matched 20K checkpoint without a statistically detectable change in ground-truth video qual- ity. The full model improves average success from 15.6% to 32.7%, with VideoClean providing the largest gain. On five real-robot tasks, Tactile-WAM achieves 49.2% success.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 11 of its 29 references that are in the map. First posted on arXiv 25 Jun 2026.
Builds on
11 of 29 references.
Closest ancestors · 4
Same direction, newest first
- 2026Unified 4D World Action Modeling from Video Priors with Asynchronous Denoising29 Apr
- 2026World Action Models are Zero-shot Policies17 Feb
- 2026Visuo-Tactile World Models5 Feb
- 2026Causal World Modeling for Robot Control29 Jan
Other references · 7
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 279
- 2025Reactive Diffusion Policy: Slow-Fast Visual-Tactile Policy Learning for Contact-Rich Manipulationcited by 103
- 2024Prediction with Action: Visual Policy Learning via Joint Denoising Processcited by 64
- 2024Sparsh: Self-supervised touch representations for vision-based tactile sensingcited by 61
- 2024UniT: Data Efficient Tactile Representation with Generalization to Unseen Objectscited by 15
- 2025ManiFeel: Benchmarking and Understanding Visuotactile Manipulation Policy Learningcited by 12
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026TacWAM: Anchor-Guided World Action Model with Mechanics-Aware Tactile Predictioncited by 3
- 2026N0-TWAM: Scaling Tactile-Native World-Action Model for Contact-Rich Manipulationcited by 2
- 2026Agile-WAM: An Agile Tactile World Action Model for Contact-Rich Robot Controlcited by 1
- 2026Disentangling Visuo-Tactile Foresight: Oracle-Guided Interface Discovery for World Action Modelscited by 0
- 2026ViTaR: Visuo-Tactile Residual Adaptation for Foundation VLA Manipulationcited by 0
- 2026VT-MUSE: Multimodal Unified Sequential Visuotactile Representation Learning for Manipulationcited by 0
- 2026HapticWAM: Distilling Imagined Touch into a World-Action Model without Inference-Time Tactile Sensingcited by 0
- 2026Uni-VLaT: Whole-Body Tactile Adaptation of VLA Policies for Humanoid Loco-Manipulationcited by 0
- 2026TacDyn-WAM: Learning Implicit Tactile Dynamics in a Heterogeneous Visuo-Tactile World Action Modelcited by 0
- 2026TacDyn-WAM: Learning Implicit Tactile Dynamics in a Heterogeneous Visuo-Tactile World Action Model30 Sep 2026
- 2026Uni-VLaT: Whole-Body Tactile Adaptation of VLA Policies for Humanoid Loco-Manipulation28 Sep 2026
- 2026HapticWAM: Distilling Imagined Touch into a World-Action Model without Inference-Time Tactile Sensing20 Sep 2026
- 2026Agile-WAM: An Agile Tactile World Action Model for Contact-Rich Robot Control17 Sep 2026
- 2026VT-MUSE: Multimodal Unified Sequential Visuotactile Representation Learning for Manipulation21 Aug 2026
- 2026ViTaR: Visuo-Tactile Residual Adaptation for Foundation VLA Manipulation16 Aug 2026
- 2026Disentangling Visuo-Tactile Foresight: Oracle-Guided Interface Discovery for World Action Models1 Aug 2026
- 2026TacWAM: Anchor-Guided World Action Model with Mechanics-Aware Tactile Prediction30 Jul 2026
- 2026N0-TWAM: Scaling Tactile-Native World-Action Model for Contact-Rich Manipulation26 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026VT-WAM: Visual-Tactile World Action Model for Contact-Rich Manipulation
- 2026HiTac-WAM: A Hierarchical Tactile World Action Model for Contact-Rich Robot Manipulation
- 2026TacPAC: Tactile Prediction and Real-Time Action Correction in World-Action Models for Contact-Rich Manipulation
- 2026ME-Dex 1.0: Bringing Heterogeneous Tactile Sensing into World Action Modeling
- 2026Dream-Tac: A Unified Tactile World Action Model for Contact-Rich Robot Manipulation
- 2026VTAM: Video-Tactile-Action Models for Complex Physical Interaction Beyond VLAs
- 2026τ: Learning Touch-Augmented Vision-Language-Action Models from Future Visual Supervision
- 2026ContactWorld: What Representations Matter for Vision-Tactile Latent World Models in Contact-Rich Manipulation