TacWAM: Anchor-Guided World Action Model with Mechanics-Aware Tactile Prediction
On the map: World models → Embodied and robot world models
Abstract (arXiv)
World Action Models (WAMs) combine future-state prediction with robot action generation, but existing approaches largely rely on visual futures. Visual prediction captures scene structure and object motion, yet provides limited supervision for force, deformation, shear, and slip during contact-rich manipulation. This creates two design requirements: tactile futures should carry meaningful physical information, and they should not become privileged cues for action generation. We present TacWAM, a mechanics-aware tactile WAM that addresses this challenge in three steps. First, a Spatially Aligned Fusion (SAF) Tactile Encoder maps tactile appearance, dense force fields, and deformation flow into a shared latent prediction space, with bilateral force and torque reconstruction preserving global contact information. Second, a tactile history encoder provides temporal context so future tactile prediction reflects how force and deformation change beyond the current tactile observation. Third, Anchor-Guided Tri-Modal (AGT) Attention separates current visual and tactile anchors, future prediction tokens, and action tokens, allowing future tactile states to supervise training without being directly read by the action branch. We evaluate TacWAM on four real-world contact-rich manipulation tasks covering fragile grasping, sustained surface contact, and dynamic in-hand manipulation. TacWAM achieves an average success rate of 75.0%, exceeding the strongest evaluated baseline by 37.5 percentage points. Staged ablations show consistent degradation when tactile history is removed and access to future prediction targets is relaxed. These results indicate that future tactile supervision can improve contact-aware action learning when combined with informative tactile representations and deployment-consistent information constraints.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 24 of its 29 references that are in the map. First posted on arXiv 30 Jul 2026.
Builds on
24 of 29 references.
Closest ancestors · 10
Same direction, newest first
- 2026ViTacWorld: Scaling Visuo-Tactile World Models for Contact-Rich Robot Manipulation24 Jul
- 2026VT-WAM: Visual-Tactile World Action Model for Contact-Rich Manipulation2 Jul
- 2026Tactile-WAM: Touch-Aware World Action Model with Tactile Asymmetric Attention25 Jun
- 2026TacForeSight: Force-Guided Tactile World Model for Contact-Rich Manipulation9 Jun
- 2026AHA-WAM:Asynchronous Horizon-Adaptive World-Action Modeling with Observation-Guided Context Routing8 Jun
- 2026OA-WAM: Object-Addressable World Action Model for Robust Robot Manipulation7 May
- 2026Enhancing Policy Learning with World-Action Model30 Mar
- 2026OmniVTA: Visuo-Tactile World Modeling for Contact-Rich Robotic Manipulation19 Mar
- 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?17 Mar
- 2026Visuo-Tactile World Models5 Feb
Other references · 14
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2025Reactive Diffusion Policy: Slow-Fast Visual-Tactile Policy Learning for Contact-Rich Manipulationcited by 108
- 2019Making Sense of Vision and Touch: Learning Multimodal Representations for Contact-Rich Taskscited by 84
- 2025VTLA: Vision-Tactile-Language-Action Model with Preference Learning for Insertion Manipulationcited by 55
- 2025ViTacFormer: Learning Cross-Modal Representation for Visuo-Tactile Dexterous Manipulationcited by 38
- 2025VLA-Touch: Enhancing Vision-Language-Action Models with Dual-Level Tactile Feedbackcited by 38
- 2024RoboPack: Learning Tactile-Informed Dynamics Models for Dense Packingcited by 19
- 2025Tactile-VLA: Unlocking Vision-Language-Action Model's Physical Knowledge for Tactile Generalizationcited by 19
- 2025Learning to Feel the Future: DreamTacVLA for Contact-Rich Manipulationcited by 18
- 2024Tac-Man: Tactile-Informed Prior-Free Manipulation of Articulated Objectscited by 9
- 2026TouchWorld: A Predictive and Reactive Tactile Foundation Model for Dexterous Manipulationcited by 9
- 2026N0-VTLA: Scaling Vision-Tactile-Language-Action Model with Latent Tactile Tokenscited by 6
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Beyond Multimodal Alignment: Certifying Physical Language through Response Substitution and Ordered Executioncited by 0
- 2026Uni-VLaT: Whole-Body Tactile Adaptation of VLA Policies for Humanoid Loco-Manipulationcited by 0
- 2026TacDyn-WAM: Learning Implicit Tactile Dynamics in a Heterogeneous Visuo-Tactile World Action Modelcited by 0
- 2026TacDyn-WAM: Learning Implicit Tactile Dynamics in a Heterogeneous Visuo-Tactile World Action Model30 Sep 2026
- 2026Uni-VLaT: Whole-Body Tactile Adaptation of VLA Policies for Humanoid Loco-Manipulation28 Sep 2026
- 2026Beyond Multimodal Alignment: Certifying Physical Language through Response Substitution and Ordered Execution19 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026HiTac-WAM: A Hierarchical Tactile World Action Model for Contact-Rich Robot Manipulation
- 2026Agile-WAM: An Agile Tactile World Action Model for Contact-Rich Robot Control
- 2026N0-TWAM: Scaling Tactile-Native World-Action Model for Contact-Rich Manipulation
- 2026TacPAC: Tactile Prediction and Real-Time Action Correction in World-Action Models for Contact-Rich Manipulation
- 2026Representation-Aligned Tactile Grounding for Contact-Rich Robotic Manipulation ↗
- 2026HapticWAM: Distilling Imagined Touch into a World-Action Model without Inference-Time Tactile Sensing
- 2026Dream-Tac: A Unified Tactile World Action Model for Contact-Rich Robot Manipulation
- 2026ME-Dex 1.0: Bringing Heterogeneous Tactile Sensing into World Action Modeling