mlsanityData to 14 Oct 2026

TacWAM: Anchor-Guided World Action Model with Mechanics-Aware Tactile Prediction

arXiv 2607.28391 ↗First posted 30 Jul 2026cs.ROcited by 3

On the map: World models → Embodied and robot world models

Abstract (arXiv)

World Action Models (WAMs) combine future-state prediction with robot action generation, but existing approaches largely rely on visual futures. Visual prediction captures scene structure and object motion, yet provides limited supervision for force, deformation, shear, and slip during contact-rich manipulation. This creates two design requirements: tactile futures should carry meaningful physical information, and they should not become privileged cues for action generation. We present TacWAM, a mechanics-aware tactile WAM that addresses this challenge in three steps. First, a Spatially Aligned Fusion (SAF) Tactile Encoder maps tactile appearance, dense force fields, and deformation flow into a shared latent prediction space, with bilateral force and torque reconstruction preserving global contact information. Second, a tactile history encoder provides temporal context so future tactile prediction reflects how force and deformation change beyond the current tactile observation. Third, Anchor-Guided Tri-Modal (AGT) Attention separates current visual and tactile anchors, future prediction tokens, and action tokens, allowing future tactile states to supervise training without being directly read by the action branch. We evaluate TacWAM on four real-world contact-rich manipulation tasks covering fragile grasping, sustained surface contact, and dynamic in-hand manipulation. TacWAM achieves an average success rate of 75.0%, exceeding the strongest evaluated baseline by 37.5 percentage points. Staged ablations show consistent degradation when tactile history is removed and access to future prediction targets is relaxed. These results indicate that future tactile supervision can improve contact-aware action learning when combined with informative tactile representations and deployment-consistent information constraints.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 24 of its 29 references that are in the map. First posted on arXiv 30 Jul 2026.

Builds on

24 of 29 references.

Closest ancestors · 10

Same direction, newest first

  1. 2026ViTacWorld: Scaling Visuo-Tactile World Models for Contact-Rich Robot Manipulation24 Jul
  2. 2026VT-WAM: Visual-Tactile World Action Model for Contact-Rich Manipulation2 Jul
  3. 2026Tactile-WAM: Touch-Aware World Action Model with Tactile Asymmetric Attention25 Jun
  4. 2026TacForeSight: Force-Guided Tactile World Model for Contact-Rich Manipulation9 Jun
  5. 2026AHA-WAM:Asynchronous Horizon-Adaptive World-Action Modeling with Observation-Guided Context Routing8 Jun
  6. 2026OA-WAM: Object-Addressable World Action Model for Robust Robot Manipulation7 May
  7. 2026Enhancing Policy Learning with World-Action Model30 Mar
  8. 2026OmniVTA: Visuo-Tactile World Modeling for Contact-Rich Robotic Manipulation19 Mar
  9. 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?17 Mar
  10. 2026Visuo-Tactile World Models5 Feb

Other references · 14

  1. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  2. 2025Reactive Diffusion Policy: Slow-Fast Visual-Tactile Policy Learning for Contact-Rich Manipulationcited by 108
  3. 2019Making Sense of Vision and Touch: Learning Multimodal Representations for Contact-Rich Taskscited by 84
  4. 2025VTLA: Vision-Tactile-Language-Action Model with Preference Learning for Insertion Manipulationcited by 55
  5. 2025ViTacFormer: Learning Cross-Modal Representation for Visuo-Tactile Dexterous Manipulationcited by 38
  6. 2025VLA-Touch: Enhancing Vision-Language-Action Models with Dual-Level Tactile Feedbackcited by 38
  7. 2024RoboPack: Learning Tactile-Informed Dynamics Models for Dense Packingcited by 19
  8. 2025Tactile-VLA: Unlocking Vision-Language-Action Model's Physical Knowledge for Tactile Generalizationcited by 19
  9. 2025Learning to Feel the Future: DreamTacVLA for Contact-Rich Manipulationcited by 18
  10. 2024Tac-Man: Tactile-Informed Prior-Free Manipulation of Articulated Objectscited by 9
  11. 2026TouchWorld: A Predictive and Reactive Tactile Foundation Model for Dexterous Manipulationcited by 9
  12. 2026N0-VTLA: Scaling Vision-Tactile-Language-Action Model with Latent Tactile Tokenscited by 6
2 more
  1. 2026Tactile-based Multimodal Fusion in Embodied Intelligence: A Survey of Vision, Language, and Contact-Driven Paradigmscited by 2
  2. 2026τ: Learning Touch-Augmented Vision-Language-Action Models from Future Visual Supervisioncited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026HiTac-WAM: A Hierarchical Tactile World Action Model for Contact-Rich Robot Manipulation
  2. 2026Agile-WAM: An Agile Tactile World Action Model for Contact-Rich Robot Control
  3. 2026N0-TWAM: Scaling Tactile-Native World-Action Model for Contact-Rich Manipulation
  4. 2026TacPAC: Tactile Prediction and Real-Time Action Correction in World-Action Models for Contact-Rich Manipulation
  5. 2026Representation-Aligned Tactile Grounding for Contact-Rich Robotic Manipulation ↗
  6. 2026HapticWAM: Distilling Imagined Touch into a World-Action Model without Inference-Time Tactile Sensing
  7. 2026Dream-Tac: A Unified Tactile World Action Model for Contact-Rich Robot Manipulation
  8. 2026ME-Dex 1.0: Bringing Heterogeneous Tactile Sensing into World Action Modeling