TacForeSight: Force-Guided Tactile World Model for Contact-Rich Manipulation
On the map: World models → Embodied and robot world models
Abstract (arXiv)
Contact-rich manipulation requires robots to continuously perceive and regulate evolving physical interactions under dynamic contact transitions or complex surface geometries. Recent imitation learning methods improve contact-aware control by incorporating tactile or force feedback, but they rarely model the asymmetric spatiotemporal roles of global force and local tactile sensing. To address this, we propose TacForeSight, a lightweight force-conditioned tactile foresight framework for real-time manipulation. The core component is TacForceWM, a tactile world model that predicts short-horizon tactile latent dynamics from dual-finger tactile observations conditioned on high-frequency wrist force and torque signals. Another key component, the Predictive Tactile-Conditioned Policy, leverages the predicted latents as anticipatory contact priors, models the current-to-future tactile evolution via cross-attention, and adaptively fuses visuo-tactile features through a tactile-guided gating module. By forecasting purely within a compact latent space, TacForeSight enables proactive contact reasoning with efficient real-time inference suitable for high-frequency manipulation control. Real-robot experiments on five representative tasks and three in-process perturbation settings show that TacForeSight consistently outperforms existing baselines, particularly under dynamic contact disturbances. All models and datasets will be made publicly available on the project website at https://tacforesight.github.io/ProjectPage.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 20 of its 39 references that are in the map. First posted on arXiv 9 Jun 2026.
Builds on
20 of 39 references.
Closest ancestors · 5
Same direction, newest first
- 2026OmniVTA: Visuo-Tactile World Modeling for Contact-Rich Robotic Manipulation19 Mar
- 2026Visuo-Tactile World Models5 Feb
- 2026Causal World Modeling for Robot Control29 Jan
- 2024RoboDreamer: Learning Compositional World Models for Robot Imagination18 Apr
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusion7 Mar
Other references · 15
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2022DayDreamer: World Models for Physical Robot Learningcited by 400
- 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 300
- 2026LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixelscited by 273
- 2025World4Drive: End-to-End Autonomous Driving via Intention-aware Physical Latent World Modelcited by 95
- 2025ForceVLA: Enhancing VLA Models with a Force-aware MoE for Contact-rich Manipulationcited by 91
- 2025VLA-Touch: Enhancing Vision-Language-Action Models with Dual-Level Tactile Feedbackcited by 38
- 2025MLA: A Multisensory Language-Action Model for Multimodal Understanding and Forecasting in Robotic Manipulationcited by 23
- 2026ForceVLA2: Unleashing Hybrid Force-Position Control with Force Awareness for Contact-Rich Manipulationcited by 22
- 2026TacVLA: Contact-Aware Tactile Fusion for Robust Vision-Language-Action Manipulationcited by 19
Built on by
Citing papers per year: 2026: 11.
11 papers.
- 2026ViTacWorld: Scaling Visuo-Tactile World Models for Contact-Rich Robot Manipulationcited by 5
- 2026TacWAM: Anchor-Guided World Action Model with Mechanics-Aware Tactile Predictioncited by 3
- 2026N0-TWAM: Scaling Tactile-Native World-Action Model for Contact-Rich Manipulationcited by 2
- 2026TacForcing: Streaming Action Generation with Execution-Time Tactile Feedbackcited by 2
- 2026TacPAC: Tactile Prediction and Real-Time Action Correction in World-Action Models for Contact-Rich Manipulationcited by 2
- 2026TACO: TActile World Model as a Self-COrrector for Scalable Robot Policy Post-Trainingcited by 1
- 2026Learning Physical Interaction: A Survey of Tactile- and Force-aware Robot Learningcited by 1
- 2026Disentangling Visuo-Tactile Foresight: Oracle-Guided Interface Discovery for World Action Modelscited by 0
- 2026VT-MUSE: Multimodal Unified Sequential Visuotactile Representation Learning for Manipulationcited by 0
- 2026HapticWAM: Distilling Imagined Touch into a World-Action Model without Inference-Time Tactile Sensingcited by 0
- 2026TacDyn-WAM: Learning Implicit Tactile Dynamics in a Heterogeneous Visuo-Tactile World Action Modelcited by 0
- 2026TacDyn-WAM: Learning Implicit Tactile Dynamics in a Heterogeneous Visuo-Tactile World Action Model30 Sep 2026
- 2026HapticWAM: Distilling Imagined Touch into a World-Action Model without Inference-Time Tactile Sensing20 Sep 2026
- 2026TacPAC: Tactile Prediction and Real-Time Action Correction in World-Action Models for Contact-Rich Manipulation4 Sep 2026
- 2026TacForcing: Streaming Action Generation with Execution-Time Tactile Feedback26 Aug 2026
- 2026VT-MUSE: Multimodal Unified Sequential Visuotactile Representation Learning for Manipulation21 Aug 2026
- 2026Learning Physical Interaction: A Survey of Tactile- and Force-aware Robot Learning2 Aug 2026
- 2026Disentangling Visuo-Tactile Foresight: Oracle-Guided Interface Discovery for World Action Models1 Aug 2026
- 2026TacWAM: Anchor-Guided World Action Model with Mechanics-Aware Tactile Prediction30 Jul 2026
- 2026N0-TWAM: Scaling Tactile-Native World-Action Model for Contact-Rich Manipulation26 Jul 2026
- 2026ViTacWorld: Scaling Visuo-Tactile World Models for Contact-Rich Robot Manipulation24 Jul 2026
- 2026TACO: TActile World Model as a Self-COrrector for Scalable Robot Policy Post-Training3 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026TouchWorld: A Predictive and Reactive Tactile Foundation Model for Dexterous Manipulation
- 2026HiTac-WAM: A Hierarchical Tactile World Action Model for Contact-Rich Robot Manipulation
- 2026Dream-Tac: A Unified Tactile World Action Model for Contact-Rich Robot Manipulation
- 2026Tactile-Guided Robot Learning: From Representation Learning to Foundation Models ↗
- 2026Contact-Grounded Policy: Dexterous Visuotactile Policy with Generative Contact Grounding
- 2026Representation-Aligned Tactile Grounding for Contact-Rich Robotic Manipulation ↗
- 2026ForeTac: Predictive Contact Guidance for Generative Robot Policies
- 2026ForeTac-VLA: A Forecasting-Based Tactile-Vision-Language-Action Model for Contact-Rich Robotic Manipulation