Compact Visuotactile World Models for Lifting: Prediction, Reward Alignment, and Force Constraints
On the map: World models → Embodied and robot world models
Abstract (arXiv)
Accurate tactile forecasts need not improve force-constrained control. We study a 652,157-parameter action-conditioned visuotactile world model with matched behavior cloning, policy learning in imagination, independent reactive implicit Q-learning, and model-assisted force feedback. A fixed protocol executes 34 policies on 120 fresh MuJoCo environments spanning geometry and physical-parameter shifts, plus 324 independently replayed action branches on 12 additional ID environments. Visuotactile dynamics reduce force action-effect MAE from 0.413 N for persistence to 0.338 N. Model-assisted feedback raises ID force-budgeted success from 73.3% to 93.3%, with paired difference +20.0 [+6.7,+33.4] percentage points (95% CI), with the difference occurring during scripted lowering. Its pooled difference is +3.9 [-4.5,+11.7] points. Imagined RL achieves 11.9% pooled joint success versus 25.0% for reactive IQL. An empirical tactile-residual stress test adds 330 executions. The evidence concerns rigid-box lifting after a common approach, without physical-robot transfer or a closed-loop safety guarantee.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 11 of its 14 references that are in the map. First posted on arXiv 9 Sep 2026.
Builds on
11 of 14 references.
Closest ancestors · 3
Same direction, newest first
- 2026FeelWorld: Visuo-Tactile World Model for Hierarchical Contact Prediction and Planning27 Jul
- 2026OmniVTA: Visuo-Tactile World Modeling for Contact-Rich Robotic Manipulation19 Mar
- 2026Visuo-Tactile World Models5 Feb
Other references · 8
- 2021Offline Reinforcement Learning with Implicit Q-Learningcited by 1,293
- 2023TD-MPC2: Scalable, Robust World Models for Continuous Controlcited by 512
- 2020robosuite: A Modular Simulation Framework and Benchmark for Robot Learningcited by 511
- 2020The Value Equivalence Principle for Model-Based Reinforcement Learningcited by 94
- 2024Sparsh: Self-supervised touch representations for vision-based tactile sensingcited by 64
- 2023Conformal Decision Theory: Safe Autonomous Decisions from Imperfect Predictionscited by 50
- 2019Manipulation by Feel: Touch-Based Control with Deep Predictive Modelscited by 36
- 2024FeelAnyForce: Estimating Contact Force Feedback from Tactile Sensation for Vision-Based Tactile Sensorscited by 11
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026TacDyn-WAM: Learning Implicit Tactile Dynamics in a Heterogeneous Visuo-Tactile World Action Model
- 2026OpenViTac: Learning and Benchmarking Visuo-Tactile Policies in a Unified Sim-and-Real Framework ↗
- 2026Dream-Tac: A Unified Tactile World Action Model for Contact-Rich Robot Manipulation
- 2026ViTacWorld: Scaling Visuo-Tactile World Models for Contact-Rich Robot Manipulation
- 2026TouchWorld: A Predictive and Reactive Tactile Foundation Model for Dexterous Manipulation
- 2026Disentangling Visuo-Tactile Foresight: Oracle-Guided Interface Discovery for World Action Models
- 2026HiTac-WAM: A Hierarchical Tactile World Action Model for Contact-Rich Robot Manipulation
- 2026ForeTac-VLA: A Forecasting-Based Tactile-Vision-Language-Action Model for Contact-Rich Robotic Manipulation