mlsanityData to 7 Oct 2026

Uni-VLaT: Whole-Body Tactile Adaptation of VLA Policies for Humanoid Loco-Manipulation

arXiv 2609.35450 ↗First posted 28 Sep 2026cs.ROcited by 0

On the map: Vision-language-action models → Tactile, force-aware and humanoid VLA

Abstract (arXiv)

Physical contact often determines how a humanoid should respond during loco-manipulation, yet vision and proprioception alone are often insufficient to characterize physical interaction, especially when the contact region is occluded. Unlike sparse force or torque measurements at predefined regions, distributed tactile sensing preserves spatially resolved contact patterns across the robot body. We therefore study how to integrate such whole-body tactile information into vision-language-action (VLA) policies for contact-rich control. Our approach, Uni-VLaT, introduces a tactile pathway whose latent state is trained not only for action generation, but also to predict future tactile, proprioceptive, and visual representations. This predictive objective builds a tactile-anchored multimodal context, encouraging a more structured understanding of the physical world. We evaluate Uni-VLaT on five real-robot tasks covering tactile-triggered locomotion, sustained physical interaction, human-robot contact, and loco-manipulation. Uni-VLaT achieves a 75% average success rate, outperforming a baseline without tactile input by 43 points and a tactile-input baseline without predictive supervision by 7 points. Across two pretrained VLA backbones, our method improves Table Sweeping by 30 points on both backbones and Back-Tap Walking by 85-90 points. Ablations further show that contextualized tactile prediction and absolute future targets are critical to performance. These results indicate that predictive tactile learning provides an effective route for extending pretrained VLA policies to whole-body physical interaction.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Tactile, force-aware and humanoid VLA, one of 13 directions in Vision-language-action models. Builds on 52 of its 55 references that are in the map. First posted on arXiv 28 Sep 2026.

Builds on

52 of 55 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026OpenHLM: An Empirical Recipe for Whole-Body Humanoid Loco-Manipulation20 Jun
  2. 2026TacCoRL: Integrating Tactile Feedback into VLA via Simulation10 Jun
  3. 2026HapticVLA: Contact-Rich Manipulation via Vision-Language-Action Model without Inference-Time Tactile Sensing16 Mar
  4. 2025VLA-Touch: Enhancing Vision-Language-Action Models with Dual-Level Tactile Feedback23 Jul
  5. 2025LeVERB: Humanoid Whole-Body Control with Latent Vision-Language Instruction16 Jun

Other references · 47

  1. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  2. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  3. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
  4. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  5. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
  6. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
  7. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  8. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
  9. 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
  10. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
  11. 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 982
  12. 2022A Generalist Agentcited by 802
35 more
  1. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
  2. 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
  3. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
  4. 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 490
  5. 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 411
  6. 2024Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperationcited by 377
  7. 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planningcited by 357
  8. 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 285
  9. 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 274
  10. 2025DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledgecited by 203
  11. 2024OmniH2O: Universal and Dexterous Human-to-Humanoid Whole-Body Teleoperation and Learningcited by 167
  12. 2020DIGIT: A Novel Design for a Low-Cost Compact High-Resolution Tactile Sensor with Application to In-Hand Manipulationcited by 164
  13. 2024HumanPlus: Humanoid Shadowing and Imitation from Humanscited by 164
  14. 2023RoboCat: A Self-Improving Generalist Agent for Robotic Manipulationcited by 108
  15. 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Modelcited by 104
  16. 2026StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developingcited by 103
  17. 2024HumanoidBench: Simulated Humanoid Benchmark for Whole-Body Locomotion and Manipulationcited by 101
  18. 2022Touch and Go: Learning from Human-Collected Vision and Touchcited by 84
  19. 2025SONIC: Supersizing Motion Tracking for Natural Humanoid Whole-Body Controlcited by 83
  20. 2025ReconVLA: Reconstructive Vision-Language-Action Model as Effective Robot Perceivercited by 80
  21. 2024HOVER: Versatile Neural Whole-Body Controller for Humanoid Robotscited by 76
  22. 2026DiT4DiT: Jointly Modeling Video Dynamics and Actions for Generalizable Robot Controlcited by 71
  23. 2024Sparsh: Self-supervised touch representations for vision-based tactile sensingcited by 61
  24. 2020TACTO: A Fast, Flexible, and Open-source Simulator for High-Resolution Vision-based Tactile Sensorscited by 59
  25. 2025Humanoid-VLA: Towards Universal Humanoid Control with Visual Integrationcited by 43
  26. 2025Beyond Sight: Finetuning Generalist Robot Policies with Heterogeneous Sensors via Language Groundingcited by 40
  27. 2025WholeBodyVLA: Towards Unified Latent VLA for Whole-Body Loco-Manipulation Controlcited by 32
  28. 2026Dream-Tac: A Unified Tactile World Action Model for Contact-Rich Robot Manipulationcited by 17
  29. 2025ManiFeel: Benchmarking and Understanding Visuotactile Manipulation Policy Learningcited by 12
  30. 2026VT-WAM: Visual-Tactile World Action Model for Contact-Rich Manipulationcited by 10
  31. 2026Tactile-WAM: Touch-Aware World Action Model with Tactile Asymmetric Attentioncited by 9
  32. 2025TACT: Humanoid Whole-body Contact Manipulation through Deep Imitation Learning with Tactile Modalitycited by 6
  33. 2026Learning Versatile Humanoid Manipulation with Touch Dreamingcited by 3
  34. 2026TacWAM: Anchor-Guided World Action Model with Mechanics-Aware Tactile Predictioncited by 3
  35. 2026WT-UMI: Tactile-based Whole-Body Manipulation via Force-Supervised Contact-Aware Planningcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026UniTacVLA: Unified Tactile Understanding and Prediction in Vision Language Action Models
  2. 2026N0-VTLA: Scaling Vision-Tactile-Language-Action Model with Latent Tactile Tokens
  3. 2025Tactile-VLA: Unlocking Vision-Language-Action Model's Physical Knowledge for Tactile Generalization
  4. 2026ForeTac-VLA: A Forecasting-Based Tactile-Vision-Language-Action Model for Contact-Rich Robotic Manipulation
  5. 2025Humanoid Locomotion and Manipulation: Current Progress and Challenges in Control, Planning, and Learning
  6. 2026τ: Learning Touch-Augmented Vision-Language-Action Models from Future Visual Supervision
  7. 2026OpenViTac: Learning and Benchmarking Visuo-Tactile Policies in a Unified Sim-and-Real Framework ↗
  8. 2026FWBC-VLA: Force-Aware Whole-Body Compensation for Contact-Rich Loco-Manipulation