HapticVLA: Contact-Rich Manipulation via Vision-Language-Action Model without Inference-Time Tactile Sensing
On the map: Vision-language-action models → Tactile, force-aware and humanoid VLA
Abstract (arXiv)
Tactile sensing is a crucial capability for Vision-Language-Action (VLA) architectures, as it enables dexterous and safe manipulation in contact-rich tasks. However, reliance on dedicated tactile hardware increases cost and reduces reproducibility across robotic platforms. We argue that tactile-aware manipulation can be learned offline and deployed without direct haptic feedback at inference. To this end, we present HapticVLA, which proceeds in two tightly coupled stages: Safety-Aware Reward-Weighted Flow Matching (SA-RWFM) and Tactile Distillation (TD). SA-RWFM trains a flow-matching action expert that incorporates precomputed, safety-aware tactile rewards penalizing excessive grasping force and suboptimal grasping trajectories. TD further transfers this tactile-aware capability into a conventional VLA: we distill a compact tactile token from the SA-RWFM teacher and train a student VLA to predict that token from vision and state modalities, enabling tactile-aware action generation at inference without requiring on-board tactile sensors. This design preserves contact-rich tactile-aware reasoning within VLA while removing the need for on-board tactile sensors during deployment. On real-world experiments, HapticVLA achieves a mean success rate of 86.7%, consistently outperforming baseline VLAs - including versions provided with direct tactile feedback during inference.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Tactile, force-aware and humanoid VLA, one of 13 directions in Vision-language-action models. Builds on 31 of its 38 references that are in the map. First posted on arXiv 16 Mar 2026.
Builds on
31 of 38 references.
Closest ancestors · 5
Same direction, newest first
- 2026FD-VLA: Force-Distilled Vision-Language-Action Model for Contact-Rich Manipulation2 Feb
- 2026TaF-VLA: Tactile-Force Alignment in Vision-Language-Action Models for Force-aware Manipulation28 Jan
- 2025OmniVTLA: Vision-Tactile-Language-Action Models with Semantic-Aligned Tactile Sensing12 Aug
- 2025VLA-Touch: Enhancing Vision-Language-Action Models with Dual-Level Tactile Feedback23 Jul
- 2025ForceVLA: Enhancing VLA Models with a Force-aware MoE for Contact-rich Manipulation28 May
Other references · 26
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2019Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learningcited by 1,168
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
- 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 564
- 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 507
- 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 285
- 2025RoboBrain: A Unified Brain Model for Robotic Manipulation from Abstract to Concretecited by 134
- 2025ReinFlow: Fine-tuning Flow Matching Policy with Online Reinforcement Learningcited by 83
- 2025VTLA: Vision-Tactile-Language-Action Model with Preference Learning for Insertion Manipulationcited by 54
14 more
- 2025VLA-0: Building State-of-the-Art VLAs with Zero Modificationcited by 49
- 2025Beyond Sight: Finetuning Generalist Robot Policies with Heterogeneous Sensors via Language Groundingcited by 40
- 2025Online Reward-Weighted Fine-Tuning of Flow Matching with Wasserstein Regularizationcited by 40
- 2025FlowRL: Matching Reward Distributions for LLM Reasoningcited by 38
- 2025MoVE-KD: Knowledge Distillation for VLMs with Mixture of Visual Encoderscited by 25
- 2025MLA: A Multisensory Language-Action Model for Multimodal Understanding and Forecasting in Robotic Manipulationcited by 22
- 2025FedVLA: Federated Vision-Language-Action Learning with Dual Gating Mixture-of-Experts for Robotic Manipulationcited by 18
- 2025Reinforcement Learning for Flow-Matching Policiescited by 14
- 2025Balancing Signal and Variance: Adaptive Offline RL Post-Training for VLA Flow Modelscited by 14
- 2025FlowRAM: Grounding Flow Matching Policy with Region-Aware Mamba Framework for Robotic Manipulationcited by 13
- 2026DySL-VLA: Efficient Vision-Language-Action Model Inference via Dynamic-Static Layer-Skipping for Robot Manipulationcited by 8
- 2025ActDistill: General Action-Guided Self-Derived Distillation for Efficient Vision-Language-Action Modelscited by 4
- 2024Low Fidelity Visuo-Tactile Pretraining Improves Vision-Only Manipulation Performancecited by 3
- 2026X-Distill: Cross-Architecture Vision Distillation for Visuomotor Learningcited by 2
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026TORL-VLA: Tactile Guided Online Reinforcement Learning for Contact-Rich Manipulationcited by 4
- 2026Human-Centric Transferable Tactile Pre-Training for Dexterous Robotic Manipulationcited by 4
- 2026TacCoRL: Integrating Tactile Feedback into VLA via Simulationcited by 3
- 2026FM-VLA: Force-based Memory for Vision-Language-Action Models in Contact-Rich Manipulationcited by 2
- 2026SpaceVLA: Spatially Grounded VLA for Robotic Manipulation with User-Authored Grasp and Place Anchorscited by 0
- 2026PhaseLoRA: Control-Regime-Conditioned Low-Rank Adaptation for Continuous-Action Vision-Language-Action Policiescited by 0
- 2026VT-Bridge: Bridging Pretrained Foundation VLAs to VTLAs via Lightweight Residual Adaptationcited by 0
- 2026HapticWAM: Distilling Imagined Touch into a World-Action Model without Inference-Time Tactile Sensingcited by 0
- 2026Uni-VLaT: Whole-Body Tactile Adaptation of VLA Policies for Humanoid Loco-Manipulationcited by 0
- 2026Uni-VLaT: Whole-Body Tactile Adaptation of VLA Policies for Humanoid Loco-Manipulation28 Sep 2026
- 2026HapticWAM: Distilling Imagined Touch into a World-Action Model without Inference-Time Tactile Sensing20 Sep 2026
- 2026VT-Bridge: Bridging Pretrained Foundation VLAs to VTLAs via Lightweight Residual Adaptation18 Sep 2026
- 2026PhaseLoRA: Control-Regime-Conditioned Low-Rank Adaptation for Continuous-Action Vision-Language-Action Policies15 Aug 2026
- 2026SpaceVLA: Spatially Grounded VLA for Robotic Manipulation with User-Authored Grasp and Place Anchors6 Aug 2026
- 2026FM-VLA: Force-based Memory for Vision-Language-Action Models in Contact-Rich Manipulation20 Jul 2026
- 2026Human-Centric Transferable Tactile Pre-Training for Dexterous Robotic Manipulation1 Jul 2026
- 2026TacCoRL: Integrating Tactile Feedback into VLA via Simulation10 Jun 2026
- 2026TORL-VLA: Tactile Guided Online Reinforcement Learning for Contact-Rich Manipulation8 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026UniTacVLA: Unified Tactile Understanding and Prediction in Vision Language Action Models
- 2026TacVLA: Contact-Aware Tactile Fusion for Robust Vision-Language-Action Manipulation
- 2026τ: Learning Touch-Augmented Vision-Language-Action Models from Future Visual Supervision
- 2026SimpleTouch: Can Vision-Language-Action Models Master Contact-Rich Manipulation Without Tactile Policy Pretraining?
- 2025Tactile-VLA: Unlocking Vision-Language-Action Model's Physical Knowledge for Tactile Generalization
- 2026TouchWorld: A Predictive and Reactive Tactile Foundation Model for Dexterous Manipulation
- 2025TLA: Tactile-Language-Action Model for Contact-Rich Manipulation
- 2026HapTile: A Haptic-Informed Vision-Tactile-Language-Action Dataset for Contact-Rich Imitation Learning