TA-VLA: Elucidating the Design Space of Torque-aware Vision-Language-Action Models
On the map: Vision-language-action models → Tactile, force-aware and humanoid VLA
Abstract (arXiv)
Many robotic manipulation tasks require sensing and responding to force signals such as torque to assess whether the task has been successfully completed and to enable closed-loop control. However, current Vision-Language-Action (VLA) models lack the ability to integrate such subtle physical feedback. In this work, we explore Torque-aware VLA models, aiming to bridge this gap by systematically studying the design space for incorporating torque signals into existing VLA architectures. We identify and evaluate several strategies, leading to three key findings. First, introducing torque adapters into the decoder consistently outperforms inserting them into the encoder.Third, inspired by joint prediction and planning paradigms in autonomous driving, we propose predicting torque as an auxiliary output, which further improves performance. This strategy encourages the model to build a physically grounded internal representation of interaction dynamics. Extensive quantitative and qualitative experiments across contact-rich manipulation benchmarks validate our findings.
Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). Placed in Tactile, force-aware and humanoid VLA, one of 13 directions in Vision-language-action models. Builds on 49 of its 54 references that are in the map. First posted on arXiv 9 Sep 2025.
Builds on
49 of 54 references.
References · 49
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2023GPT-4 Technical Reportcited by 18,132
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2017Neural Discrete Representation Learningcited by 4,650
- 2024GPT-4o System Cardcited by 4,467
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
37 more
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2024PaliGemma: A versatile 3B VLM for transfercited by 679
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
- 2024DeepSeek LLM: Scaling Open-Source Language Models with Longtermismcited by 621
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 411
- 2023An Embodied Generalist Agent in 3D Worldcited by 355
- 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 344
- 2022Motion Transformer with Global Intention Localization and Local Movement Refinementcited by 267
- 2025HybridVLA: Collaborative Diffusion and Autoregression in a Unified Vision-Language-Action Modelcited by 176
- 2025Reactive Diffusion Policy: Slow-Fast Visual-Tactile Policy Learning for Contact-Rich Manipulationcited by 103
- 20243D-ViTac: Learning Fine-Grained Manipulation with Visuo-Tactile Sensingcited by 67
- 2025DiffVLA: Vision-Language Guided Diffusion Planning for Autonomous Drivingcited by 64
- 2025Impromptu VLA: Open Weights and Open Data for Driving Vision-Language-Action Modelscited by 60
- 2022Visuo-Tactile Transformers for Manipulationcited by 43
- 2024TOD3Cap: Towards 3D Dense Captioning in Outdoor Scenescited by 40
- 2024ForceMimic: Force-Centric Imitation Learning with Force-Motion Capture System for Contact-Rich Manipulationcited by 36
- 2024Adaptive Compliance Policy: Learning Approximate Compliance for Diffusion Guided Controlcited by 36
- 2024Hint-AD: Holistically Aligned Interpretability in End-to-End Autonomous Drivingcited by 33
- 2024FoAR: Force-Aware Reactive Policy for Contact-Rich Robotic Manipulationcited by 32
- 2025FACTR: Force-Attending Curriculum Training for Contact-Rich Policy Learningcited by 31
- 2022TOIST: Task Oriented Instance Segmentation Transformer with Noun-Pronoun Distillationcited by 25
- 2024TacDiffusion: Force-domain Diffusion Policy for Precise Tactile Manipulationcited by 23
- 2025DexForce: Extracting Force-informed Actions from Kinesthetic Demonstrations for Dexterous Manipulationcited by 21
- 2023Delving into Shape-aware Zero-shot Semantic Segmentationcited by 16
- 2025Chameleon: Fast-slow Neuro-symbolic Lane Topology Extractioncited by 16
- 2024Learning Variable Compliance Control From a Few Demonstrations for Bimanual Robot with Haptic Feedback Teleoperation Systemcited by 13
- 2024PreAfford: Universal Affordance-Based Pre-Grasping for Diverse Objects and Environmentscited by 11
- 2024Built Different: Tactile Perception to Overcome Cross-Embodiment Capability Differences in Collaborative Manipulationcited by 6
- 2024Learning Diffusion Policies from Demonstrations For Compliant Contact-rich Manipulationcited by 6
- 2024Haptic-ACT: Bridging Human Intuition with Compliant Robotic Manipulation via Immersive VRcited by 5
- 2025Bi-LAT: Bilateral Control-Based Imitation Learning via Natural Language and Action Chunking with Transformerscited by 5
- 2023Fine Robotic Manipulation without Force/Torque Sensorcited by 1
Built on by
Citing papers per year: 2025: 4; 2026: 26.
30 papers.
Sort:
By area:
- 2026π0.7: a Steerable Generalist Robotic Foundation Model with Emergent Capabilitiescited by 127
- 2026MEM: Multi-Scale Embodied Memory for Vision Language Action Modelscited by 55
- 2026World Action Models: The Next Frontier in Embodied AIcited by 46
- 2025HiF-VLA: Hindsight, Insight and Foresight through Motion Representation for Vision-Language-Action Modelscited by 30
- 2026RLDX-1 Technical Reportcited by 25
- 2026Dream-Tac: A Unified Tactile World Action Model for Contact-Rich Robot Manipulationcited by 17
- 2026FD-VLA: Force-Distilled Vision-Language-Action Model for Contact-Rich Manipulationcited by 15
- 2026VTAM: Video-Tactile-Action Models for Complex Physical Interaction Beyond VLAscited by 14
- 2026TaF-VLA: Tactile-Force Alignment in Vision-Language-Action Models for Force-aware Manipulationcited by 11
- 2026AT-VLA: Adaptive Tactile Injection for Enhanced Feedback Reaction in Vision-Language-Action Modelscited by 9
- 2026Dexora: Open-source VLA for High-DoF Bimanual Dexteritycited by 9
- 2025ImplicitRDP: An End-to-End Visual-Force Diffusion Policy with Structural Slow-Fast Learningcited by 8
18 more
- 2026LIBERO-Safety: A Comprehensive Benchmark for Physical and Semantic Safety in Vision-Language-Action Modelscited by 8
- 2025FILIC: Dual-Loop Force-Guided Imitation Learning with Impedance Torque Control for Contact-Rich Manipulation Taskscited by 6
- 2026DAM-VLA: Decoupled Asynchronous Multimodal Vision Language Action modelcited by 6
- 2025An Anatomy of Vision-Language-Action Models: From Modules to Milestones and Challengescited by 4
- 2026TORL-VLA: Tactile Guided Online Reinforcement Learning for Contact-Rich Manipulationcited by 4
- 2026Towards Human-Like Manipulation through RL-Augmented Teleoperation and Mixture-of-Dexterous-Experts VLAcited by 3
- 2026Never Too Late for Force: Accelerating VLA Post-Training with Reactive Force Injectioncited by 3
- 2026Modular Sensory Stream for Integrating Physical Feedback in Vision-Language-Action Modelscited by 2
- 2026FM-VLA: Force-based Memory for Vision-Language-Action Models in Contact-Rich Manipulationcited by 2
- 2026PHR-VLA: Planning Horizon Reasoning for Vision-Language-Action Modelscited by 1
- 2026UniMem: Unifying Multimodal Memory and Control for Vision-Language-Action Modelscited by 0
- 2026ForceDelta-VLA: Distilling Force-Conditioned ActionCorrections for Contact-Rich Manipulationcited by 0
- 2026TAO-Force: Unifying Force-Aware Perception and Fast-Slow Control for Contact-Rich Manipulationcited by 0
- 2026CompVLA: A Variable Compliance Vision-Language-Action Model for Contact-rich Manipulationcited by 0
- 2026Opt2VLA: Force-Aware Vision-Language-Action for Contact-Rich Humanoid Whole-Body Manipulationcited by 0
- 2026Imagine-RL: Residual-Confidence-Guided Cross-Attention for World-Model-Augmented VLA Reinforcement Learningcited by 0
- 2026RoboFollow: Unveiling the Instruction Following Mirage in Embodied Agentscited by 0
- 2026Explore, Execute, Evolve: A Skill Acquisition and Reuse Loop for Embodied Agentscited by 0
- 2026Explore, Execute, Evolve: A Skill Acquisition and Reuse Loop for Embodied Agents29 Sep 2026
- 2026RoboFollow: Unveiling the Instruction Following Mirage in Embodied Agents22 Sep 2026
- 2026Imagine-RL: Residual-Confidence-Guided Cross-Attention for World-Model-Augmented VLA Reinforcement Learning21 Sep 2026
- 2026Opt2VLA: Force-Aware Vision-Language-Action for Contact-Rich Humanoid Whole-Body Manipulation21 Sep 2026
- 2026CompVLA: A Variable Compliance Vision-Language-Action Model for Contact-rich Manipulation20 Sep 2026
- 2026TAO-Force: Unifying Force-Aware Perception and Fast-Slow Control for Contact-Rich Manipulation16 Sep 2026
- 2026ForceDelta-VLA: Distilling Force-Conditioned ActionCorrections for Contact-Rich Manipulation16 Sep 2026
- 2026PHR-VLA: Planning Horizon Reasoning for Vision-Language-Action Models27 Aug 2026
- 2026UniMem: Unifying Multimodal Memory and Control for Vision-Language-Action Models24 Aug 2026
- 2026FM-VLA: Force-based Memory for Vision-Language-Action Models in Contact-Rich Manipulation20 Jul 2026
- 2026Never Too Late for Force: Accelerating VLA Post-Training with Reactive Force Injection15 Jul 2026
- 2026LIBERO-Safety: A Comprehensive Benchmark for Physical and Semantic Safety in Vision-Language-Action Models22 Jun 2026
18 more
- 2026DAM-VLA: Decoupled Asynchronous Multimodal Vision Language Action model10 Jun 2026
- 2026TORL-VLA: Tactile Guided Online Reinforcement Learning for Contact-Rich Manipulation8 Jun 2026
- 2026Dream-Tac: A Unified Tactile World Action Model for Contact-Rich Robot Manipulation7 Jun 2026
- 2026Dexora: Open-source VLA for High-DoF Bimanual Dexterity18 May 2026
- 2026World Action Models: The Next Frontier in Embodied AI12 May 2026
- 2026AT-VLA: Adaptive Tactile Injection for Enhanced Feedback Reaction in Vision-Language-Action Models8 May 2026
- 2026RLDX-1 Technical Report5 May 2026
- 2026Modular Sensory Stream for Integrating Physical Feedback in Vision-Language-Action Models25 Apr 2026
- 2026π0.7: a Steerable Generalist Robotic Foundation Model with Emergent Capabilities16 Apr 2026
- 2026VTAM: Video-Tactile-Action Models for Complex Physical Interaction Beyond VLAs24 Mar 2026
- 2026Towards Human-Like Manipulation through RL-Augmented Teleoperation and Mixture-of-Dexterous-Experts VLA9 Mar 2026
- 2026MEM: Multi-Scale Embodied Memory for Vision Language Action Models4 Mar 2026
- 2026FD-VLA: Force-Distilled Vision-Language-Action Model for Contact-Rich Manipulation2 Feb 2026
- 2026TaF-VLA: Tactile-Force Alignment in Vision-Language-Action Models for Force-aware Manipulation28 Jan 2026
- 2025An Anatomy of Vision-Language-Action Models: From Modules to Milestones and Challenges12 Dec 2025
- 2025ImplicitRDP: An End-to-End Visual-Force Diffusion Policy with Structural Slow-Fast Learning11 Dec 2025
- 2025HiF-VLA: Hindsight, Insight and Foresight through Motion Representation for Vision-Language-Action Models10 Dec 2025
- 2025FILIC: Dual-Loop Force-Guided Imitation Learning with Impedance Torque Control for Contact-Rich Manipulation Tasks21 Sep 2025
- 2026MEM: Multi-Scale Embodied Memory for Vision Language Action Modelscited by 55
- 2025HiF-VLA: Hindsight, Insight and Foresight through Motion Representation for Vision-Language-Action Modelscited by 30
- 2026RLDX-1 Technical Reportcited by 25
- 2026FD-VLA: Force-Distilled Vision-Language-Action Model for Contact-Rich Manipulationcited by 15
- 2026TaF-VLA: Tactile-Force Alignment in Vision-Language-Action Models for Force-aware Manipulationcited by 11
- 2026AT-VLA: Adaptive Tactile Injection for Enhanced Feedback Reaction in Vision-Language-Action Modelscited by 9
- 2026Dexora: Open-source VLA for High-DoF Bimanual Dexteritycited by 9
- 2026LIBERO-Safety: A Comprehensive Benchmark for Physical and Semantic Safety in Vision-Language-Action Modelscited by 8
- 2025An Anatomy of Vision-Language-Action Models: From Modules to Milestones and Challengescited by 4
- 2026TORL-VLA: Tactile Guided Online Reinforcement Learning for Contact-Rich Manipulationcited by 4
- 2026Towards Human-Like Manipulation through RL-Augmented Teleoperation and Mixture-of-Dexterous-Experts VLAcited by 3
- 2026Never Too Late for Force: Accelerating VLA Post-Training with Reactive Force Injectioncited by 3
12 most cited of 20 All 20 (JSON)
- 2026Opt2VLA: Force-Aware Vision-Language-Action for Contact-Rich Humanoid Whole-Body Manipulation21 Sep 2026
- 2026CompVLA: A Variable Compliance Vision-Language-Action Model for Contact-rich Manipulation20 Sep 2026
- 2026TAO-Force: Unifying Force-Aware Perception and Fast-Slow Control for Contact-Rich Manipulation16 Sep 2026
- 2026ForceDelta-VLA: Distilling Force-Conditioned ActionCorrections for Contact-Rich Manipulation16 Sep 2026
- 2026PHR-VLA: Planning Horizon Reasoning for Vision-Language-Action Models27 Aug 2026
- 2026UniMem: Unifying Multimodal Memory and Control for Vision-Language-Action Models24 Aug 2026
- 2026FM-VLA: Force-based Memory for Vision-Language-Action Models in Contact-Rich Manipulation20 Jul 2026
- 2026Never Too Late for Force: Accelerating VLA Post-Training with Reactive Force Injection15 Jul 2026
- 2026LIBERO-Safety: A Comprehensive Benchmark for Physical and Semantic Safety in Vision-Language-Action Models22 Jun 2026
- 2026TORL-VLA: Tactile Guided Online Reinforcement Learning for Contact-Rich Manipulation8 Jun 2026
- 2026Dexora: Open-source VLA for High-DoF Bimanual Dexterity18 May 2026
- 2026AT-VLA: Adaptive Tactile Injection for Enhanced Feedback Reaction in Vision-Language-Action Models8 May 2026
12 newest of 20 All 20 (JSON)
- 2026World Action Models: The Next Frontier in Embodied AIcited by 46
- 2026Dream-Tac: A Unified Tactile World Action Model for Contact-Rich Robot Manipulationcited by 17
- 2026VTAM: Video-Tactile-Action Models for Complex Physical Interaction Beyond VLAscited by 14
- 2026Imagine-RL: Residual-Confidence-Guided Cross-Attention for World-Model-Augmented VLA Reinforcement Learningcited by 0
- 2026Explore, Execute, Evolve: A Skill Acquisition and Reuse Loop for Embodied Agentscited by 0
- 2026Explore, Execute, Evolve: A Skill Acquisition and Reuse Loop for Embodied Agents29 Sep 2026
- 2026Imagine-RL: Residual-Confidence-Guided Cross-Attention for World-Model-Augmented VLA Reinforcement Learning21 Sep 2026
- 2026Dream-Tac: A Unified Tactile World Action Model for Contact-Rich Robot Manipulation7 Jun 2026
- 2026World Action Models: The Next Frontier in Embodied AI12 May 2026
- 2026VTAM: Video-Tactile-Action Models for Complex Physical Interaction Beyond VLAs24 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2026PhysVLA: Towards Physically-Grounded VLA for Embodied Robotic Manipulation
- 2025ForceVLA: Enhancing VLA Models with a Force-aware MoE for Contact-rich Manipulation
- 2026FAVLA: A Force-Adaptive Fast-Slow VLA model for Contact-Rich Robotic Manipulation
- 2026UniTacVLA: Unified Tactile Understanding and Prediction in Vision Language Action Models
- 2025Tactile-VLA: Unlocking Vision-Language-Action Model's Physical Knowledge for Tactile Generalization
- 2026FWBC-VLA: Force-Aware Whole-Body Compensation for Contact-Rich Loco-Manipulation
- 2025Efficient Vision-Language-Action Models for Embodied Manipulation: A Systematic Survey
- 2026CRAFT: Adapting VLA Models to Contact-rich Manipulation via Force-aware Curriculum Fine-tuning