mlsanityData to 7 Oct 2026

TA-VLA: Elucidating the Design Space of Torque-aware Vision-Language-Action Models

arXiv 2509.07962 ↗First posted 9 Sep 2025cs.ROcited by 30

On the map: Vision-language-action models → Tactile, force-aware and humanoid VLA

Abstract (arXiv)

Many robotic manipulation tasks require sensing and responding to force signals such as torque to assess whether the task has been successfully completed and to enable closed-loop control. However, current Vision-Language-Action (VLA) models lack the ability to integrate such subtle physical feedback. In this work, we explore Torque-aware VLA models, aiming to bridge this gap by systematically studying the design space for incorporating torque signals into existing VLA architectures. We identify and evaluate several strategies, leading to three key findings. First, introducing torque adapters into the decoder consistently outperforms inserting them into the encoder.Third, inspired by joint prediction and planning paradigms in autonomous driving, we propose predicting torque as an auxiliary output, which further improves performance. This strategy encourages the model to build a physically grounded internal representation of interaction dynamics. Extensive quantitative and qualitative experiments across contact-rich manipulation benchmarks validate our findings.

Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). Placed in Tactile, force-aware and humanoid VLA, one of 13 directions in Vision-language-action models. Builds on 49 of its 54 references that are in the map. First posted on arXiv 9 Sep 2025.

Builds on

49 of 54 references.

References · 49

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2024The Llama 3 Herd of Modelscited by 14,192
  4. 2022Flow Matching for Generative Modelingcited by 5,426
  5. 2025Qwen2.5-VL Technical Reportcited by 5,418
  6. 2024Qwen2.5 Technical Reportcited by 4,713
  7. 2017Neural Discrete Representation Learningcited by 4,650
  8. 2024GPT-4o System Cardcited by 4,467
  9. 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
  10. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  11. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  12. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
37 more
  1. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  2. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  3. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
  4. 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
  5. 2024PaliGemma: A versatile 3B VLM for transfercited by 679
  6. 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
  7. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
  8. 2024DeepSeek LLM: Scaling Open-Source Language Models with Longtermismcited by 621
  9. 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
  10. 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 411
  11. 2023An Embodied Generalist Agent in 3D Worldcited by 355
  12. 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 344
  13. 2022Motion Transformer with Global Intention Localization and Local Movement Refinementcited by 267
  14. 2025HybridVLA: Collaborative Diffusion and Autoregression in a Unified Vision-Language-Action Modelcited by 176
  15. 2025Reactive Diffusion Policy: Slow-Fast Visual-Tactile Policy Learning for Contact-Rich Manipulationcited by 103
  16. 20243D-ViTac: Learning Fine-Grained Manipulation with Visuo-Tactile Sensingcited by 67
  17. 2025DiffVLA: Vision-Language Guided Diffusion Planning for Autonomous Drivingcited by 64
  18. 2025Impromptu VLA: Open Weights and Open Data for Driving Vision-Language-Action Modelscited by 60
  19. 2022Visuo-Tactile Transformers for Manipulationcited by 43
  20. 2024TOD3Cap: Towards 3D Dense Captioning in Outdoor Scenescited by 40
  21. 2024ForceMimic: Force-Centric Imitation Learning with Force-Motion Capture System for Contact-Rich Manipulationcited by 36
  22. 2024Adaptive Compliance Policy: Learning Approximate Compliance for Diffusion Guided Controlcited by 36
  23. 2024Hint-AD: Holistically Aligned Interpretability in End-to-End Autonomous Drivingcited by 33
  24. 2024FoAR: Force-Aware Reactive Policy for Contact-Rich Robotic Manipulationcited by 32
  25. 2025FACTR: Force-Attending Curriculum Training for Contact-Rich Policy Learningcited by 31
  26. 2022TOIST: Task Oriented Instance Segmentation Transformer with Noun-Pronoun Distillationcited by 25
  27. 2024TacDiffusion: Force-domain Diffusion Policy for Precise Tactile Manipulationcited by 23
  28. 2025DexForce: Extracting Force-informed Actions from Kinesthetic Demonstrations for Dexterous Manipulationcited by 21
  29. 2023Delving into Shape-aware Zero-shot Semantic Segmentationcited by 16
  30. 2025Chameleon: Fast-slow Neuro-symbolic Lane Topology Extractioncited by 16
  31. 2024Learning Variable Compliance Control From a Few Demonstrations for Bimanual Robot with Haptic Feedback Teleoperation Systemcited by 13
  32. 2024PreAfford: Universal Affordance-Based Pre-Grasping for Diverse Objects and Environmentscited by 11
  33. 2024Built Different: Tactile Perception to Overcome Cross-Embodiment Capability Differences in Collaborative Manipulationcited by 6
  34. 2024Learning Diffusion Policies from Demonstrations For Compliant Contact-rich Manipulationcited by 6
  35. 2024Haptic-ACT: Bridging Human Intuition with Compliant Robotic Manipulation via Immersive VRcited by 5
  36. 2025Bi-LAT: Bilateral Control-Based Imitation Learning via Natural Language and Action Chunking with Transformerscited by 5
  37. 2023Fine Robotic Manipulation without Force/Torque Sensorcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 4; 2026: 26.

30 papers.

Sort:

By area:

  1. 2026π0.7: a Steerable Generalist Robotic Foundation Model with Emergent Capabilitiescited by 127
  2. 2026MEM: Multi-Scale Embodied Memory for Vision Language Action Modelscited by 55
  3. 2026World Action Models: The Next Frontier in Embodied AIcited by 46
  4. 2025HiF-VLA: Hindsight, Insight and Foresight through Motion Representation for Vision-Language-Action Modelscited by 30
  5. 2026RLDX-1 Technical Reportcited by 25
  6. 2026Dream-Tac: A Unified Tactile World Action Model for Contact-Rich Robot Manipulationcited by 17
  7. 2026FD-VLA: Force-Distilled Vision-Language-Action Model for Contact-Rich Manipulationcited by 15
  8. 2026VTAM: Video-Tactile-Action Models for Complex Physical Interaction Beyond VLAscited by 14
  9. 2026TaF-VLA: Tactile-Force Alignment in Vision-Language-Action Models for Force-aware Manipulationcited by 11
  10. 2026AT-VLA: Adaptive Tactile Injection for Enhanced Feedback Reaction in Vision-Language-Action Modelscited by 9
  11. 2026Dexora: Open-source VLA for High-DoF Bimanual Dexteritycited by 9
  12. 2025ImplicitRDP: An End-to-End Visual-Force Diffusion Policy with Structural Slow-Fast Learningcited by 8
18 more
  1. 2026LIBERO-Safety: A Comprehensive Benchmark for Physical and Semantic Safety in Vision-Language-Action Modelscited by 8
  2. 2025FILIC: Dual-Loop Force-Guided Imitation Learning with Impedance Torque Control for Contact-Rich Manipulation Taskscited by 6
  3. 2026DAM-VLA: Decoupled Asynchronous Multimodal Vision Language Action modelcited by 6
  4. 2025An Anatomy of Vision-Language-Action Models: From Modules to Milestones and Challengescited by 4
  5. 2026TORL-VLA: Tactile Guided Online Reinforcement Learning for Contact-Rich Manipulationcited by 4
  6. 2026Towards Human-Like Manipulation through RL-Augmented Teleoperation and Mixture-of-Dexterous-Experts VLAcited by 3
  7. 2026Never Too Late for Force: Accelerating VLA Post-Training with Reactive Force Injectioncited by 3
  8. 2026Modular Sensory Stream for Integrating Physical Feedback in Vision-Language-Action Modelscited by 2
  9. 2026FM-VLA: Force-based Memory for Vision-Language-Action Models in Contact-Rich Manipulationcited by 2
  10. 2026PHR-VLA: Planning Horizon Reasoning for Vision-Language-Action Modelscited by 1
  11. 2026UniMem: Unifying Multimodal Memory and Control for Vision-Language-Action Modelscited by 0
  12. 2026ForceDelta-VLA: Distilling Force-Conditioned ActionCorrections for Contact-Rich Manipulationcited by 0
  13. 2026TAO-Force: Unifying Force-Aware Perception and Fast-Slow Control for Contact-Rich Manipulationcited by 0
  14. 2026CompVLA: A Variable Compliance Vision-Language-Action Model for Contact-rich Manipulationcited by 0
  15. 2026Opt2VLA: Force-Aware Vision-Language-Action for Contact-Rich Humanoid Whole-Body Manipulationcited by 0
  16. 2026Imagine-RL: Residual-Confidence-Guided Cross-Attention for World-Model-Augmented VLA Reinforcement Learningcited by 0
  17. 2026RoboFollow: Unveiling the Instruction Following Mirage in Embodied Agentscited by 0
  18. 2026Explore, Execute, Evolve: A Skill Acquisition and Reuse Loop for Embodied Agentscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026PhysVLA: Towards Physically-Grounded VLA for Embodied Robotic Manipulation
  2. 2025ForceVLA: Enhancing VLA Models with a Force-aware MoE for Contact-rich Manipulation
  3. 2026FAVLA: A Force-Adaptive Fast-Slow VLA model for Contact-Rich Robotic Manipulation
  4. 2026UniTacVLA: Unified Tactile Understanding and Prediction in Vision Language Action Models
  5. 2025Tactile-VLA: Unlocking Vision-Language-Action Model's Physical Knowledge for Tactile Generalization
  6. 2026FWBC-VLA: Force-Aware Whole-Body Compensation for Contact-Rich Loco-Manipulation
  7. 2025Efficient Vision-Language-Action Models for Embodied Manipulation: A Systematic Survey
  8. 2026CRAFT: Adapting VLA Models to Contact-rich Manipulation via Force-aware Curriculum Fine-tuning