Opt2VLA: Force-Aware Vision-Language-Action for Contact-Rich Humanoid Whole-Body Manipulation
On the map: Vision-language-action models → Tactile, force-aware and humanoid VLA
Abstract (arXiv)
Humanoid robots are expected to perform diverse human-level tasks in daily environments, many of which require precise regulation of interaction forces. While recent vision-language-action (VLA) models have shown promise for semantic planning and visuomotor control, existing humanoid systems primarily represent actions through geometric motion goals and rely on whole-body controllers focused on motion tracking, with limited explicit reasoning or control of interaction forces. This limitation is particularly relevant in contact-rich tasks, where geometrically similar motions may require different force regimes depending on the task context and where visual observations may become unreliable after contact. In this work, we present Opt2VLA, a force-aware VLA framework that introduces explicit force commands at the VLA-to-control interface for humanoid whole-body manipulation. A single multi-task VLA policy jointly predicts both geometric motion goals and continuous contact-force references, which are tracked by task-specific reinforcement learning (RL)-based whole-body controllers. To provide scalable and physically grounded supervision, we generate dynamically feasible and contact-consistent training data via whole-body trajectory optimization (TO) with explicit force references. We evaluate Opt2VLA on three contact-rich humanoid tasks and show that explicit force conditioning enables more accurate and consistent force regulation than motion-only control, while physically grounded torque supervision from TO further improves force tracking accuracy and stability. Closed-loop evaluations further demonstrate language-conditioned force modulation with Opt2VLA in simulation and on humanoid hardware.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Tactile, force-aware and humanoid VLA, one of 13 directions in Vision-language-action models. Builds on 37 of its 43 references that are in the map. First posted on arXiv 21 Sep 2026.
Builds on
37 of 43 references.
Closest ancestors · 3
Same direction, newest first
- 2025TA-VLA: Elucidating the Design Space of Torque-aware Vision-Language-Action Models9 Sep
- 2025LeVERB: Humanoid Whole-Body Control with Latent Vision-Language Instruction16 Jun
- 2025ForceVLA: Enhancing VLA Models with a Force-aware MoE for Contact-rich Manipulation28 May
Other references · 34
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2025π*0.6: a VLA That Learns From Experiencecited by 280
- 2017Asymmetric Actor Critic for Image-Based Robot Learningcited by 202
- 2024HumanPlus: Humanoid Shadowing and Imitation from Humanscited by 164
- 2023Real-World Humanoid Locomotion with Reinforcement Learningcited by 132
- 2024Expressive Whole-Body Control for Humanoid Robotscited by 117
- 2024Learning Human-to-Humanoid Real-Time Whole-Body Teleoperationcited by 112
- 2025SONIC: Supersizing Motion Tracking for Natural Humanoid Whole-Body Controlcited by 83
- 2025Humanoid Locomotion and Manipulation: Current Progress and Challenges in Control, Planning, and Learningcited by 52
- 2025Humanoid-VLA: Towards Universal Humanoid Control with Visual Integrationcited by 43
22 more
- 2023DTC: Deep Tracking Controlcited by 37
- 2025WholeBodyVLA: Towards Unified Latent VLA for Whole-Body Loco-Manipulation Controlcited by 32
- 2023Sim-to-Real Learning for Humanoid Box Loco-Manipulationcited by 30
- 2019Crocoddyl: An Efficient and Versatile Framework for Multi-Contact Optimal Controlcited by 29
- 2024Opt2Skill: Imitating Dynamically-feasible Whole-Body Trajectories for Versatile Humanoid Loco-Manipulationcited by 28
- 2022Optimization-Based Control for Dynamic Legged Robotscited by 21
- 2025Being-0: A Humanoid Robotic Agent with Vision-Language Models and Modular Skillscited by 21
- 2022OPT-Mimic: Imitation of Optimized Trajectories for Dynamic Quadruped Behaviorscited by 19
- 2024HumanVLA: Towards Vision-Language Directed Object Rearrangement by Physical Humanoidcited by 17
- 2024Learning Multi-Modal Whole-Body Control for Real-World Humanoid Robotscited by 16
- 2021Linear Policies are Sufficient to Realize Robust Bipedal Walking on Challenging Terrainscited by 7
- 2024Tailoring Solution Accuracy for Fast Whole-body Model Predictive Control of Legged Robotscited by 7
- 2025SoftMimic: Learning Compliant Whole-body Control from Examplescited by 7
- 2023Exploring Kinodynamic Fabrics for Reactive Whole-Body Control of Underactuated Humanoid Robotscited by 5
- 2023Multi-Contact Whole-Body Force Control for Position-Controlled Robotscited by 4
- 2026Walk the PLANC: Physics-Guided RL for Agile Humanoid Locomotion on Constrained Footholdscited by 4
- 2022Optimizing Bipedal Maneuvers of Single Rigid-Body Models for Reinforcement Learningcited by 2
- 2024A Biomechanics-Inspired Approach to Soccer Kicking for Humanoid Robotscited by 2
- 2025Chasing Stability: Humanoid Running via Control Lyapunov Function Guided Reinforcement Learningcited by 2
- 2023Benchmarking the Full-Order Model Optimization Based Imitation in the Humanoid Robot Reinforcement Learning Walkcited by 1
- 2026Accelerating and Scaling MPC-Guided Reinforcement Learning for Humanoid Locomotion and Manipulationcited by 1
- 2026FWBC-VLA: Force-Aware Whole-Body Compensation for Contact-Rich Loco-Manipulationcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026WOLF-VLA: Whole-Body Humanoid Optimal Locomotion Framework for Vision-Language-Action Learning
- 2026ForceVLA2: Unleashing Hybrid Force-Position Control with Force Awareness for Contact-Rich Manipulation
- 2026CRAFT: Adapting VLA Models to Contact-rich Manipulation via Force-aware Curriculum Fine-tuning
- 2026Humanoid Loco-Manipulation With Discrete VLA Model
- 2026CompVLA: A Variable Compliance Vision-Language-Action Model for Contact-rich Manipulation
- 2026OpenHLM: An Empirical Recipe for Whole-Body Humanoid Loco-Manipulation
- 2026KINO: A Keyframe Interface for VLM Planning and Whole-Body Control in Humanoid Loco-Manipulation ↗
- 2026ForceDelta-VLA: Distilling Force-Conditioned ActionCorrections for Contact-Rich Manipulation