GazeVLA: Learning Human Intention for Robotic Manipulation
Not on the map. Why?
Abstract (arXiv)
Embodied foundation models have achieved significant breakthroughs in robotic manipulation, yet they still depend heavily on large-scale robot demonstrations. Although recent works have explored leveraging human data to alleviate this dependency, effectively extracting transferable knowledge remains a significant challenge due to the inherent embodiment gap between human and robot. We argue that the intention underlying human actions can serve as a powerful intermediate representation for bridging this gap. In this paper, we introduce a novel framework that explicitly learns and transfers human intention to facilitate robotic manipulation. Specifically, we model intention through gaze, as it naturally precedes physical actions and serves as an observable proxy for human intent. Our model is first pretrained on a large-scale egocentric human dataset to capture human intention and its synergy with action, followed by finetuning on a small set of robot and human data. During inference, the model adopts a Chain-of-Thought reasoning paradigm, sequentially predicting intention before executing the action. Extensive evaluations in simulation and real-world settings, across long-horizon and fine-grained tasks, and under few-shot and robustness benchmarks, show that our method consistently outperforms strong baselines, generalizes better, and achieves state-of-the-art performance. Project page: https://gazevla.github.io .
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). First posted on arXiv 24 Apr 2026.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026Gaze2Act: Gaze-Conditioned Vision-Language-Action Policies for Interactive Robot Manipulationcited by 8
- 2026IntentVLA: Short-Horizon Intent Modeling for Aliased Robot Manipulationcited by 7
- 2026Robot Learning from Human Videos: A Surveycited by 5
- 2026mmHRI: Towards Privacy-Preserving Human-Robot Interaction with Millimeter-Wave Radarcited by 1
- 2026EgoRecovery: Acquiring Failure Recovery Ability Through Human Recovery Demonstrationcited by 0
- 2026PhotoHOI: Synthesizing 3D Hand-Object Interactions from a Single RGB Photographcited by 0
- 2026Act with Intent: Distilling Behavior Intent for Vision-Language-Action Modelscited by 0
- 2026ActGaze: Learning Action-Grounded Gaze through Counterfactual Visual Interventions for High-Precision Manipulationcited by 0
- 2026EyeRobot 2.0: Active Gaze for Precise Manipulation without Wrist Camerascited by 0
- 2026EyeRobot 2.0: Active Gaze for Precise Manipulation without Wrist Cameras2 Oct 2026
- 2026mmHRI: Towards Privacy-Preserving Human-Robot Interaction with Millimeter-Wave Radar28 Sep 2026
- 2026ActGaze: Learning Action-Grounded Gaze through Counterfactual Visual Interventions for High-Precision Manipulation24 Sep 2026
- 2026Act with Intent: Distilling Behavior Intent for Vision-Language-Action Models24 Aug 2026
- 2026PhotoHOI: Synthesizing 3D Hand-Object Interactions from a Single RGB Photograph3 Aug 2026
- 2026EgoRecovery: Acquiring Failure Recovery Ability Through Human Recovery Demonstration22 Jul 2026
- 2026Gaze2Act: Gaze-Conditioned Vision-Language-Action Policies for Interactive Robot Manipulation28 May 2026
- 2026IntentVLA: Short-Horizon Intent Modeling for Aliased Robot Manipulation14 May 2026
- 2026Robot Learning from Human Videos: A Survey30 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2025IntentionVLA: Generalizable and Efficient Embodied Intention Reasoning for Human-Robot Interaction
- 2026Learning Human-Intention Priors from Large-Scale Human Demonstrations for Robotic Manipulation
- 2026HINT: Human-Intent Inception for Long-Horizon Robot Manipulation ↗
- 2026WatchAct: A Benchmark for Behavior-Grounded Robot Manipulation
- 2025INTENTION: Inferring Tendencies of Humanoid Robot Motion Through Interactive Intuition and Grounded VLM
- 2026Gaze-Regularized Vision-Language-Action Models for Robotic Manipulation
- 2026Intent at a Glance: Gaze-Guided Robotic Manipulation via Foundation Models
- 2019Understanding Teacher Gaze Patterns for Robot Learning