Predicting the Intention to Interact with a Service Robot:the Role of Gaze Cues
Not on the map. Why?
Abstract (arXiv)
For a service robot, it is crucial to perceive as early as possible that an approaching person intends to interact: in this case, it can proactively enact friendly behaviors that lead to an improved user experience. We solve this perception task with a sequence-to-sequence classifier of a potential user intention to interact, which can be trained in a self-supervised way. Our main contribution is a study of the benefit of features representing the person's gaze in this context. Extensive experiments on a novel dataset show that the inclusion of gaze cues significantly improves the classifier performance (AUROC increases from 84.5% to 91.2%); the distance at which an accurate classification can be achieved improves from 2.4 m to 3.2 m. We also quantify the system's ability to adapt to new environments without external supervision. Qualitative experiments show practical applications with a waiter robot.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 12 of its 38 references that are in the map. First posted on arXiv 2 Apr 2024.
Builds on
12 of 38 references.
References · 12
- 2019Self-supervised Visual Feature Learning with Deep Neural Networks: A Surveycited by 656
- 2017Multi-task Self-Supervised Visual Learningcited by 200
- 2016Eye Tracking for Everyonecited by 155
- 2015Appearance-Based Gaze Estimation in the Wildcited by 153
- 2016It's Written All Over Your Face: Full-Face Appearance-Based Gaze Estimationcited by 123
- 2022GazeOnce: Real-Time Multi-Person Gaze Estimationcited by 17
- 2023Nonverbal Cues in Human-Robot Interaction: A Communication Studies Perspectivecited by 16
- 2020Are you still with me? Continuous Engagement Assessment from a Robot's Point of Viewcited by 12
- 2022Intention estimation from gaze and motion features for human-robot shared-control object manipulationcited by 11
- 2023Gaze-based intention estimation: principles, methodologies, and applications in HRIcited by 11
- 2023Self-Supervised Prediction of the Intention to Interact with a Service Robotcited by 7
- 2015Starting engagement detection towards a companion robot using multimodal featurescited by 3
Built on by
Citing papers per year: 2024: 1; 2025: 3; 2026: 1.
5 papers.
- 2024GazeHTA: End-to-end Gaze Target Detection with Head-Target Associationcited by 6
- 2025MINT-RVAE: Multi-Cues Intention Prediction of Human-Robot Interaction using Human Pose and Emotion Information from RGB-only Camera Datacited by 1
- 2025Real-Time Human-Robot Interaction Intent Detection Using RGB-based Pose and Emotion Cues with Cross-Camera Model Generalizationcited by 1
- 2025Sixth-Sense: Self-Supervised Learning of Spatial Awareness of Humans from a Planar Lidarcited by 0
- 2026Multi-scale Object-Aware Gaze Estimation via Geometric Reasoningcited by 0
- 2026Multi-scale Object-Aware Gaze Estimation via Geometric Reasoning28 Jun 2026
- 2025Real-Time Human-Robot Interaction Intent Detection Using RGB-based Pose and Emotion Cues with Cross-Camera Model Generalization18 Dec 2025
- 2025MINT-RVAE: Multi-Cues Intention Prediction of Human-Robot Interaction using Human Pose and Emotion Information from RGB-only Camera Data26 Sep 2025
- 2025Sixth-Sense: Self-Supervised Learning of Spatial Awareness of Humans from a Planar Lidar28 Feb 2025
- 2024GazeHTA: End-to-end Gaze Target Detection with Head-Target Association16 Apr 2024