When the Inference Meets the Explicitness or Why Multimodality Can Make Us Forget About the Perfect Predictor
Not on the map. Why?
Abstract (arXiv)
Although in the literature it is common to find predictors and inference systems that try to predict human intentions, the uncertainty of these models due to the randomness of human behavior has led some authors to start advocating the use of communication systems that explicitly elicit human intention. In this work, it is analyzed the use of four different communication systems with a human-robot collaborative object transportation task as experimental testbed: two intention predictors (one based on force prediction and another with an enhanced velocity prediction algorithm) and two explicit communication methods (a button interface and a voice-command recognition system). These systems were integrated into IVO, a custom mobile social robot equipped with force sensor to detect the force exchange between both agents and LiDAR to detect the environment. The collaborative task required transporting an object over a 5-7 meter distance with obstacles in the middle, demanding rapid decisions and precise physical coordination. 75 volunteers perform a total of 255 executions divided into three groups, testing inference systems in the first round, communication systems in the second, and the combined strategies in the third. The results show that, 1) once sufficient performance is achieved, the human no longer notices and positively assesses technical improvements; 2) the human prefers systems that are more natural to them even though they have higher failure rates; and 3) the preferred option is the right combination of both systems.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 10 of its 62 references that are in the map. First posted on arXiv 21 Feb 2026.
Builds on
10 of 62 references.
References · 10
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2018Speech Commands: A Dataset for Limited-Vocabulary Speech Recognitioncited by 741
- 2021Broadcasted Residual Learning for Efficient Keyword Spottingcited by 47
- 2020MatchboxNet: 1D Time-Channel Separable Convolutional Neural Network Architecture for Speech Commands Recognitioncited by 36
- 2019On the Utility of Model Learning in HRIcited by 21
- 2021How to select and use tools? : Active Perception of Target Objects Using Multimodal Deep Learningcited by 15
- 2018Anticipation in Human-Robot Cooperation: A Recurrent Neural Network Approach for Multiple Action Sequences Predictioncited by 12
- 2017Robot Planning with Mathematical Models of Human State and Actioncited by 7
- 2021Communicating Inferred Goals with Passive Augmented Reality and Active Haptic Feedbackcited by 1
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026An Approach to Combining Video and Speech with Large Language Models in Human-Robot Interactioncited by 2
- 2026A ROS 2 Wrapper for Florence-2: Multi-Mode Local Vision-Language Inference for Robotic Systemscited by 1
- 2026Ablation Study of Multimodal Perception, Language Grounding, and Control for Human-Robot Interaction in an Object Detection and Grasping Taskcited by 0
- 2026From Technical Metrics to User Perception: A User Study of a Multimodal Human-Robot Interaction System for Object Detection and Graspingcited by 0
- 2026From Technical Metrics to User Perception: A User Study of a Multimodal Human-Robot Interaction System for Object Detection and Grasping1 Jul 2026
- 2026Ablation Study of Multimodal Perception, Language Grounding, and Control for Human-Robot Interaction in an Object Detection and Grasping Task1 May 2026
- 2026A ROS 2 Wrapper for Florence-2: Multi-Mode Local Vision-Language Inference for Robotic Systems1 Apr 2026
- 2026An Approach to Combining Video and Speech with Large Language Models in Human-Robot Interaction23 Feb 2026