Nonverbal Cues in Human-Robot Interaction: A Communication Studies Perspective
Not on the map. Why?
Abstract (arXiv)
Communication between people is characterized by a broad range of nonverbal cues. Transferring these cues into the design of robots and other artificial agents that interact with people may foster more natural, inviting, and accessible experiences. In this position paper, we offer a series of definitive nonverbal codes for human-robot interaction (HRI) that address the five human sensory systems (visual, auditory, haptic, olfactory, gustatory) drawn from the field of communication studies. We discuss how these codes can be translated into design patterns for HRI using a curated sample of the communication studies and HRI literatures. As nonverbal codes are an essential mode in human communication, we argue that integrating robotic nonverbal codes in HRI will afford robots a feeling of "aliveness" or "social agency" that would otherwise be missing. We end with suggestions for research directions to stimulate work on nonverbal communication within the field of HRI and improve communication between human and robots.
Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 4 of its 153 references that are in the map. First posted on arXiv 22 Apr 2023.
Builds on
4 of 153 references.
References · 4
- 2022What Pronouns for Pepper? A Critical Review of Gender/ing in Researchcited by 9
- 2021Measuring Voice UX Quantitatively: A Rapid Reviewcited by 6
- 2021Crossing the Tepper Line: An Emerging Ontology for Describing the Dynamic Sociality of Embodied AIcited by 3
- 2020Establishing Human-Robot Trust through Music-Driven Robotic Emotion Prosody and Gesturecited by 2
Built on by
Citing papers per year: 2024: 6; 2025: 4; 2026: 6.
16 papers.
Sort:
By area:
- 2024EMOTION: Expressive Motion Sequence Generation for Humanoid Robots with In-Context Learningcited by 6
- 2024Predicting the Intention to Interact with a Service Robot:the Role of Gaze Cuescited by 5
- 2025HRIBench: Benchmarking Vision-Language Models for Real-Time Human Perception in Human-Robot Interactioncited by 4
- 2025Social Identity in Human-Agent Interaction: A Primercited by 3
- 2026PolySLGen: Online Multimodal Speaking-Listening Reaction Generation in Polyadic Interactioncited by 3
- 2024AV-EmoDialog: Chat with Audio-Visual Users Leveraging Emotional Cuescited by 2
- 2024SLYKLatent: A Learning Framework for Gaze Estimation Using Deep Facial Feature Learningcited by 1
- 2024Qualitative Approaches to Voice UXcited by 1
- 2025ChatGPT and U(X): A Rapid Review on Measuring the User Experiencecited by 1
- 2026Non-verbal Real-time Human-AI Interaction in Constrained Robotic Environmentscited by 1
- 2026Unveiling the Limits of Large Language Models in Inferring Pragmatic Meaning from Non-Verbal Responsescited by 1
- 2024QUB-PHEO: A Visual-Based Dyadic Multi-View Dataset for Intention Inference in Collaborative Assemblycited by 0
4 more
- 2025DiG-Net: Enhancing Human-Robot Interaction through Hyper-Range Dynamic Gesture Recognition in Assistive Roboticscited by 0
- 2026Operationalizing Perceptions of Agent Gender: Foundations and Guidelinescited by 0
- 2026Prompt-to-Gesture: Measuring the Capabilities of Image-to-Video Deictic Gesture Generationcited by 0
- 2026Real-time body pose non-verbal communication with a consistency-based reliability measurecited by 0
- 2026Real-time body pose non-verbal communication with a consistency-based reliability measure8 Jun 2026
- 2026Unveiling the Limits of Large Language Models in Inferring Pragmatic Meaning from Non-Verbal Responses1 Jun 2026
- 2026Prompt-to-Gesture: Measuring the Capabilities of Image-to-Video Deictic Gesture Generation16 Apr 2026
- 2026PolySLGen: Online Multimodal Speaking-Listening Reaction Generation in Polyadic Interaction9 Apr 2026
- 2026Operationalizing Perceptions of Agent Gender: Foundations and Guidelines10 Mar 2026
- 2026Non-verbal Real-time Human-AI Interaction in Constrained Robotic Environments2 Mar 2026
- 2025Social Identity in Human-Agent Interaction: A Primer12 Aug 2025
- 2025HRIBench: Benchmarking Vision-Language Models for Real-Time Human Perception in Human-Robot Interaction25 Jun 2025
- 2025DiG-Net: Enhancing Human-Robot Interaction through Hyper-Range Dynamic Gesture Recognition in Assistive Robotics30 May 2025
- 2025ChatGPT and U(X): A Rapid Review on Measuring the User Experience20 Mar 2025
- 2024AV-EmoDialog: Chat with Audio-Visual Users Leveraging Emotional Cues23 Dec 2024
- 2024EMOTION: Expressive Motion Sequence Generation for Humanoid Robots with In-Context Learning30 Oct 2024
4 more
- 2024QUB-PHEO: A Visual-Based Dyadic Multi-View Dataset for Intention Inference in Collaborative Assembly23 Sep 2024
- 2024Qualitative Approaches to Voice UX23 Apr 2024
- 2024Predicting the Intention to Interact with a Service Robot:the Role of Gaze Cues2 Apr 2024
- 2024SLYKLatent: A Learning Framework for Gaze Estimation Using Deep Facial Feature Learning2 Feb 2024
- 2024EMOTION: Expressive Motion Sequence Generation for Humanoid Robots with In-Context Learningcited by 6
- 2024Predicting the Intention to Interact with a Service Robot:the Role of Gaze Cuescited by 5
- 2025Social Identity in Human-Agent Interaction: A Primercited by 3
- 2026PolySLGen: Online Multimodal Speaking-Listening Reaction Generation in Polyadic Interactioncited by 3
- 2024AV-EmoDialog: Chat with Audio-Visual Users Leveraging Emotional Cuescited by 2
- 2024SLYKLatent: A Learning Framework for Gaze Estimation Using Deep Facial Feature Learningcited by 1
- 2024Qualitative Approaches to Voice UXcited by 1
- 2025ChatGPT and U(X): A Rapid Review on Measuring the User Experiencecited by 1
- 2026Non-verbal Real-time Human-AI Interaction in Constrained Robotic Environmentscited by 1
- 2026Unveiling the Limits of Large Language Models in Inferring Pragmatic Meaning from Non-Verbal Responsescited by 1
- 2024QUB-PHEO: A Visual-Based Dyadic Multi-View Dataset for Intention Inference in Collaborative Assemblycited by 0
- 2025DiG-Net: Enhancing Human-Robot Interaction through Hyper-Range Dynamic Gesture Recognition in Assistive Roboticscited by 0
12 most cited of 14 All 14 (JSON)
- 2026Real-time body pose non-verbal communication with a consistency-based reliability measure8 Jun 2026
- 2026Unveiling the Limits of Large Language Models in Inferring Pragmatic Meaning from Non-Verbal Responses1 Jun 2026
- 2026Prompt-to-Gesture: Measuring the Capabilities of Image-to-Video Deictic Gesture Generation16 Apr 2026
- 2026PolySLGen: Online Multimodal Speaking-Listening Reaction Generation in Polyadic Interaction9 Apr 2026
- 2026Non-verbal Real-time Human-AI Interaction in Constrained Robotic Environments2 Mar 2026
- 2025Social Identity in Human-Agent Interaction: A Primer12 Aug 2025
- 2025DiG-Net: Enhancing Human-Robot Interaction through Hyper-Range Dynamic Gesture Recognition in Assistive Robotics30 May 2025
- 2025ChatGPT and U(X): A Rapid Review on Measuring the User Experience20 Mar 2025
- 2024AV-EmoDialog: Chat with Audio-Visual Users Leveraging Emotional Cues23 Dec 2024
- 2024EMOTION: Expressive Motion Sequence Generation for Humanoid Robots with In-Context Learning30 Oct 2024
- 2024QUB-PHEO: A Visual-Based Dyadic Multi-View Dataset for Intention Inference in Collaborative Assembly23 Sep 2024
- 2024Qualitative Approaches to Voice UX23 Apr 2024
12 newest of 14 All 14 (JSON)