mlsanityData to 7 Oct 2026

Body Gesture Recognition to Control a Social Robot

arXiv 2206.07538 ↗First posted 15 Jun 2022cs.RO cs.CV cs.HCcited by 0

Not on the map. Why?

Abstract (arXiv)

In this work, we propose a gesture based language to allow humans to interact with robots using their body in a natural way. We have created a new gesture detection model using neural networks and a custom dataset of humans performing a set of body gestures to train our network. Furthermore, we compare body gesture communication with other communication channels to acknowledge the importance of adding this knowledge to robots. The presented approach is extensively validated in diverse simulations and real-life experiments with non-trained volunteers. This attains remarkable results and shows that it is a valuable framework for social robotics applications, such as human robot collaboration or human-robot interaction.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 7 of its 18 references that are in the map. First posted on arXiv 15 Jun 2022.

Builds on

7 of 18 references.

References · 7

  1. 2019MediaPipe: A Framework for Building Perception Pipelinescited by 572
  2. 2018Survey on Emotional Body Gesture Recognitioncited by 47
  3. 2022Sign Language Video Retrieval with Free-Form Textual Queriescited by 21
  4. 2019Improved Optical Flow for Gesture-based Human-robot Interactioncited by 8
  5. 2021A Proposed Set of Communicative Gestures for Human Robot Interaction and an RGB Image-based Gesture Recognizer Implemented in ROScited by 4
  6. 2019Enabling Intuitive Human-Robot Teaming Using Augmented Reality and Gesture Controlcited by 2
  7. 2020Gesture Recognition for Initiating Human-to-Robot Handoverscited by 1

Built on by

Not cited yet.