# ZoomTouch: Multi-User Remote Robot Control in Zoom by DNN-based Gesture Recognition

arXiv: https://arxiv.org/abs/2011.03845 · HTML: https://mlsanity.com/paper/2011.03845/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 7 Nov 2020.

## Built on by (most cited first, 2 of 2)

- [GraspLook: a VR-based Telemanipulation System with R-CNN-driven Augmentation of Virtual Environment](https://mlsanity.com/paper/2110.12518/) (2021)
- [HaGRIDv2: 1M Images for Static and Dynamic Hand Gesture Recognition](https://mlsanity.com/paper/2412.01508/) (2024)

## Abstract (arXiv)

We present ZoomTouch - a breakthrough technology for multi-user control of robot from Zoom in real-time by DNN-based gesture recognition. The users from digital world can have a video conferencing and manipulate the robot to make the dexterous manipulations with tangible objects. As the scenario, we proposed the remote COVID-19 test Laboratory to considerably reduce the time to receive the data and substitute medical assistant working in protective gear in close proximity with infected cells. The proposed technology suggests a new type of reality, where multi-users can jointly interact with remote object, e.g. make a new building design, joint cooking in robotic kitchen, etc, and discuss/modify the results at the same time.