Object-Independent Human-to-Robot Handovers using Real Time Robotic Vision
Not on the map. Why?
Abstract (arXiv)
We present an approach for safe and object-independent human-to-robot handovers using real time robotic vision and manipulation. We aim for general applicability with a generic object detector, a fast grasp selection algorithm and by using a single gripper-mounted RGB-D camera, hence not relying on external sensors. The robot is controlled via visual servoing towards the object of interest. Putting a high emphasis on safety, we use two perception modules: human body part segmentation and hand/finger segmentation. Pixels that are deemed to belong to the human are filtered out from candidate grasp poses, hence ensuring that the robot safely picks the object without colliding with the human partner. The grasp selection and perception modules run concurrently in real-time, which allows monitoring of the progress. In experiments with 13 objects, the robot was able to successfully take the object from the human in 81.9% of the trials.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Jun 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 5; 2023: 4; 2024: 5; 2025: 2.
17 papers.
Sort:
By area:
- 2023Learning Human-to-Robot Handovers from Point Cloudscited by 34
- 2022HandoverSim: A Simulation Framework and Benchmark for Human-to-Robot Object Handoverscited by 15
- 2024GenH2R: Learning Generalizable Human-to-Robot Handover via Scalable Simulation, Demonstration, and Imitationcited by 14
- 2023SynH2R: Synthesizing Hand-Object Motions for Learning Human-to-Robot Handoverscited by 13
- 2022Model Predictive Control for Fluid Human-to-Robot Handoverscited by 9
- 2021The CORSMAL benchmark for the prediction of the properties of containerscited by 6
- 2024Sparse multi-view hand-object reconstruction for unseen environmentscited by 4
- 2024MoVEInt: Mixture of Variational Experts for Learning Human-Robot Interactions from Demonstrationscited by 3
- 2024Segmenting Object Affordances: Reproducibility and Sensitivity to Scalecited by 3
- 2022Improving Generalization of Deep Networks for Estimating Physical Properties of Containers and Fillingscited by 2
- 2022Container Localisation and Mass Estimation with an RGB-D Cameracited by 2
- 2022Audio-Visual Object Classification for Human-Robot Collaborationcited by 2
5 more
- 2023Affordance segmentation of hand-occluded containers from exocentric imagescited by 2
- 2024Stereo Hand-Object Reconstruction for Human-to-Robot Handovercited by 2
- 2025Visual Affordance Prediction: Survey and Reproducibilitycited by 1
- 2023AnyOKP: One-Shot and Instance-Aware Object Keypoint Extraction with Pretrained ViTcited by 0
- 2025SPGrasp: Spatiotemporal Prompt-driven Grasp Synthesis in Dynamic Scenescited by 0
- 2025SPGrasp: Spatiotemporal Prompt-driven Grasp Synthesis in Dynamic Scenes28 Aug 2025
- 2025Visual Affordance Prediction: Survey and Reproducibility8 May 2025
- 2024Stereo Hand-Object Reconstruction for Human-to-Robot Handover10 Dec 2024
- 2024Segmenting Object Affordances: Reproducibility and Sensitivity to Scale3 Sep 2024
- 2024MoVEInt: Mixture of Variational Experts for Learning Human-Robot Interactions from Demonstrations10 Jul 2024
- 2024Sparse multi-view hand-object reconstruction for unseen environments2 May 2024
- 2024GenH2R: Learning Generalizable Human-to-Robot Handover via Scalable Simulation, Demonstration, and Imitation1 Jan 2024
- 2023SynH2R: Synthesizing Hand-Object Motions for Learning Human-to-Robot Handovers9 Nov 2023
- 2023AnyOKP: One-Shot and Instance-Aware Object Keypoint Extraction with Pretrained ViT15 Sep 2023
- 2023Affordance segmentation of hand-occluded containers from exocentric images22 Aug 2023
- 2023Learning Human-to-Robot Handovers from Point Clouds30 Mar 2023
- 2022HandoverSim: A Simulation Framework and Benchmark for Human-to-Robot Object Handovers19 May 2022
5 more
- 2022Model Predictive Control for Fluid Human-to-Robot Handovers31 Mar 2022
- 2022Audio-Visual Object Classification for Human-Robot Collaboration3 Mar 2022
- 2022Container Localisation and Mass Estimation with an RGB-D Camera2 Mar 2022
- 2022Improving Generalization of Deep Networks for Estimating Physical Properties of Containers and Fillings2 Mar 2022
- 2021The CORSMAL benchmark for the prediction of the properties of containers27 Jul 2021
- 2023Learning Human-to-Robot Handovers from Point Cloudscited by 34
- 2022HandoverSim: A Simulation Framework and Benchmark for Human-to-Robot Object Handoverscited by 15
- 2023SynH2R: Synthesizing Hand-Object Motions for Learning Human-to-Robot Handoverscited by 13
- 2022Model Predictive Control for Fluid Human-to-Robot Handoverscited by 9
- 2021The CORSMAL benchmark for the prediction of the properties of containerscited by 6
- 2024Sparse multi-view hand-object reconstruction for unseen environmentscited by 4
- 2024MoVEInt: Mixture of Variational Experts for Learning Human-Robot Interactions from Demonstrationscited by 3
- 2024Segmenting Object Affordances: Reproducibility and Sensitivity to Scalecited by 3
- 2022Improving Generalization of Deep Networks for Estimating Physical Properties of Containers and Fillingscited by 2
- 2022Container Localisation and Mass Estimation with an RGB-D Cameracited by 2
- 2022Audio-Visual Object Classification for Human-Robot Collaborationcited by 2
- 2023Affordance segmentation of hand-occluded containers from exocentric imagescited by 2
12 most cited of 16 All 16 (JSON)
- 2025SPGrasp: Spatiotemporal Prompt-driven Grasp Synthesis in Dynamic Scenes28 Aug 2025
- 2025Visual Affordance Prediction: Survey and Reproducibility8 May 2025
- 2024Stereo Hand-Object Reconstruction for Human-to-Robot Handover10 Dec 2024
- 2024Segmenting Object Affordances: Reproducibility and Sensitivity to Scale3 Sep 2024
- 2024MoVEInt: Mixture of Variational Experts for Learning Human-Robot Interactions from Demonstrations10 Jul 2024
- 2024Sparse multi-view hand-object reconstruction for unseen environments2 May 2024
- 2023SynH2R: Synthesizing Hand-Object Motions for Learning Human-to-Robot Handovers9 Nov 2023
- 2023AnyOKP: One-Shot and Instance-Aware Object Keypoint Extraction with Pretrained ViT15 Sep 2023
- 2023Affordance segmentation of hand-occluded containers from exocentric images22 Aug 2023
- 2023Learning Human-to-Robot Handovers from Point Clouds30 Mar 2023
- 2022HandoverSim: A Simulation Framework and Benchmark for Human-to-Robot Object Handovers19 May 2022
- 2022Model Predictive Control for Fluid Human-to-Robot Handovers31 Mar 2022
12 newest of 16 All 16 (JSON)