Preemptive Motion Planning for Human-to-Robot Indirect Placement Handovers
Not on the map. Why?
Abstract (arXiv)
As technology advances, the need for safe, efficient, and collaborative human-robot-teams has become increasingly important. One of the most fundamental collaborative tasks in any setting is the object handover. Human-to-robot handovers can take either of two approaches: (1) direct hand-to-hand or (2) indirect hand-to-placement-to-pick-up. The latter approach ensures minimal contact between the human and robot but can also result in increased idle time due to having to wait for the object to first be placed down on a surface. To minimize such idle time, the robot must preemptively predict the human intent of where the object will be placed. Furthermore, for the robot to preemptively act in any sort of productive manner, predictions and motion planning must occur in real-time. We introduce a novel prediction-planning pipeline that allows the robot to preemptively move towards the human agent's intended placement location using gaze and gestures as model inputs. In this paper, we investigate the performance and drawbacks of our early intent predictor-planner as well as the practical benefits of using such a pipeline through a human-robot case study.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 13 of its 44 references that are in the map. First posted on arXiv 1 Mar 2022.
Builds on
13 of 44 references.
References · 13
- 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,162
- 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 690
- 2017Socially Aware Motion Planning with Deep Reinforcement Learningcited by 136
- 2019Understanding Human Gaze Communication by Spatio-Temporal Graph Reasoningcited by 40
- 2018Probabilistic Prediction of Interactive Driving Behavior via Hierarchical Inverse Reinforcement Learningcited by 28
- 2020MoGaze: A Dataset of Full-Body Motions that Includes Workspace Geometry and Eye-Gazecited by 21
- 2020Human Grasp Classification for Reactive Human-to-Robot Handoverscited by 13
- 2018Anticipation in Human-Robot Cooperation: A Recurrent Neural Network Approach for Multiple Action Sequences Predictioncited by 12
- 2021Communicative Learning with Natural Gestures for Embodied Navigation Agents with Human-in-the-Scenecited by 7
- 2017Estimating Human Intent for Physical Human-Robot Co-Manipulationcited by 3
- 2020Anticipatory Human-Robot Collaboration via Multi-Objective Trajectory Optimizationcited by 3
- 2020Anticipating Human Intention for Full-Body Motion Prediction in Object Grasping and Placing Taskscited by 2
1 more
Built on by
Citing papers per year: 2026: 2.
2 papers.