# Context-aware collaborative pushing of heavy objects using skeleton-based intention prediction

arXiv: https://arxiv.org/abs/2505.10239 · HTML: https://mlsanity.com/paper/2505.10239/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 15 May 2025.

## Built on by (most cited first, 3 of 3)

- [Multi-Agent Systems: From Classical Paradigms to Large Foundation Model-Enabled Futures](https://mlsanity.com/paper/2604.18133/) (2026)
- [OmniRobotHome: A Multi-Camera Home Platform for Real-Time Human-Robot Interaction](https://mlsanity.com/paper/2604.28197/) (2026)
- [Learning from Humans for Proactive Assistance in Human-Robot Collaborative Transport](https://mlsanity.com/paper/2609.25351/) (2026)

## Abstract (arXiv)

In physical human-robot interaction, force feedback has been the most common sensing modality to convey the human intention to the robot. It is widely used in admittance control to allow the human to direct the robot. However, it cannot be used in scenarios where direct force feedback is not available since manipulated objects are not always equipped with a force sensor. In this work, we study one such scenario: the collaborative pushing and pulling of heavy objects on frictional surfaces, a prevalent task in industrial settings. When humans do it, they communicate through verbal and non-verbal cues, where body poses, and movements often convey more than words. We propose a novel context-aware approach using Directed Graph Neural Networks to analyze spatio-temporal human posture data to predict human motion intention for non-verbal collaborative physical manipulation. Our experiments demonstrate that robot assistance significantly reduces human effort and improves task efficiency. The results indicate that incorporating posture-based context recognition, either together with or as an alternative to force sensing, enhances robot decision-making and control efficiency.