Probabilistic Human Intent Prediction for Mobile Manipulation: An Evaluation with Human-Inspired Constraints
Not on the map. Why?
Abstract (arXiv)
Accurate inference of human intent enables human-robot collaboration without constraining human control or causing conflicts between humans and robots. We present GUIDER (Global User Intent Dual-phase Estimation for Robots), a probabilistic framework that enables a robot to estimate the intent of human operators. GUIDER maintains two coupled belief layers, one tracking navigation goals and the other manipulation goals. In the Navigation phase, a Synergy Map blends controller velocity with an occupancy grid to rank interaction areas. Upon arrival at a goal, an autonomous multi-view scan builds a local 3D cloud. The Manipulation phase combines U2Net saliency, FastSAM instance saliency, and three geometric grasp-feasibility tests, with an end-effector kinematics-aware update rule that evolves object probabilities in real-time. GUIDER can recognize areas and objects of intent without predefined goals. We evaluated GUIDER on 25 trials (five participants x five task variants) in Isaac Sim, and compared it with two baselines, one for navigation and one for manipulation. Across the 25 trials, GUIDER achieved a median stability of 93-100% during navigation, compared with 60-100% for the BOIR baseline, with an improvement of 39.5% in a redirection scenario (T5). During manipulation, stability reached 94-100% (versus 69-100% for Trajectron), with a 31.4% difference in a redirection task (T3). In geometry-constrained trials (manipulation), GUIDER recognized the object intent three times earlier than Trajectron (median remaining time to confident prediction 23.6 s vs 7.8 s). These results validate our dual-phase framework and show improvements in intent inference in both phases of mobile manipulation tasks.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 24 of its 59 references that are in the map. First posted on arXiv 14 Jul 2025.
Builds on
24 of 59 references.
References · 24
- 2025Gemma 3 Technical Reportcited by 1,824
- 2020U2-Net: Going Deeper with Nested U-Structure for Salient Object Detectioncited by 412
- 2023MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrationscited by 327
- 2023Fast Segment Anythingcited by 290
- 2023MotionDiffuser: Controllable Multi-Agent Motion Prediction using Diffusioncited by 213
- 2017Accelerated Hierarchical Density Clusteringcited by 102
- 2020Learning Dexterous Grasping with Object-Centric Visual Affordancescited by 85
- 2022Human Trajectory Prediction via Neural Social Physicscited by 66
- 2023IndustReal: Transferring Contact-Rich Assembly Tasks from Simulation to Realitycited by 53
- 2017Shared Autonomy via Hindsight Optimization for Teleoperation and Teamingcited by 40
- 2019Deep Reinforcement Learning using Genetic Algorithm for Parameter Optimizationcited by 24
- 2021Spatial Intention Maps for Multi-Agent Mobile Manipulationcited by 11
12 more
- 2021Predictive Runtime Monitoring for Mobile Robots using Logic-Based Bayesian Intent Inferencecited by 8
- 2024Robot Trajectron: Trajectory Prediction-based Shared Control for Robot Manipulationcited by 7
- 2025Sim-to-Real Transfer for Mobile Robots with Reinforcement Learning: from NVIDIA Isaac Sim to Gazebo and Real ROS 2 Robotscited by 7
- 2020Active Intent Disambiguation for Shared Control Robotscited by 6
- 2021A Bayesian-Based Approach to Human Operator Intent Recognition in Remote Mobile Robot Navigationcited by 4
- 2021SpectGRASP: Robotic Grasping by Spectral Correlationcited by 3
- 2024Sim-to-Real gap in RL: Use Case with TIAGo and Isaac Sim/Gymcited by 3
- 2024Constraint-Aware Intent Estimation for Dynamic Human-Robot Object Co-Manipulationcited by 3
- 2021A System for Traded Control Teleoperation of Manipulation Tasks using Intent Prediction from Hand Gesturescited by 2
- 2022Robot-Assisted Nuclear Disaster Response: Report and Insights from a Field Exercisecited by 2
- 2024A Mini-Review on Mobile Manipulators with Variable Autonomycited by 2
- 2024Semi-autonomous Robotic Disassembly Enhanced by Mixed Realitycited by 1
Built on by
Citing papers per year: 2025: 2.
2 papers.