mlsanityData to 7 Oct 2026

Predictive Reachability for Embodiment Selection in Mobile Manipulation Behaviors

arXiv 2410.21059 ↗First posted 28 Oct 2024cs.ROcited by 0

On the map: World models → Embodied and robot world models

Abstract (arXiv)

Mobile manipulators require coordinated control between navigation and manipulation to accomplish tasks. Typically, coordinated mobile manipulation behaviors have base navigation to approach the goal followed by arm manipulation to reach the desired pose. Selecting the embodiment between the base and arm can be determined based on reachability. Previous methods evaluate reachability by computing inverse kinematics and activate arm motions once solutions are identified. In this study, we introduce a new approach called predictive reachability that decides reachability based on predicted arm motions. Our model utilizes a hierarchical policy framework built upon a world model. The world model allows the prediction of future trajectories and the evaluation of reachability. The hierarchical policy selects the embodiment based on the predicted reachability and plans accordingly. Unlike methods that require prior knowledge about robots and environments for inverse kinematics, our method only relies on image-based observations. We evaluate our approach through basic reaching tasks across various environments. The results demonstrate that our method outperforms previous model-based approaches in both sample efficiency and performance, while enabling more reasonable embodiment selection based on predictive reachability.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 13 of its 21 references that are in the map. First posted on arXiv 28 Oct 2024.

Builds on

13 of 21 references.

References · 13

  1. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
  2. 2018Learning Latent Dynamics for Planning from Pixelscited by 1,221
  3. 2023Mastering Diverse Domains through World Modelscited by 1,193
  4. 2020Mastering Atari with Discrete World Modelscited by 990
  5. 2015End-to-End Training of Deep Visuomotor Policiescited by 847
  6. 2018Recurrent World Models Facilitate Policy Evolutioncited by 761
  7. 2022Deep Hierarchical Planning from Pixelscited by 96
  8. 2019HRL4IN: Hierarchical Reinforcement Learning for Interactive Navigation with Mobile Manipulatorscited by 52
  9. 2021Learning Kinematic Feasibility for Mobile Manipulation through Deep Reinforcement Learningcited by 24
  10. 2022Robot Learning of Mobile Manipulation with Reachability Behavior Priorscited by 20
  11. 2017Reuleaux: Robot Base Placement by Reachability Analysiscited by 10
  12. 2020Whole-Body Control of a Mobile Manipulator using End-to-End Reinforcement Learningcited by 7
1 more
  1. 2014Learning and Reasoning with Action-Related Places for Robust Mobile Manipulationcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026DynaMOMA: Instantaneous Prediction of Grasp Poses for Mobile Manipulation of Dynamic Objects ↗
  2. 2026World Models for Robotic Manipulation: A Survey
  3. 2024Pushing the Limits of Cross-Embodiment Learning for Manipulation and Navigation
  4. 2026DreamTrajectory: Trajectory-Guided Action Generation with World Model Alignment for Mobile Manipulation
  5. 2025A Step Toward World Models: A Survey on Robotic Manipulation
  6. 2026Spatially Generalizable Mobile Manipulation via Adaptive Experience Selection and Dynamic Imagination ↗
  7. 2026DECOWAM: Decoupled Whole-Body World-Action Model for Legged Mobile Manipulation
  8. 2025MoTo: A Zero-shot Plug-in Interaction-aware Navigation for General Mobile Manipulation