A Holistic Approach to Reactive Mobile Manipulation
Not on the map. Why?
Abstract (arXiv)
We present the design and implementation of a taskable reactive mobile manipulation system. In contrary to related work, we treat the arm and base degrees of freedom as a holistic structure which greatly improves the speed and fluidity of the resulting motion. At the core of this approach is a robust and reactive motion controller which can achieve a desired end-effector pose, while avoiding joint position and velocity limits, and ensuring the mobile manipulator is manoeuvrable throughout the trajectory. This can support sensor-based behaviours such as closed-loop visual grasping. As no planning is involved in our approach, the robot is never stationary thinking about what to do next. We show the versatility of our holistic motion controller by implementing a pick and place system using behaviour trees and demonstrate this task on a 9-degree-of-freedom mobile manipulator. Additionally, we provide an open-source implementation of our motion controller for both non-holonomic and omnidirectional mobile manipulators available at jhavl.github.io/holistic.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). First posted on arXiv 10 Sep 2021.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2022: 2; 2023: 3; 2024: 3; 2025: 4; 2026: 3.
15 papers.
Sort:
By area:
- 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 391
- 2023SayPlan: Grounding Large Language Models using 3D Scene Graphs for Scalable Robot Task Planningcited by 289
- 2026RoboCasa365: A Large-Scale Simulation Framework for Training and Benchmarking Generalist Robotscited by 65
- 2024DynaMem: Online Dynamic Spatio-Semantic Memory for Open World Mobile Manipulationcited by 32
- 2024SPIN: Simultaneous Perception, Interaction and Navigationcited by 27
- 2023Causal Policy Gradient for Whole-Body Mobile Manipulationcited by 18
- 2022N2M2: Learning Navigation for Arbitrary Mobile Manipulation Motions in Unseen and Dynamic Environmentscited by 15
- 2025Manipulation as in Simulation: Enabling Accurate Geometry Perception in Robotscited by 11
- 2023MOMA-Force: Visual-Force Imitation for Real-World Mobile Manipulationcited by 9
- 2025SLAC: Safe and Efficient Real-Robot Reinforcement Learning via Unsupervised Simulation Pre-Trainingcited by 7
- 2025M4Diffuser: Multi-View Diffusion Policy with Manipulability-Aware Control for Robust Mobile Manipulationcited by 2
- 2026HarnessPAI: An Evolving Harness for Physical AIcited by 1
3 more
- 2022Augmentation for Learning From Demonstration with Environmental Constraintscited by 0
- 2025Re4MPC: Reactive Nonlinear MPC for Multi-model Motion Planning via Deep Reinforcement Learningcited by 0
- 2026FastGrasp: Learning-based Whole-Body Control Method for Fast Dexterous Grasping with Mobile Manipulatorscited by 0
- 2026HarnessPAI: An Evolving Harness for Physical AI24 Sep 2026
- 2026FastGrasp: Learning-based Whole-Body Control Method for Fast Dexterous Grasping with Mobile Manipulators14 Apr 2026
- 2026RoboCasa365: A Large-Scale Simulation Framework for Training and Benchmarking Generalist Robots4 Mar 2026
- 2025M4Diffuser: Multi-View Diffusion Policy with Manipulability-Aware Control for Robust Mobile Manipulation18 Sep 2025
- 2025Manipulation as in Simulation: Enabling Accurate Geometry Perception in Robots2 Sep 2025
- 2025Re4MPC: Reactive Nonlinear MPC for Multi-model Motion Planning via Deep Reinforcement Learning10 Jun 2025
- 2025SLAC: Safe and Efficient Real-Robot Reinforcement Learning via Unsupervised Simulation Pre-Training4 Jun 2025
- 2024DynaMem: Online Dynamic Spatio-Semantic Memory for Open World Mobile Manipulation7 Nov 2024
- 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robots4 Jun 2024
- 2024SPIN: Simultaneous Perception, Interaction and Navigation13 May 2024
- 2023MOMA-Force: Visual-Force Imitation for Real-World Mobile Manipulation7 Aug 2023
- 2023SayPlan: Grounding Large Language Models using 3D Scene Graphs for Scalable Robot Task Planning12 Jul 2023
- 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 391
- 2023SayPlan: Grounding Large Language Models using 3D Scene Graphs for Scalable Robot Task Planningcited by 289
- 2026RoboCasa365: A Large-Scale Simulation Framework for Training and Benchmarking Generalist Robotscited by 65
- 2024SPIN: Simultaneous Perception, Interaction and Navigationcited by 27
- 2023Causal Policy Gradient for Whole-Body Mobile Manipulationcited by 18
- 2022N2M2: Learning Navigation for Arbitrary Mobile Manipulation Motions in Unseen and Dynamic Environmentscited by 15
- 2025Manipulation as in Simulation: Enabling Accurate Geometry Perception in Robotscited by 11
- 2023MOMA-Force: Visual-Force Imitation for Real-World Mobile Manipulationcited by 9
- 2025SLAC: Safe and Efficient Real-Robot Reinforcement Learning via Unsupervised Simulation Pre-Trainingcited by 7
- 2025M4Diffuser: Multi-View Diffusion Policy with Manipulability-Aware Control for Robust Mobile Manipulationcited by 2
- 2026HarnessPAI: An Evolving Harness for Physical AIcited by 1
- 2025Re4MPC: Reactive Nonlinear MPC for Multi-model Motion Planning via Deep Reinforcement Learningcited by 0
12 most cited of 13 All 13 (JSON)
- 2026HarnessPAI: An Evolving Harness for Physical AI24 Sep 2026
- 2026FastGrasp: Learning-based Whole-Body Control Method for Fast Dexterous Grasping with Mobile Manipulators14 Apr 2026
- 2026RoboCasa365: A Large-Scale Simulation Framework for Training and Benchmarking Generalist Robots4 Mar 2026
- 2025M4Diffuser: Multi-View Diffusion Policy with Manipulability-Aware Control for Robust Mobile Manipulation18 Sep 2025
- 2025Manipulation as in Simulation: Enabling Accurate Geometry Perception in Robots2 Sep 2025
- 2025Re4MPC: Reactive Nonlinear MPC for Multi-model Motion Planning via Deep Reinforcement Learning10 Jun 2025
- 2025SLAC: Safe and Efficient Real-Robot Reinforcement Learning via Unsupervised Simulation Pre-Training4 Jun 2025
- 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robots4 Jun 2024
- 2024SPIN: Simultaneous Perception, Interaction and Navigation13 May 2024
- 2023MOMA-Force: Visual-Force Imitation for Real-World Mobile Manipulation7 Aug 2023
- 2023SayPlan: Grounding Large Language Models using 3D Scene Graphs for Scalable Robot Task Planning12 Jul 2023
- 2023Causal Policy Gradient for Whole-Body Mobile Manipulation4 May 2023
12 newest of 13 All 13 (JSON)