A Unified MPC Framework for Whole-Body Dynamic Locomotion and Manipulation
Not on the map. Why?
Abstract (arXiv)
In this paper, we propose a whole-body planning framework that unifies dynamic locomotion and manipulation tasks by formulating a single multi-contact optimal control problem. We model the hybrid nature of a generic multi-limbed mobile manipulator as a switched system, and introduce a set of constraints that can encode any pre-defined gait sequence or manipulation schedule in the formulation. Since the system is designed to actively manipulate its environment, the equations of motion are composed by augmenting the robot's centroidal dynamics with the manipulated-object dynamics. This allows us to describe any high-level task in the same cost/constraint function. The resulting planning framework could be solved on the robot's onboard computer in real-time within a model predictive control scheme. This is demonstrated in a set of real hardware experiments done in free-motion, such as base or end-effector pose tracking, and while pushing/pulling a heavy resistive door. Robustness against model mismatches and external disturbances is also verified during these test cases.
Key facts. Cited by 33 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 Mar 2021.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 2; 2022: 4; 2023: 2; 2024: 9; 2025: 15; 2026: 1.
33 papers.
Sort:
By area:
- 2021Articulated Object Interaction in Unknown Scenes with Whole-Body Mobile Manipulationcited by 44
- 2024Advancing Humanoid Locomotion: Mastering Challenging Terrains with Denoising World Model Learningcited by 38
- 2024Learning Force Control for Legged Manipulationcited by 19
- 2025Dexterous Manipulation through Imitation Learning: A Surveycited by 18
- 2025Learning coordinated badminton skills for legged manipulatorscited by 16
- 2021Evaluating model-based planning and planner amortization for continuous controlcited by 15
- 2022N2M2: Learning Navigation for Arbitrary Mobile Manipulation Motions in Unseen and Dynamic Environmentscited by 15
- 2025Bridging the Sim-to-Real Gap for Athletic Loco-Manipulationcited by 11
- 2022Robotic Table Wiping via Reinforcement Learning and Whole-body Trajectory Optimizationcited by 10
- 2025A Unified and General Humanoid Whole-Body Controller for Versatile Locomotioncited by 10
- 2022Sim-to-Real Learning for Bipedal Locomotion Under Unsensed Dynamic Loadscited by 9
- 2024Guided Reinforcement Learning for Robust Multi-Contact Loco-Manipulationcited by 9
21 more
- 2025Humanoid Whole-Body Locomotion on Narrow Terrain via Dynamic Balance and Reinforcement Learningcited by 7
- 2023Predicting Motion Plans for Articulating Everyday Objectscited by 5
- 2024Whole-body End-Effector Pose Trackingcited by 5
- 2025Ego-Vision World Model for Humanoid Contact Planningcited by 5
- 2025Dynamic object goal pushing with mobile manipulators through model-free constrained reinforcement learningcited by 3
- 2024Diffusion-Informed Probabilistic Contact Search for Multi-Finger Manipulationcited by 2
- 2024Dynamic Non-Prehensile Object Transport via Model-Predictive Reinforcement Learningcited by 2
- 2025ZipMPC: Compressed Context-Dependent MPC Cost via Imitation Learningcited by 2
- 2022A Transferable Legged Mobile Manipulation Framework Based on Disturbance Predictive Controlcited by 1
- 2023Kinematically-Decoupled Impedance Control for Fast Object Visual Servoing and Grasping on Quadruped Manipulatorscited by 1
- 2024Opening Articulated Structures in the Real Worldcited by 1
- 2024Learning Rapid Turning, Aerial Reorientation, and Balancing using Manipulator as a Tailcited by 1
- 2025Bipedalism for Quadrupedal Robots: Versatile Loco-Manipulation through Risk-Adaptive Reinforcement Learningcited by 1
- 2025INTENTION: Inferring Tendencies of Humanoid Robot Motion Through Interactive Intuition and Grounded VLMcited by 1
- 2024Goal-Conditioned Terminal Value Estimation for Real-time and Multi-task Model Predictive Controlcited by 0
- 2025CAIMAN: Causal Action Influence Detection for Sample-efficient Loco-manipulationcited by 0
- 2025Re4MPC: Reactive Nonlinear MPC for Multi-model Motion Planning via Deep Reinforcement Learningcited by 0
- 2025Bayesian Inverse Physics for Neuro-Symbolic Robot Learningcited by 0
- 2025PegasusFlow: Parallel Rolling-Denoising Score Sampling for Robot Diffusion Planner Flow Matchingcited by 0
- 2025Pretraining in Actor-Critic Reinforcement Learning for Locomotioncited by 0
- 2026Learning Dynamic Pick-and-Place for a Legged Manipulatorcited by 0
- 2026Learning Dynamic Pick-and-Place for a Legged Manipulator15 May 2026
- 2025Pretraining in Actor-Critic Reinforcement Learning for Locomotion14 Oct 2025
- 2025Ego-Vision World Model for Humanoid Contact Planning13 Oct 2025
- 2025PegasusFlow: Parallel Rolling-Denoising Score Sampling for Robot Diffusion Planner Flow Matching10 Sep 2025
- 2025INTENTION: Inferring Tendencies of Humanoid Robot Motion Through Interactive Intuition and Grounded VLM6 Aug 2025
- 2025Bipedalism for Quadrupedal Robots: Versatile Loco-Manipulation through Risk-Adaptive Reinforcement Learning27 Jul 2025
- 2025ZipMPC: Compressed Context-Dependent MPC Cost via Imitation Learning17 Jul 2025
- 2025Bayesian Inverse Physics for Neuro-Symbolic Robot Learning10 Jun 2025
- 2025Re4MPC: Reactive Nonlinear MPC for Multi-model Motion Planning via Deep Reinforcement Learning10 Jun 2025
- 2025Learning coordinated badminton skills for legged manipulators29 May 2025
- 2025Dexterous Manipulation through Imitation Learning: A Survey4 Apr 2025
- 2025Humanoid Whole-Body Locomotion on Narrow Terrain via Dynamic Balance and Reinforcement Learning24 Feb 2025
21 more
- 2025Bridging the Sim-to-Real Gap for Athletic Loco-Manipulation15 Feb 2025
- 2025A Unified and General Humanoid Whole-Body Controller for Versatile Locomotion5 Feb 2025
- 2025Dynamic object goal pushing with mobile manipulators through model-free constrained reinforcement learning3 Feb 2025
- 2025CAIMAN: Causal Action Influence Detection for Sample-efficient Loco-manipulation2 Feb 2025
- 2024Dynamic Non-Prehensile Object Transport via Model-Predictive Reinforcement Learning27 Nov 2024
- 2024Guided Reinforcement Learning for Robust Multi-Contact Loco-Manipulation17 Oct 2024
- 2024Goal-Conditioned Terminal Value Estimation for Real-time and Multi-task Model Predictive Control7 Oct 2024
- 2024Diffusion-Informed Probabilistic Contact Search for Multi-Finger Manipulation1 Oct 2024
- 2024Whole-body End-Effector Pose Tracking24 Sep 2024
- 2024Advancing Humanoid Locomotion: Mastering Challenging Terrains with Denoising World Model Learning26 Aug 2024
- 2024Learning Rapid Turning, Aerial Reorientation, and Balancing using Manipulator as a Tail15 Jul 2024
- 2024Learning Force Control for Legged Manipulation2 May 2024
- 2024Opening Articulated Structures in the Real World27 Feb 2024
- 2023Kinematically-Decoupled Impedance Control for Fast Object Visual Servoing and Grasping on Quadruped Manipulators10 Jul 2023
- 2023Predicting Motion Plans for Articulating Everyday Objects2 Mar 2023
- 2022Robotic Table Wiping via Reinforcement Learning and Whole-body Trajectory Optimization19 Oct 2022
- 2022N2M2: Learning Navigation for Arbitrary Mobile Manipulation Motions in Unseen and Dynamic Environments17 Jun 2022
- 2022Sim-to-Real Learning for Bipedal Locomotion Under Unsensed Dynamic Loads9 Apr 2022
- 2022A Transferable Legged Mobile Manipulation Framework Based on Disturbance Predictive Control2 Mar 2022
- 2021Evaluating model-based planning and planner amortization for continuous control7 Oct 2021
- 2021Articulated Object Interaction in Unknown Scenes with Whole-Body Mobile Manipulation18 Mar 2021
- 2021Articulated Object Interaction in Unknown Scenes with Whole-Body Mobile Manipulationcited by 44
- 2024Learning Force Control for Legged Manipulationcited by 19
- 2025Learning coordinated badminton skills for legged manipulatorscited by 16
- 2021Evaluating model-based planning and planner amortization for continuous controlcited by 15
- 2022N2M2: Learning Navigation for Arbitrary Mobile Manipulation Motions in Unseen and Dynamic Environmentscited by 15
- 2025Bridging the Sim-to-Real Gap for Athletic Loco-Manipulationcited by 11
- 2022Robotic Table Wiping via Reinforcement Learning and Whole-body Trajectory Optimizationcited by 10
- 2025A Unified and General Humanoid Whole-Body Controller for Versatile Locomotioncited by 10
- 2022Sim-to-Real Learning for Bipedal Locomotion Under Unsensed Dynamic Loadscited by 9
- 2024Guided Reinforcement Learning for Robust Multi-Contact Loco-Manipulationcited by 9
- 2025Humanoid Whole-Body Locomotion on Narrow Terrain via Dynamic Balance and Reinforcement Learningcited by 7
- 2023Predicting Motion Plans for Articulating Everyday Objectscited by 5
12 most cited of 27 All 27 (JSON)
- 2026Learning Dynamic Pick-and-Place for a Legged Manipulator15 May 2026
- 2025Pretraining in Actor-Critic Reinforcement Learning for Locomotion14 Oct 2025
- 2025INTENTION: Inferring Tendencies of Humanoid Robot Motion Through Interactive Intuition and Grounded VLM6 Aug 2025
- 2025Bipedalism for Quadrupedal Robots: Versatile Loco-Manipulation through Risk-Adaptive Reinforcement Learning27 Jul 2025
- 2025Bayesian Inverse Physics for Neuro-Symbolic Robot Learning10 Jun 2025
- 2025Re4MPC: Reactive Nonlinear MPC for Multi-model Motion Planning via Deep Reinforcement Learning10 Jun 2025
- 2025Learning coordinated badminton skills for legged manipulators29 May 2025
- 2025Humanoid Whole-Body Locomotion on Narrow Terrain via Dynamic Balance and Reinforcement Learning24 Feb 2025
- 2025Bridging the Sim-to-Real Gap for Athletic Loco-Manipulation15 Feb 2025
- 2025A Unified and General Humanoid Whole-Body Controller for Versatile Locomotion5 Feb 2025
- 2025Dynamic object goal pushing with mobile manipulators through model-free constrained reinforcement learning3 Feb 2025
- 2025CAIMAN: Causal Action Influence Detection for Sample-efficient Loco-manipulation2 Feb 2025
12 newest of 27 All 27 (JSON)