Combining Learning-based Locomotion Policy with Model-based Manipulation for Legged Mobile Manipulators
Not on the map. Why?
Abstract (arXiv)
Deep reinforcement learning produces robust locomotion policies for legged robots over challenging terrains. To date, few studies have leveraged model-based methods to combine these locomotion skills with the precise control of manipulators. Here, we incorporate external dynamics plans into learning-based locomotion policies for mobile manipulation. We train the base policy by applying a random wrench sequence on the robot base in simulation and adding the noisified wrench sequence prediction to the policy observations. The policy then learns to counteract the partially-known future disturbance. The random wrench sequences are replaced with the wrench prediction generated with the dynamics plans from model predictive control to enable deployment. We show zero-shot adaptation for manipulators unseen during training. On the hardware, we demonstrate stable locomotion of legged robots with the prediction of the external wrench.
Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). First posted on arXiv 11 Jan 2022.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2022: 2; 2023: 4; 2024: 15; 2025: 9; 2026: 2.
32 papers.
Sort:
By area:
- 2024Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperationcited by 377
- 2024Deep Reinforcement Learning for Robotics: A Survey of Real-World Successescited by 153
- 2023Robot Parkour Learningcited by 115
- 2022Deep Whole-Body Control: Learning a Unified Policy for Manipulation and Locomotioncited by 98
- 2023DoReMi: Grounding Language Model by Detecting and Recovering from Plan-Execution Misalignmentcited by 58
- 2024Visual Whole-Body Control for Legged Loco-Manipulationcited by 58
- 2022Holo-Dex: Teaching Dexterity with Immersive Mixed Realitycited by 52
- 2024Mobile-TeleVision: Predictive Motion Priors for Humanoid Whole-Body Controlcited by 41
- 2023DribbleBot: Dynamic Legged Manipulation in the Wildcited by 33
- 2024M2Diffuser: Diffusion-based Trajectory Optimization for Mobile Manipulation in 3D Scenescited by 26
- 2024Continuously Improving Mobile Manipulation with Autonomous Real-World RLcited by 20
- 2025Learning coordinated badminton skills for legged manipulatorscited by 16
20 more
- 2024Learning to Open and Traverse Doors with a Legged Manipulatorcited by 14
- 2025Bridging the Sim-to-Real Gap for Athletic Loco-Manipulationcited by 11
- 2024Autonomous Behavior Planning For Humanoid Loco-manipulation Through Grounded Language Modelcited by 8
- 2024Helpful DoggyBot: Open-World Object Fetching using Legged Robots and Vision-Language Modelscited by 8
- 2024HYPERmotion: Learning Hybrid Behavior Planning for Autonomous Loco-manipulationcited by 7
- 2024WildLMa: Long Horizon Loco-Manipulation in the Wildcited by 6
- 2024Whole-body End-Effector Pose Trackingcited by 5
- 2024Learning Whole-Body Loco-Manipulation for Omni-Directional Task Space Pose Tracking with a Wheeled-Quadrupedal-Manipulatorcited by 5
- 2025SLIM: Sim-to-Real Legged Instructive Manipulation via Long-Horizon Visuomotor Learningcited by 4
- 2024Combining Planning and Diffusion for Mobility with Unknown Dynamicscited by 3
- 2025FALCON: Actively Decoupled Visuomotor Policies for Loco-Manipulation with Foundation-Model-Based Coordinationcited by 3
- 2023Decentralized Motor Skill Learning for Complex Robotic Systemscited by 2
- 2025Integrating Learning-Based Manipulation and Physics-Based Locomotion for Whole-Body Badminton Robot Controlcited by 2
- 2024Human-Humanoid Robots Cross-Embodiment Behavior-Skill Transfer Using Decomposed Adversarial Learning from Demonstrationcited by 1
- 2025Bipedalism for Quadrupedal Robots: Versatile Loco-Manipulation through Risk-Adaptive Reinforcement Learningcited by 1
- 2025MoDeSuite: Robot Learning Task Suite for Benchmarking Mobile Manipulation with Deformable Objectscited by 1
- 2026CMP: Robust Whole-Body Tracking for Loco-Manipulation via Competence Manifold Projectioncited by 1
- 2025Inverse RL Scene Dynamics Learning for Nonlinear Predictive Control in Autonomous Vehiclescited by 0
- 2025Scoop-and-Toss: Dynamic Object Collection for Quadrupedal Systemscited by 0
- 2026Learning Dynamic Pick-and-Place for a Legged Manipulatorcited by 0
- 2026Learning Dynamic Pick-and-Place for a Legged Manipulator15 May 2026
- 2026CMP: Robust Whole-Body Tracking for Loco-Manipulation via Competence Manifold Projection8 Apr 2026
- 2025FALCON: Actively Decoupled Visuomotor Policies for Loco-Manipulation with Foundation-Model-Based Coordination4 Dec 2025
- 2025MoDeSuite: Robot Learning Task Suite for Benchmarking Mobile Manipulation with Deformable Objects29 Jul 2025
- 2025Bipedalism for Quadrupedal Robots: Versatile Loco-Manipulation through Risk-Adaptive Reinforcement Learning27 Jul 2025
- 2025Scoop-and-Toss: Dynamic Object Collection for Quadrupedal Systems11 Jun 2025
- 2025Learning coordinated badminton skills for legged manipulators29 May 2025
- 2025Integrating Learning-Based Manipulation and Physics-Based Locomotion for Whole-Body Badminton Robot Control24 Apr 2025
- 2025Inverse RL Scene Dynamics Learning for Nonlinear Predictive Control in Autonomous Vehicles2 Apr 2025
- 2025Bridging the Sim-to-Real Gap for Athletic Loco-Manipulation15 Feb 2025
- 2025SLIM: Sim-to-Real Legged Instructive Manipulation via Long-Horizon Visuomotor Learning17 Jan 2025
- 2024Human-Humanoid Robots Cross-Embodiment Behavior-Skill Transfer Using Decomposed Adversarial Learning from Demonstration19 Dec 2024
20 more
- 2024Mobile-TeleVision: Predictive Motion Priors for Humanoid Whole-Body Control10 Dec 2024
- 2024Learning Whole-Body Loco-Manipulation for Omni-Directional Task Space Pose Tracking with a Wheeled-Quadrupedal-Manipulator4 Dec 2024
- 2024WildLMa: Long Horizon Loco-Manipulation in the Wild22 Nov 2024
- 2024M2Diffuser: Diffusion-based Trajectory Optimization for Mobile Manipulation in 3D Scenes15 Oct 2024
- 2024Combining Planning and Diffusion for Mobility with Unknown Dynamics9 Oct 2024
- 2024Helpful DoggyBot: Open-World Object Fetching using Legged Robots and Vision-Language Models30 Sep 2024
- 2024Continuously Improving Mobile Manipulation with Autonomous Real-World RL30 Sep 2024
- 2024Whole-body End-Effector Pose Tracking24 Sep 2024
- 2024Learning to Open and Traverse Doors with a Legged Manipulator7 Sep 2024
- 2024Autonomous Behavior Planning For Humanoid Loco-manipulation Through Grounded Language Model15 Aug 2024
- 2024Deep Reinforcement Learning for Robotics: A Survey of Real-World Successes7 Aug 2024
- 2024HYPERmotion: Learning Hybrid Behavior Planning for Autonomous Loco-manipulation20 Jun 2024
- 2024Visual Whole-Body Control for Legged Loco-Manipulation25 Mar 2024
- 2024Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperation4 Jan 2024
- 2023Robot Parkour Learning11 Sep 2023
- 2023DoReMi: Grounding Language Model by Detecting and Recovering from Plan-Execution Misalignment1 Jul 2023
- 2023Decentralized Motor Skill Learning for Complex Robotic Systems30 Jun 2023
- 2023DribbleBot: Dynamic Legged Manipulation in the Wild3 Apr 2023
- 2022Deep Whole-Body Control: Learning a Unified Policy for Manipulation and Locomotion18 Oct 2022
- 2022Holo-Dex: Teaching Dexterity with Immersive Mixed Reality12 Oct 2022
- 2024Deep Reinforcement Learning for Robotics: A Survey of Real-World Successescited by 153
- 2023Robot Parkour Learningcited by 115
- 2022Deep Whole-Body Control: Learning a Unified Policy for Manipulation and Locomotioncited by 98
- 2024Visual Whole-Body Control for Legged Loco-Manipulationcited by 58
- 2022Holo-Dex: Teaching Dexterity with Immersive Mixed Realitycited by 52
- 2024Mobile-TeleVision: Predictive Motion Priors for Humanoid Whole-Body Controlcited by 41
- 2023DribbleBot: Dynamic Legged Manipulation in the Wildcited by 33
- 2024Continuously Improving Mobile Manipulation with Autonomous Real-World RLcited by 20
- 2025Learning coordinated badminton skills for legged manipulatorscited by 16
- 2024Learning to Open and Traverse Doors with a Legged Manipulatorcited by 14
- 2025Bridging the Sim-to-Real Gap for Athletic Loco-Manipulationcited by 11
- 2024Autonomous Behavior Planning For Humanoid Loco-manipulation Through Grounded Language Modelcited by 8
12 most cited of 24 All 24 (JSON)
- 2026Learning Dynamic Pick-and-Place for a Legged Manipulator15 May 2026
- 2026CMP: Robust Whole-Body Tracking for Loco-Manipulation via Competence Manifold Projection8 Apr 2026
- 2025MoDeSuite: Robot Learning Task Suite for Benchmarking Mobile Manipulation with Deformable Objects29 Jul 2025
- 2025Bipedalism for Quadrupedal Robots: Versatile Loco-Manipulation through Risk-Adaptive Reinforcement Learning27 Jul 2025
- 2025Scoop-and-Toss: Dynamic Object Collection for Quadrupedal Systems11 Jun 2025
- 2025Learning coordinated badminton skills for legged manipulators29 May 2025
- 2025Bridging the Sim-to-Real Gap for Athletic Loco-Manipulation15 Feb 2025
- 2025SLIM: Sim-to-Real Legged Instructive Manipulation via Long-Horizon Visuomotor Learning17 Jan 2025
- 2024Human-Humanoid Robots Cross-Embodiment Behavior-Skill Transfer Using Decomposed Adversarial Learning from Demonstration19 Dec 2024
- 2024Mobile-TeleVision: Predictive Motion Priors for Humanoid Whole-Body Control10 Dec 2024
- 2024Learning Whole-Body Loco-Manipulation for Omni-Directional Task Space Pose Tracking with a Wheeled-Quadrupedal-Manipulator4 Dec 2024
- 2024Helpful DoggyBot: Open-World Object Fetching using Legged Robots and Vision-Language Models30 Sep 2024
12 newest of 24 All 24 (JSON)