mlsanityData to 7 Oct 2026

Multi-skill Mobile Manipulation for Object Rearrangement

arXiv 2209.02778 ↗First posted 6 Sep 2022cs.RO cs.LGcited by 46

Not on the map. Why?

Abstract (arXiv)

We study a modular approach to tackle long-horizon mobile manipulation tasks for object rearrangement, which decomposes a full task into a sequence of subtasks. To tackle the entire task, prior work chains multiple stationary manipulation skills with a point-goal navigation skill, which are learned individually on subtasks. Although more effective than monolithic end-to-end RL policies, this framework suffers from compounding errors in skill chaining, e.g., navigating to a bad location where a stationary manipulation skill can not reach its target to manipulate. To this end, we propose that the manipulation skills should include mobility to have flexibility in interacting with the target object from multiple locations and at the same time the navigation skill could have multiple end points which lead to successful manipulation. We operationalize these ideas by implementing mobile manipulation skills rather than stationary ones and training a navigation skill trained with region goal instead of point goal. We evaluate our multi-skill mobile manipulation method M3 on 3 challenging long-horizon mobile manipulation tasks in the Home Assistant Benchmark (HAB), and show superior performance as compared to the baselines.

Key facts. Cited by 46 papers in the map (data through 7 Oct 2026). Builds on 20 of its 32 references that are in the map. First posted on arXiv 6 Sep 2022.

Builds on

20 of 32 references.

References · 20

  1. 2017Proximal Policy Optimization Algorithmscited by 14,441
  2. 2019Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learningcited by 1,168
  3. 2018On Evaluation of Embodied Navigation Agentscited by 526
  4. 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 501
  5. 2020robosuite: A Modular Simulation Framework and Benchmark for Robot Learningcited by 484
  6. 2020Object Goal Navigation using Goal-Oriented Semantic Explorationcited by 421
  7. 2019DD-PPO: Learning Near-Perfect PointGoal Navigators from 2.5 Billion Framescited by 352
  8. 2020Learning to Explore using Active Neural SLAMcited by 308
  9. 2020Integrated Task and Motion Planningcited by 281
  10. 2021ManiSkill: Generalizable Manipulation Skill Benchmark with Large-Scale Demonstrationscited by 193
  11. 2020Rearrangement: A Challenge for Embodied AIcited by 153
  12. 2018PDDLStream: Integrating Symbolic Planners and Blackbox Samplers via Optimistic Adaptive Planningcited by 147
8 more
  1. 2021ManipulaTHOR: A Framework for Visual Object Manipulationcited by 101
  2. 2019Interactive Gibson Benchmark (iGibson 0.5): A Benchmark for Interactive Navigation in Cluttered Environmentscited by 89
  3. 2021The ThreeDWorld Transport Challenge: A Visually Guided Task-and-Motion Planning Benchmark for Physically Realistic Embodied AIcited by 64
  4. 2021Adversarial Skill Chaining for Long-Horizon Robot Manipulation via Terminal State Regularizationcited by 44
  5. 2021Fully Autonomous Real-World Reinforcement Learning with Applications to Mobile Manipulationcited by 30
  6. 2019DoorGym: A Scalable Door Opening Environment And Baseline Agentcited by 26
  7. 2021Success Weighted by Completion Time: A Dynamics-Aware Evaluation Criteria for Embodied Navigationcited by 21
  8. 2021Towards Disturbance-Free Visual Mobile Manipulationcited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 2; 2023: 13; 2024: 19; 2025: 6; 2026: 6.

46 papers.

Sort:

By area:

  1. 2024Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperationcited by 377
  2. 2023ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skillscited by 313
  3. 2023Habitat 3.0: A Co-Habitat for Humans, Avatars and Robotscited by 220
  4. 2023Where are we in the search for an Artificial Visual Cortex for Embodied Intelligence?cited by 215
  5. 2023Large Language Models as Generalizable Policies for Embodied Taskscited by 86
  6. 2023ARNOLD: A Benchmark for Language-Grounded Task Learning With Continuous States in Realistic 3D Scenescited by 68
  7. 2024Visual Whole-Body Control for Legged Loco-Manipulationcited by 58
  8. 2024Theia: Distilling Diverse Vision Foundation Models for Robot Learningcited by 56
  9. 2024PoliFormer: Scaling On-Policy RL with Transformers Results in Masterful Navigatorscited by 55
  10. 2024TRANSIC: Sim-to-Real Policy Transfer by Learning from Online Correctioncited by 50
  11. 2024Closed-Loop Open-Vocabulary Mobile Manipulation with GPT-4Vcited by 40
  12. 2025MoManipVLA: Transferring Vision-language-action Models for General Mobile Manipulationcited by 34
34 more
  1. 2024Learning Generalizable Feature Fields for Mobile Manipulationcited by 31
  2. 2024M2Diffuser: Diffusion-based Trajectory Optimization for Mobile Manipulation in 3D Scenescited by 26
  3. 2023GAMMA: Graspability-Aware Mobile MAnipulation Policy Learning based on Online Grasping Pose Fusioncited by 21
  4. 2024Continuously Improving Mobile Manipulation with Autonomous Real-World RLcited by 20
  5. 2024ManiSkill-HAB: A Benchmark for Low-Level Manipulation in Home Rearrangement Taskscited by 20
  6. 2023Chain-of-Thought Predictive Controlcited by 18
  7. 2023Harmonic Mobile Manipulationcited by 16
  8. 2023Skill Transformer: A Monolithic Policy for Mobile Manipulationcited by 15
  9. 2023Adaptive Coordination in Social Embodied Rearrangementcited by 14
  10. 2023Learning Hierarchical Interactive Multi-Object Search for Mobile Manipulationcited by 12
  11. 2024DrS: Learning Reusable Dense Rewards for Multi-Stage Taskscited by 9
  12. 2023A Closer Look at Reward Decomposition for High-Level Robotic Explanationscited by 7
  13. 2024When Should We Prefer State-to-Visual DAgger Over Visual Reinforcement Learning?cited by 7
  14. 2024WildLMa: Long Horizon Loco-Manipulation in the Wildcited by 6
  15. 2022Learning-Augmented Model-Based Planning for Visual Explorationcited by 5
  16. 2024M3Bench: Benchmarking Whole-body Motion Generation for Mobile Manipulation in 3D Scenescited by 5
  17. 2023Galactic: Scaling End-to-End Reinforcement Learning for Rearrangement at 100k Steps-Per-Secondcited by 4
  18. 2025A Real-to-Sim-to-Real Approach to Robotic Manipulation with VLM-Generated Iterative Keypoint Rewardscited by 4
  19. 2025ManiTaskGen: A Comprehensive Task Generator for Benchmarking and Improving Vision-Language Agents on Embodied Decision-Makingcited by 4
  20. 2024Combining Planning and Diffusion for Mobility with Unknown Dynamicscited by 3
  21. 2025LodeStar: Long-horizon Dexterity via Synthetic Data Augmentation from Human Demonstrationscited by 3
  22. 2022Comparison of Model-Free and Model-Based Learning-Informed Planning for PointGoal Navigationcited by 2
  23. 2024Reinforcement Learning via Auxiliary Task Distillationcited by 2
  24. 2025EMMOE: A Comprehensive Benchmark for Embodied Mobile Manipulation in Open Environmentscited by 2
  25. 2026From Instruction to Event: Sound-Triggered Mobile Manipulationcited by 2
  26. 2026SoPE: Spherical Coordinate-Based Positional Embedding for Enhancing Spatial Perception of 3D LVLMscited by 2
  27. 2024ReMoBot: Retrieval-Based Few-Shot Imitation Learning for Mobile Manipulation with Vision Foundation Modelscited by 1
  28. 2024Hierarchical Object-Oriented POMDP Planning for Object Rearrangementcited by 1
  29. 2025RoboPARA: Dual-Arm Robot Planning with Parallel Allocation and Recomposition Across Taskscited by 1
  30. 2024Learning the Generalizable Manipulation Skills on Soft-body Tasks via Guided Self-attention Behavior Cloning Policycited by 0
  31. 2026Whole-Body Mobile Manipulation using Offline Reinforcement Learning on Sub-optimal Controllerscited by 0
  32. 2026Diffusion Policy for Coordinated Control of a Nonholonomic Mobile Base and Dual Arms in Door Opening and Passingcited by 0
  33. 2026MAVP: Map-Aware Visuomotor Policies for Mobile Manipulationcited by 0
  34. 2026SEES: A Self-Evolving Embodied System via Failure-Guided VLA Policy Adaptationcited by 0