Effective Baselines for Multiple Object Rearrangement Planning in Partially Observable Mapped Environments
Not on the map. Why?
Abstract (arXiv)
Many real-world tasks, from house-cleaning to cooking, can be formulated as multi-object rearrangement problems -- where an agent needs to get specific objects into appropriate goal states. For such problems, we focus on the setting that assumes a pre-specified goal state, availability of perfect manipulation and object recognition capabilities, and a static map of the environment but unknown initial location of objects to be rearranged. Our goal is to enable home-assistive intelligent agents to efficiently plan for rearrangement under such partial observability. This requires efficient trade-offs between exploration of the environment and planning for rearrangement, which is challenging because of long-horizon nature of the problem. To make progress on this problem, we first analyze the effects of various factors such as number of objects and receptacles, agent carrying capacity, environment layouts etc. on exploration and planning for rearrangement using classical methods. We then investigate both monolithic and modular deep reinforcement learning (DRL) methods for planning in our setting. We find that monolithic DRL methods do not succeed at long-horizon planning needed for multi-object rearrangement. Instead, modular greedy approaches surprisingly perform reasonably well and emerge as competitive baselines for planning with partial observability in multi-object rearrangement problems. We also show that our greedy modular agents are empirically optimal when the objects that need to be rearranged are uniformly distributed in the environment -- thereby contributing baselines with strong performance for future work on multi-object rearrangement planning in partially observable settings.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 20 of its 38 references that are in the map. First posted on arXiv 24 Jan 2023.
Builds on
20 of 38 references.
References · 20
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 592
- 2018On Evaluation of Embodied Navigation Agentscited by 547
- 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 511
- 2018Gibson Env: Real-World Perception for Embodied Agentscited by 481
- 2019DD-PPO: Learning Near-Perfect PointGoal Navigators from 2.5 Billion Framescited by 362
- 2020Learning to Explore using Active Neural SLAMcited by 316
- 2018An Intriguing Failing of Convolutional Neural Networks and the CoordConv Solutioncited by 307
- 2020Integrated Task and Motion Planningcited by 290
- 2016Modular Multitask Reinforcement Learning with Policy Sketchescited by 203
- 2020Rearrangement: A Challenge for Embodied AIcited by 155
- 2019Learning Exploration Policies for Navigationcited by 116
8 more
- 2021Visual Room Rearrangementcited by 102
- 2022TASKOGRAPHY: Evaluating robot task planning over large 3D scene graphscited by 59
- 2020An Exploration of Embodied Visual Explorationcited by 58
- 2022Housekeep: Tidying Virtual Households using Commonsense Reasoningcited by 57
- 2021My House, My Rules: Learning Tidying Preferences with Graph Neural Networkscited by 27
- 2020The Robotic Vision Scene Understanding Challengecited by 9
- 2020Beyond Tabula-Rasa: a Modular Reinforcement Learning Approach for Physically Embedded 3D Sokobancited by 7
- 2020Optimal Assistance for Object-Rearrangement Tasks in Augmented Realitycited by 3
Built on by
Citing papers per year: 2024: 1.
1 paper.