Long-HOT: A Modular Hierarchical Approach for Long-Horizon Object Transport
Not on the map. Why?
Abstract (arXiv)
We address key challenges in long-horizon embodied exploration and navigation by proposing a new object transport task and a novel modular framework for temporally extended navigation. Our first contribution is the design of a novel Long-HOT environment focused on deep exploration and long-horizon planning where the agent is required to efficiently find and pick up target objects to be carried and dropped at a goal location, with load constraints and optional access to a container if it finds one. Further, we propose a modular hierarchical transport policy (HTP) that builds a topological graph of the scene to perform exploration with the help of weighted frontiers. Our hierarchical approach uses a combination of motion planning algorithms to reach point goals within explored locations and object navigation policies for moving towards semantic targets at unknown locations. Experiments on both our proposed Habitat transport task and on MultiOn benchmarks show that our method significantly outperforms baselines and prior works. Further, we validate the effectiveness of our modular approach for long-horizon transport by demonstrating meaningful generalization to much harder transport scenes with training only on simpler versions of the task.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 38 of its 50 references that are in the map. First posted on arXiv 28 Oct 2022.
Builds on
38 of 50 references.
References · 38
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
- 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,013
- 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 850
- 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 773
- 2018On Evaluation of Embodied Navigation Agentscited by 526
- 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 501
- 2018Gibson Env: Real-World Perception for Embodied Agentscited by 477
- 2016The Option-Critic Architecturecited by 433
26 more
- 2020Object Goal Navigation using Goal-Oriented Semantic Explorationcited by 421
- 2018VirtualHome: Simulating Household Activities via Programscited by 411
- 2019DD-PPO: Learning Near-Perfect PointGoal Navigators from 2.5 Billion Framescited by 352
- 2017Embodied Question Answeringcited by 335
- 2020Integrated Task and Motion Planningcited by 281
- 2020ObjectNav Revisited: On Evaluation of Embodied Agents Navigating to Objectscited by 240
- 2017Cognitive Mapping and Planning for Visual Navigationcited by 209
- 2020Neural Topological SLAM for Visual Navigationcited by 193
- 2020RoboTHOR: An Open Simulation-to-Real Embodied AI Platformcited by 190
- 2020iGibson 1.0: a Simulation Environment for Interactive Tasks in Large Realistic Scenescited by 151
- 2020Watch-And-Help: A Challenge for Social Perception and Human-AI Collaborationcited by 131
- 2018Visual Semantic Navigation using Scene Priorscited by 127
- 2021Waypoint Models for Instruction-guided Navigation in Continuous Environmentscited by 125
- 2019Scene Memory Transformer for Embodied Agents in Long-Horizon Taskscited by 106
- 2020Occupancy Anticipation for Efficient Exploration and Navigationcited by 104
- 2021Visual Room Rearrangementcited by 101
- 2020MultiON: Benchmarking Semantic Map Memory using Multi-Object Navigationcited by 95
- 2018Learning to Learn How to Learn: Self-Adaptive Visual Navigation Using Meta-Learningcited by 91
- 2021The ThreeDWorld Transport Challenge: A Visually Guided Task-and-Motion Planning Benchmark for Physically Realistic Embodied AIcited by 64
- 2016Control of Memory, Active Perception, and Action in Minecraftcited by 61
- 2018Neural Modular Control for Embodied Question Answeringcited by 56
- 2020A Cordial Sync: Going Beyond Marginal Policies for Multi-Agent Embodied Taskscited by 52
- 2020ReLMoGen: Leveraging Motion Generation in Reinforcement Learning for Mobile Manipulationcited by 47
- 2016FFRob: Leveraging Symbolic Planning for Efficient Task and Motion Planningcited by 34
- 2020Motion Planner Augmented Reinforcement Learning for Robot Manipulation in Obstructed Environmentscited by 19
- 2021Teaching Agents how to Map: Spatial Reasoning for Multi-Object Navigationcited by 17
Built on by
Not cited yet.