mlsanityData to 7 Oct 2026

Long-HOT: A Modular Hierarchical Approach for Long-Horizon Object Transport

arXiv 2210.15908 ↗First posted 28 Oct 2022cs.CV cs.ROcited by 0

Not on the map. Why?

Abstract (arXiv)

We address key challenges in long-horizon embodied exploration and navigation by proposing a new object transport task and a novel modular framework for temporally extended navigation. Our first contribution is the design of a novel Long-HOT environment focused on deep exploration and long-horizon planning where the agent is required to efficiently find and pick up target objects to be carried and dropped at a goal location, with load constraints and optional access to a container if it finds one. Further, we propose a modular hierarchical transport policy (HTP) that builds a topological graph of the scene to perform exploration with the help of weighted frontiers. Our hierarchical approach uses a combination of motion planning algorithms to reach point goals within explored locations and object navigation policies for moving towards semantic targets at unknown locations. Experiments on both our proposed Habitat transport task and on MultiOn benchmarks show that our method significantly outperforms baselines and prior works. Further, we validate the effectiveness of our modular approach for long-horizon transport by demonstrating meaningful generalization to much harder transport scenes with training only on simpler versions of the task.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 38 of its 50 references that are in the map. First posted on arXiv 28 Oct 2022.

Builds on

38 of 50 references.

References · 38

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2017Proximal Policy Optimization Algorithmscited by 14,441
  3. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  4. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
  5. 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
  6. 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,013
  7. 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 850
  8. 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 773
  9. 2018On Evaluation of Embodied Navigation Agentscited by 526
  10. 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 501
  11. 2018Gibson Env: Real-World Perception for Embodied Agentscited by 477
  12. 2016The Option-Critic Architecturecited by 433
26 more
  1. 2020Object Goal Navigation using Goal-Oriented Semantic Explorationcited by 421
  2. 2018VirtualHome: Simulating Household Activities via Programscited by 411
  3. 2019DD-PPO: Learning Near-Perfect PointGoal Navigators from 2.5 Billion Framescited by 352
  4. 2017Embodied Question Answeringcited by 335
  5. 2020Integrated Task and Motion Planningcited by 281
  6. 2020ObjectNav Revisited: On Evaluation of Embodied Agents Navigating to Objectscited by 240
  7. 2017Cognitive Mapping and Planning for Visual Navigationcited by 209
  8. 2020Neural Topological SLAM for Visual Navigationcited by 193
  9. 2020RoboTHOR: An Open Simulation-to-Real Embodied AI Platformcited by 190
  10. 2020iGibson 1.0: a Simulation Environment for Interactive Tasks in Large Realistic Scenescited by 151
  11. 2020Watch-And-Help: A Challenge for Social Perception and Human-AI Collaborationcited by 131
  12. 2018Visual Semantic Navigation using Scene Priorscited by 127
  13. 2021Waypoint Models for Instruction-guided Navigation in Continuous Environmentscited by 125
  14. 2019Scene Memory Transformer for Embodied Agents in Long-Horizon Taskscited by 106
  15. 2020Occupancy Anticipation for Efficient Exploration and Navigationcited by 104
  16. 2021Visual Room Rearrangementcited by 101
  17. 2020MultiON: Benchmarking Semantic Map Memory using Multi-Object Navigationcited by 95
  18. 2018Learning to Learn How to Learn: Self-Adaptive Visual Navigation Using Meta-Learningcited by 91
  19. 2021The ThreeDWorld Transport Challenge: A Visually Guided Task-and-Motion Planning Benchmark for Physically Realistic Embodied AIcited by 64
  20. 2016Control of Memory, Active Perception, and Action in Minecraftcited by 61
  21. 2018Neural Modular Control for Embodied Question Answeringcited by 56
  22. 2020A Cordial Sync: Going Beyond Marginal Policies for Multi-Agent Embodied Taskscited by 52
  23. 2020ReLMoGen: Leveraging Motion Generation in Reinforcement Learning for Mobile Manipulationcited by 47
  24. 2016FFRob: Leveraging Symbolic Planning for Efficient Task and Motion Planningcited by 34
  25. 2020Motion Planner Augmented Reinforcement Learning for Robot Manipulation in Obstructed Environmentscited by 19
  26. 2021Teaching Agents how to Map: Spatial Reasoning for Multi-Object Navigationcited by 17

Built on by

Not cited yet.