ESCAPE: Episodic Spatial Memory and Adaptive Execution Policy for Long-Horizon Mobile Manipulation
Not on the map. Why?
Abstract (arXiv)
Coordinating navigation and manipulation with robust performance is essential for embodied AI in complex indoor environments. However, as tasks extend over long horizons, existing methods often struggle due to catastrophic forgetting, spatial inconsistency, and rigid execution. To address these issues, we propose ESCAPE (Episodic Spatial Memory Coupled with an Adaptive Policy for Execution), operating through a tightly coupled perception-grounding-execution workflow. For robust perception, ESCAPE features a Spatio-Temporal Fusion Mapping module to autoregressively construct a depth-free, persistent 3D spatial memory, alongside a Memory-Driven Target Grounding module for precise interaction mask generation. To achieve flexible action, our Adaptive Execution Policy dynamically orchestrates proactive global navigation and reactive local manipulation to seize opportunistic targets. ESCAPE achieves state-of-the-art performance on the ALFRED benchmark, reaching 65.09% and 60.79% success rates in test seen and unseen environments with step-by-step instructions. By reducing redundant exploration, our ESCAPE attains substantial improvements in path-length-weighted metrics and maintains robust performance (61.24% / 56.04%) even without detailed guidance for long-horizon tasks.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 43 of its 55 references that are in the map. First posted on arXiv 15 Apr 2026.
Builds on
43 of 55 references.
References · 43
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,040
- 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 850
- 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 773
- 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 711
- 2023Mip-Splatting: Alias-free 3D Gaussian Splattingcited by 661
31 more
- 2021DETR3D: 3D Object Detection from Multi-view Images via 3D-to-2D Queriescited by 655
- 2022OpenScene: 3D Scene Understanding with Open Vocabulariescited by 556
- 2022PETR: Position Embedding Transformation for Multi-View 3D Object Detectioncited by 550
- 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 501
- 2022LLM-Planner: Few-Shot Grounded Planning for Embodied Agents with Large Language Modelscited by 459
- 2022BEVFusion: A Simple and Robust LiDAR-Camera Fusion Frameworkcited by 334
- 2016Learning Hand-Eye Coordination for Robotic Grasping with Deep Learning and Large-Scale Data Collectioncited by 312
- 2022Mask3D: Mask Transformer for 3D Semantic Instance Segmentationcited by 299
- 2020ObjectNav Revisited: On Evaluation of Embodied Agents Navigating to Objectscited by 240
- 2024A Survey on 3D Gaussian Splattingcited by 221
- 2025EmbodiedBench: Comprehensive Benchmarking Multi-modal Large Language Models for Vision-Driven Embodied Agentscited by 213
- 2019Cross-view Semantic Segmentation for Sensing Surroundingscited by 173
- 2021BEHAVIOR: Benchmark for Everyday Household Activities in Virtual, Interactive, and Ecological Environmentscited by 161
- 2021Episodic Transformer for Vision-and-Language Navigationcited by 155
- 2020Language-Conditioned Imitation Learning for Robot Manipulation Taskscited by 136
- 2021FILM: Following Instructions in Language with Modular Methodscited by 119
- 2021SOON: Scenario Oriented Object Navigation with Graph-based Explorationcited by 118
- 2021Structured Bird's-Eye-View Traffic Scene Understanding from Onboard Imagescited by 98
- 2021A Persistent Spatial Semantic Representation for High-level Natural Language Instruction Executioncited by 91
- 2025EmbodiedEval: Evaluate Multimodal LLMs as Embodied Agentscited by 55
- 2023SPOC: Imitating Shortest Paths in Simulation Enables Effective Navigation and Manipulation in the Real Worldcited by 47
- 2023I2-SDF: Intrinsic Indoor Scene Reconstruction and Editing via Raytracing in Neural SDFscited by 42
- 2022Prompter: Utilizing Large Language Model Prompting for a Data Efficient Embodied Instruction Followingcited by 33
- 2023Context-Aware Planning and Environment-Aware Memory for Instruction Following Embodied Agentscited by 33
- 2023Semantic Ray: Learning a Generalizable Semantic Field with Cross-Reprojection Attentioncited by 29
- 2020Factorizing Perception and Policy for Interactive Instruction Followingcited by 28
- 2024EPO: Hierarchical LLM Agents with Environment Preference Optimizationcited by 28
- 2019Embodied Language Grounding with 3D Visual Feature Representationscited by 20
- 2023ThinkBot: Embodied Instruction Following with Thought Chain Reasoningcited by 19
- 2024Embodied Instruction Following in Unknown Environmentscited by 8
- 2024DISCO: Embodied Navigation and Interaction via Differentiable Scene Semantics and Dual-level Controlcited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.