APEX: A Decoupled Memory-based Explorer for Asynchronous Aerial Object Goal Navigation
Not on the map. Why?
Abstract (arXiv)
Aerial Object Goal Navigation, a challenging frontier in Embodied AI, requires an Unmanned Aerial Vehicle (UAV) agent to autonomously explore, reason, and identify a specific target using only visual perception and language description. However, existing methods struggle with the memorization of complex spatial representations in aerial environments, reliable and interpretable action decision-making, and inefficient exploration and information gathering. To address these challenges, we introduce APEX (Aerial Parallel Explorer), a novel hierarchical agent designed for efficient exploration and target acquisition in complex aerial settings. APEX is built upon a modular, three-part architecture: 1) Dynamic Spatio-Semantic Mapping Memory, which leverages the zero-shot capability of a Vision-Language Model (VLM) to dynamically construct high-resolution 3D Attraction, Exploration, and Obstacle maps, serving as an interpretable memory mechanism. 2) Action Decision Module, trained with reinforcement learning, which translates this rich spatial understanding into a fine-grained and robust control policy. 3) Target Grounding Module, which employs an open-vocabulary detector to achieve definitive and generalizable target identification. All these components are integrated into a hierarchical, asynchronous, and parallel framework, effectively bypassing the VLM's inference latency and boosting the agent's proactivity in exploration. Extensive experiments show that APEX outperforms the previous state of the art by +4.2% SR and +2.8% SPL on challenging UAV-ON benchmarks, demonstrating its superior efficiency and the effectiveness of its hierarchical asynchronous design. Our source code is provided in hrefhttps://github.com/4amGodvzx/apexGitHub
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 45 of its 60 references that are in the map. First posted on arXiv 31 Jan 2026.
Builds on
45 of 60 references.
References · 45
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
- 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
- 2023A Survey on Multimodal Large Language Modelscited by 909
- 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 869
- 2023Vision-Language Models for Vision Tasks: A Surveycited by 839
- 2018On Evaluation of Embodied Navigation Agentscited by 547
- 2020Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environmentscited by 441
33 more
- 2023AerialVLN: Vision-and-Language Navigation for UAVscited by 121
- 2023L3MVN: Leveraging Large Language Models for Visual Target Navigationcited by 120
- 2022Vision-and-Language Navigation: A Survey of Tasks, Methods, and Future Directionscited by 117
- 2024NavGPT-2: Unleashing Navigational Reasoning Capability for Large Vision-Language Modelscited by 98
- 2025A Survey on Vision-Language-Action Models: An Action Tokenization Perspectivecited by 96
- 2024Towards Realistic UAV Vision-Language Navigation: Platform, Benchmark, and Methodologycited by 95
- 2023PIRLNav: Pretraining with Imitation and RL Finetuning for ObjectNavcited by 93
- 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Modelscited by 90
- 2024Vision-and-Language Navigation Today and Tomorrow: A Survey in the Era of Foundation Modelscited by 79
- 2024Exploring the Frontier of Vision-Language Models: A Survey of Current Methodologies and Future Directionscited by 68
- 2024VoroNav: Voronoi-based Zero-shot Object Navigation with Large Language Modelcited by 57
- 2025UAVs Meet LLMs: Overviews and Perspectives Toward Agentic Low-Altitude Mobilitycited by 49
- 2023Towards Natural Language-Guided Drones: GeoText-1652 Benchmark with Spatial Relation Matchingcited by 42
- 2021Vision-Language Navigation: A Survey and Taxonomycited by 34
- 2025UAV-ON: A Benchmark for Open-World Object Goal Navigation with Aerial Agentscited by 33
- 2025CityNavAgent: Aerial Vision-and-Language Navigation with Hierarchical Semantic Planning and Global Memorycited by 32
- 2025UAV-Flow Colosseo: A Real-World Benchmark for Flying-on-a-Word UAV Imitation Learningcited by 31
- 2024AeroVerse: UAV-Agent Benchmark Suite for Simulating, Pre-training, Finetuning, and Evaluating Aerospace Embodied World Modelscited by 25
- 2025RaceVLA: VLA-based Racing Drone Navigation with Human-like Behaviourcited by 23
- 2025CognitiveDrone: A VLA Model and Evaluation Benchmark for Real-Time Cognitive Task Solving and Reasoning in UAVscited by 22
- 2025RefDrone: A Challenging Benchmark for Referring Expression Comprehension in Drone Scenescited by 19
- 2025Grounded Vision-Language Navigation for UAVs with Open-Vocabulary Goal Understandingcited by 19
- 2024NavAgent: Multi-scale Urban Street View Fusion For UAV Embodied Vision-and-Language Navigationcited by 18
- 2025SkyVLN: Vision-and-Language Navigation and NMPC Control for UAVs in Urban Environmentscited by 14
- 2025UAVs Meet Agentic AI: A Multidomain Survey of Autonomous Aerial Intelligence and Agentic UAVscited by 13
- 2025Aerial Vision-and-Language Navigation with Grid-based View Selection and Map Constructioncited by 12
- 2025RAVEN: Resilient Aerial Navigation via Open-Set Semantic Memory and Behavior Adaptationcited by 10
- 2025General-Purpose Aerial Intelligent Agents Empowered by Large Language Modelscited by 9
- 2025LogisticsVLN: Vision-Language Navigation For Low-Altitude Terminal Delivery Based on Agentic UAVscited by 9
- 2025RAPID: Robust and Agile Planner Using Inverse Reinforcement Learning for Vision-Based Drone Navigationcited by 6
- 2025AirVista-II: An Agentic System for Embodied UAVs Toward Dynamic Scene Semantic Understandingcited by 4
- 2025Taking Flight with Dialogue: Enabling Natural Language Control for PX4-based Drone Agentcited by 4
- 2025Language-Guided Generation for Personalized Inspection Planningcited by 2
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026ESARBench: A Benchmark for Agentic UAV Embodied Search and Rescuecited by 4
- 2026FSD-VLN: Fast-Slow Dual-System Modeling for Aerial Long-Horizon Vision-Language Navigationcited by 3
- 2026SpatialFly: Implicit 3D Prior-Guided Visual Reparameterization for Continuous UAV Vision-and-Language Navigationcited by 1
- 2026UAVs Meet Embodied Intelligence: Bridging Human Intents and Flying Dynamics Via Harnessing Physical-Digital AI Agentscited by 0
- 2026AerialDojo-200K: A Large-Scale Benchmark Suite for Open-World Aerial Object-Goal Searchcited by 0
- 2026AerialDojo-200K: A Large-Scale Benchmark Suite for Open-World Aerial Object-Goal Search28 Sep 2026
- 2026UAVs Meet Embodied Intelligence: Bridging Human Intents and Flying Dynamics Via Harnessing Physical-Digital AI Agents16 Sep 2026
- 2026FSD-VLN: Fast-Slow Dual-System Modeling for Aerial Long-Horizon Vision-Language Navigation9 Jul 2026
- 2026ESARBench: A Benchmark for Agentic UAV Embodied Search and Rescue2 May 2026
- 2026SpatialFly: Implicit 3D Prior-Guided Visual Reparameterization for Continuous UAV Vision-and-Language Navigation22 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2026AirAnchor: Bridging Local and Global Spatial Information for Zero-Shot Aerial Vision-and-Language Navigation
- 2026DreamFly: Causal Memory and Receding-Horizon Diffusion Planning for Aerial Vision-Language Navigation
- 2026Dual-Layer Semantic-Spatial Belief Mapping for Aerial Object Goal Navigation
- 2026VLN on the Fly: An Onboard Vision-Language Navigation Stack for Aerial Robots
- 2026Parse, Search, and Confirmation: Training-Free Aerial Vision-and-Dialog Navigation with Chain-of-Thought Reasoning and Structured Spatial Memory
- 2025Towards Autonomous UAV Visual Object Search in City Space: Benchmark and Agentic Methodology
- 2026SearchWorld: Spatial Value-Grounded Imagination for UAV Object Search via World Models
- 2026LookasideVLN: Direction-Aware Aerial Vision-and-Language Navigation