GeoExplorer: Active Geo-localization with Curiosity-Driven Exploration
On the map: Deep reinforcement learning methods → RL for robot navigation and UAV control
Abstract (arXiv)
Active Geo-localization (AGL) is the task of localizing a goal, represented in various modalities (e.g., aerial images, ground-level images, or text), within a predefined search area. Current methods approach AGL as a goal-reaching reinforcement learning (RL) problem with a distance-based reward. They localize the goal by implicitly learning to minimize the relative distance from it. However, when distance estimation becomes challenging or when encountering unseen targets and environments, the agent exhibits reduced robustness and generalization ability due to the less reliable exploration strategy learned during training. In this paper, we propose GeoExplorer, an AGL agent that incorporates curiosity-driven exploration through intrinsic rewards. Unlike distance-based rewards, our curiosity-driven reward is goal-agnostic, enabling robust, diverse, and contextually relevant exploration based on effective environment modeling. These capabilities have been proven through extensive experiments across four AGL benchmarks, demonstrating the effectiveness and generalization ability of GeoExplorer in diverse settings, particularly in localizing unfamiliar targets and environments.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in RL for robot navigation and UAV control, one of 15 directions in Deep reinforcement learning methods. Builds on 45 of its 55 references that are in the map. First posted on arXiv 31 Jul 2025.
Builds on
45 of 55 references.
References · 45
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2023Visual Instruction Tuningcited by 7,869
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2021Decision Transformer: Reinforcement Learning via Sequence Modelingcited by 1,546
- 2023Mastering Diverse Domains through World Modelscited by 1,253
- 2017Curiosity-driven Exploration by Self-supervised Predictioncited by 1,194
- 2021Offline Reinforcement Learning as One Big Sequence Modeling Problemcited by 644
- 2023The Falcon Series of Open Language Modelscited by 535
- 2023Learning Interactive Real-World Simulatorscited by 458
- 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planningcited by 386
33 more
- 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 364
- 2018Large-Scale Study of Curiosity-Driven Learningcited by 280
- 2024Navigation World Modelscited by 272
- 2023MimicPlay: Long-Horizon Imitation Learning by Watching Human Playcited by 223
- 2023ViNT: A Foundation Model for Visual Navigationcited by 222
- 2020VIGOR: Cross-View Image Geo-localization beyond One-to-one Retrievalcited by 189
- 2023GeoCLIP: Clip-Inspired Alignment between Locations and Images for Effective Worldwide Geo-localizationcited by 187
- 2015Wide-Area Image Geolocalization with Aerial Reference Imagerycited by 186
- 2021RvS: What is Essential for Offline RL via Supervised Learning?cited by 185
- 2015Incentivizing Exploration In Reinforcement Learning With Deep Predictive Modelscited by 154
- 2019Reinforcement Learning Upside Down: Don't Predict Rewards -- Just Map Them to Actionscited by 125
- 2023AerialVLN: Vision-and-Language Navigation for UAVscited by 121
- 2022Vision-and-Language Navigation: A Survey of Tasks, Methods, and Future Directionscited by 117
- 2019Training Agents using Upside-Down Reinforcement Learningcited by 107
- 2024Towards Realistic UAV Vision-Language Navigation: Platform, Benchmark, and Methodologycited by 95
- 2024GOAT-Bench: A Benchmark for Multi-Modal Lifelong Navigationcited by 94
- 2022Deep Visual Geo-localization Benchmarkcited by 84
- 2023Fine-Grained Cross-View Geo-Localization Using a Correlation-Aware Homography Estimatorcited by 57
- 2022Uncertainty-aware Vision-based Metric Cross-view Geolocalizationcited by 54
- 2022Aerial Vision-and-Dialog Navigationcited by 49
- 2023Boosting 3-DoF Ground-to-Satellite Camera Localization Accuracy via Geometry-Guided Cross-View Transformercited by 45
- 2019Scalable Place Recognition Under Appearance Change for Autonomous Drivingcited by 42
- 2024OpenStreetView-5M: The Many Roads to Global Visual Geolocationcited by 38
- 2020Active World Model Learning with Progress Curiositycited by 28
- 2023GeoDTR+: Toward generic cross-view geolocalization via geometric disentanglementcited by 28
- 2024ConGeo: Robust Cross-view Geo-localization across Ground View Variationscited by 27
- 2025FG2: Fine-Grained Cross-View Localization by Fine-Grained Feature Matchingcited by 27
- 2023Sat2Cap: Mapping Fine-Grained Textual Descriptions from Satellite Imagescited by 19
- 2019Obstacle-aware Adaptive Informative Path Planning for UAV-based Target Searchcited by 18
- 2022ELIGN: Expectation Alignment as a Multi-Agent Intrinsic Rewardcited by 11
- 2024GOMAA-Geo: GOal Modality Agnostic Active Geo-localizationcited by 11
- 2022Aerial View Localization with Reinforcement Learning: Towards Emulating Search-and-Rescuecited by 4
- 2024PEnG: Pose-Enhanced Geo-Localisationcited by 3
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Vision-Language Reasoning for Geolocalization: A Reinforcement Learning Approach
- 2026DiffVAS: Diffusion-Guided Visual Active Search in Partially Observable Environments
- 2025ScreenExplorer: Training a Vision-Language Model for Diverse Exploration in Open GUI World
- 2025Unlocking Zero-Shot Geospatial Reasoning via Indirect Rewards
- 2026Search Inspired Exploration in Reinforcement Learning
- 2026RemoteZero: Geospatial Reasoning with Zero Labels
- 2026Thinking with Map: Reinforced Parallel Map-Augmented Agent for Geolocalization
- 2025MapExRL: Human-Inspired Indoor Exploration with Predicted Environment Context and Reinforcement Learning