Swarm Intelligence in Geo-Localization: A Multi-Agent Large Vision-Language Model Collaborative Framework
On the map: LLM reasoning → Spatial and embodied reasoning
also in 2 more
Abstract (arXiv)
Visual geo-localization demands in-depth knowledge and advanced reasoning skills to associate images with precise real-world geographic locations. Existing image database retrieval methods are limited by the impracticality of storing sufficient visual records of global landmarks. Recently, Large Vision-Language Models (LVLMs) have demonstrated the capability of geo-localization through Visual Question Answering (VQA), enabling a solution that does not require external geo-tagged image records. However, the performance of a single LVLM is still limited by its intrinsic knowledge and reasoning capabilities. To address these challenges, we introduce smileGeo, a novel visual geo-localization framework that leverages multiple Internet-enabled LVLM agents operating within an agent-based architecture. By facilitating inter-agent communication, smileGeo integrates the inherent knowledge of these agents with additional retrieved information, enhancing the ability to effectively localize images. Furthermore, our framework incorporates a dynamic learning strategy that optimizes agent communication, reducing redundant interactions and enhancing overall system efficiency. To validate the effectiveness of the proposed framework, we conducted experiments on three different datasets, and the results show that our approach significantly outperforms current state-of-the-art methods. The source code is available at https://anonymous.4open.science/r/ViusalGeoLocalization-F8F5.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 29 of its 56 references that are in the map. First posted on arXiv 21 Aug 2024.
Builds on
29 of 56 references.
References · 29
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
- 2022Atlas: Few-shot Learning with Retrieval Augmented Language Modelscited by 940
- 2015NetVLAD: CNN architecture for weakly supervised place recognitioncited by 935
- 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 786
- 2023CogAgent: A Visual Language Model for GUI Agentscited by 692
- 2023LLM-Blender: Ensembling Large Language Models with Pairwise Ranking and Generative Fusioncited by 550
- 2023Are Emergent Abilities of Large Language Models a Mirage?cited by 515
- 2017Fine-tuning CNN Image Retrieval with No Human Annotationcited by 497
- 2021Patch-NetVLAD: Multi-Scale Fusion of Locally-Global Descriptors for Place Recognitioncited by 236
- 2023GeoCLIP: Clip-Inspired Alignment between Locations and Images for Effective Worldwide Geo-localizationcited by 185
- 2022Rethinking Visual Geo-localization for Large-Scale Applicationscited by 160
17 more
- 2020Self-supervising Fine-grained Region Similarities for Large-scale Image Localizationcited by 110
- 2020VPR-Bench: An Open-Source Visual Place Recognition Evaluation Framework with Quantifiable Viewpoint and Appearance Changecited by 101
- 2017Deep Learning Features at Scale for Visual Place Recognitioncited by 96
- 2022Code4Struct: Code Generation for Few-Shot Event Structure Predictioncited by 70
- 2018CPlaNet: Enhancing Image Geolocalization by Combinatorial Partitioning of Mapscited by 68
- 2022Where in the World is this Image? Transformer-based Geo-localization in the Wildcited by 58
- 2018A Holistic Visual Place Recognition Approach using Lightweight CNNs for Significant ViewPoint and Appearance Changescited by 53
- 2019Multi-Process Fusion: Visual Place Recognition Using Multiple Image Processing Methodscited by 38
- 2024Large Language Model-based Human-Agent Collaboration for Complex Task Solvingcited by 38
- 2024G3: An Effective and Adaptive Framework for Worldwide Geolocalization Using Large Multi-Modality Modelscited by 33
- 2021Exploiting Cross-Modal Prediction and Relation Consistency for Semi-Supervised Image Captioningcited by 23
- 2021Leveraging EfficientNet and Contrastive Learning for Accurate Global-scale Location Estimationcited by 19
- 2021Semantic Reinforced Attention Learning for Visual Place Recognitioncited by 19
- 2021Inside Out Visual Place Recognitioncited by 12
- 2024Reverse Image Retrieval Cues Parametric Memory in Multimodal LLMscited by 6
- 2019A Large-Scale Empirical Study of Geotagging Behavior on Twittercited by 5
- 2024GARLIC: GPT-Augmented Reinforcement Learning with Intelligent Control for Vehicle Dispatchingcited by 5
Built on by
Citing papers per year: 2025: 4; 2026: 7.
11 papers.
- 2025GraphGeo: Multi-Agent Debate Framework for Visual Geo-localization with Heterogeneous Graph Neural Networkscited by 6
- 2026GeoAgent: Learning to Geolocate Everywhere with Reinforced Geographic Characteristicscited by 5
- 2025Image-based Geo-localization for Robotics: Are Black-box Vision-Language Models there yet?cited by 3
- 2025GeoExplain: Multimodal Reasoning based on Hierarchy of Visual Information in Street Viewcited by 3
- 2026REVERSE: Reinforcing Evidence Verification and Search for Agentic Image geo-localizationcited by 2
- 2025A Hybrid Swarm Intelligence Approach for Optimizing Multimodal Large Language Models Deployment in Edge-Cloud-based Federated Learning Environmentscited by 1
- 2026Do Vision-Language Models Respect Contextual Integrity in Location Disclosure?cited by 1
- 2026Skill-Conditioned Visual Geolocation for Vision-Language Modelscited by 1
- 2026Multi-Agent Collaborative Reasoning with Tool-Augmented Evidence for Urban Region Profilingcited by 1
- 2026The Sonar Moment: Benchmarking Audio-Language Models in Audio Geo-Localizationcited by 0
- 2026GeoMetric: Injecting Metric Geographic Structure into Worldwide Image Geo-Localizationcited by 0
- 2026Multi-Agent Collaborative Reasoning with Tool-Augmented Evidence for Urban Region Profiling15 Jul 2026
- 2026GeoMetric: Injecting Metric Geographic Structure into Worldwide Image Geo-Localization8 Jun 2026
- 2026REVERSE: Reinforcing Evidence Verification and Search for Agentic Image geo-localization26 May 2026
- 2026Skill-Conditioned Visual Geolocation for Vision-Language Models10 Apr 2026
- 2026GeoAgent: Learning to Geolocate Everywhere with Reinforced Geographic Characteristics13 Feb 2026
- 2026Do Vision-Language Models Respect Contextual Integrity in Location Disclosure?4 Feb 2026
- 2026The Sonar Moment: Benchmarking Audio-Language Models in Audio Geo-Localization6 Jan 2026
- 2025GraphGeo: Multi-Agent Debate Framework for Visual Geo-localization with Heterogeneous Graph Neural Networks2 Nov 2025
- 2025GeoExplain: Multimodal Reasoning based on Hierarchy of Visual Information in Street View19 Jun 2025
- 2025A Hybrid Swarm Intelligence Approach for Optimizing Multimodal Large Language Models Deployment in Edge-Cloud-based Federated Learning Environments4 Feb 2025
- 2025Image-based Geo-localization for Robotics: Are Black-box Vision-Language Models there yet?28 Jan 2025
Similar, not cited
Close in wording, no citation either way
- 2026SpotAgent: Grounding Visual Geo-localization in Large Vision-Language Models through Agentic Reasoning
- 2026Vision-Language Reasoning for Geolocalization: A Reinforcement Learning Approach
- 2026GeoAgent: Evaluating VLM Geolocalization Through Embodied Navigation
- 2024GeoReasoner: Geo-localization with Reasoning in Street Views using a Large Vision-Language Model
- 2026Thinking with Map: Reinforced Parallel Map-Augmented Agent for Geolocalization
- 2025Where on Earth? A Vision-Language Benchmark for Probing Model Geolocation Skills Across Scales
- 2025Recognition through Reasoning: Reinforcing Image Geo-localization with Large Vision-Language Models
- 2025GeoVista: Web-Augmented Agentic Visual Reasoning for Geolocalization