GeoBrowse: A Geolocation Benchmark for Agentic Tool Use with Expert-Annotated Reasoning Traces
On the map: LLM reasoning → Spatial and embodied reasoning
also in 1 more
Abstract (arXiv)
Deep research agents integrate fragmented evidence through multi-step tool use. BrowseComp offers a text-only testbed for such agents, but existing multimodal benchmarks rarely require both weak visual cues composition and BrowseComp-style multi-hop verification. Geolocation is a natural testbed because answers depend on combining multiple ambiguous visual cues and validating them with open-web evidence. Thus, we introduce GeoBrowse, a geolocation benchmark that combines visual reasoning with knowledge-intensive multi-hop queries. Level 1 tests extracting and composing fragmented visual cues, and Level 2 increases query difficulty by injecting long-tail knowledge and obfuscating key entities. To support evaluation, we provide an agentic workflow GATE with five think-with-image tools and four knowledge-intensive tools, and release expert-annotated stepwise traces grounded in verifiable evidence for trajectory-level analysis. Experiments show that GATE outperforms direct inference and open-source agents, indicating that no-tool, search-only or image-only setups are insufficient. Gains come from coherent, level-specific tool-use plans rather than more tool calls, as they more reliably reach annotated key evidence steps and make fewer errors when integrating into the final decision. The GeoBrowse bernchmark and codes are provided in https://github.com/ornamentt/GeoBrowse
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 29 of its 59 references that are in the map. First posted on arXiv 5 Apr 2026.
Builds on
29 of 59 references.
Closest ancestors · 1
Same direction, newest first
Other references · 28
- 2025Qwen3 Technical Reportcited by 8,195
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,722
- 2023Multimodal Chain-of-Thought Reasoning in Language Modelscited by 740
- 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 616
- 2025Humanity's Last Examcited by 467
- 2025R1-Searcher: Incentivizing the Search Capability in LLMs via Reinforcement Learningcited by 322
- 2025WebThinker: Empowering Large Reasoning Models with Deep Research Capabilitycited by 320
- 2025WebSailor: Navigating Super-human Reasoning for Web Agentcited by 218
- 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontierscited by 193
- 2025WebDancer: Towards Autonomous Information Seeking Agencycited by 180
- 2025OWL: Optimized Workforce Learning for General Multi-Agent Assistance in Real-World Task Automationcited by 129
16 more
- 2025WebWatcher: Breaking New Frontier of Vision-Language Deep Research Agentcited by 114
- 2025PyVision: Agentic Vision with Dynamic Toolingcited by 71
- 2026XSkill: Continual Learning from Experience and Skills in Multimodal Agentscited by 71
- 2025VRAG-RL: Empower Vision-Perception-Based RAG for Visually Rich Information Understanding via Iterative Reasoning with Reinforcement Learningcited by 68
- 2024Benchmarking Multimodal Retrieval Augmented Generation with Dynamic VQA Dataset and Self-adaptive Planning Agentcited by 65
- 2024FullStack Bench: Evaluating LLMs as Full Stack Coderscited by 56
- 2025EvolveSearch: An Iterative Self-Evolving Search Agentcited by 42
- 2025MM-BrowseComp: A Comprehensive Benchmark for Multimodal Browsing Agentscited by 39
- 2025MMSearch-Plus: Benchmarking Provenance-Aware Search for Multimodal Browsing Agentscited by 35
- 2025TIR-Bench: A Comprehensive Benchmark for Agentic Thinking-with-Images Reasoningcited by 34
- 2025Beyond Seeing: Evaluating Multimodal LLMs on Tool-Enabled Image Perception, Transformation, and Reasoningcited by 28
- 2025Geolocation with Real Human Gameplay Data: A Large-Scale Dataset and Human-Like Reasoning Frameworkcited by 23
- 2025Doxing via the Lens: Revealing Location-related Privacy Leakage on Multi-modal Large Reasoning Modelscited by 14
- 2025Visual Reasoning Tracer: Object-Level Grounded Reasoning Benchmarkcited by 10
- 2025Toward Structured Knowledge Reasoning: Contrastive Retrieval-Augmented Generation on Experiencecited by 7
- 2025Detecting Knowledge Boundary of Vision Large Language Models by Sampling-Based Inferencecited by 6
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Do Multimodal Agents Really Benefit from Tool Use? A Systematic Study of Capability Gainscited by 4
- 2026DeepSearch-World: Self-Distillation for Deep Search Agents in a Verifiable Environmentcited by 0
- 2026Perceive to Hypothesize, Verify to Ground: An Agentic Reasoning Framework for Open-World Geo-Localizationcited by 0
- 2026Perceive to Hypothesize, Verify to Ground: An Agentic Reasoning Framework for Open-World Geo-Localization30 Aug 2026
- 2026DeepSearch-World: Self-Distillation for Deep Search Agents in a Verifiable Environment8 Jul 2026
- 2026Do Multimodal Agents Really Benefit from Tool Use? A Systematic Study of Capability Gains1 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026LocationAgent: A Hierarchical Agent for Image Geolocation via Decoupling Strategy and Evidence from Parametric Knowledge
- 2026SpotAgent: Grounding Visual Geo-localization in Large Vision-Language Models through Agentic Reasoning
- 2026GeoAgent: Evaluating VLM Geolocalization Through Embodied Navigation
- 2026Learning to Wander: Improving the Global Image Geolocation Ability of LMMs via Actionable Reasoning
- 2025GraphGeo: Multi-Agent Debate Framework for Visual Geo-localization with Heterogeneous Graph Neural Networks
- 2026GeoAgent: Learning to Geolocate Everywhere with Reinforced Geographic Characteristics
- 2026REVERSE: Reinforcing Evidence Verification and Search for Agentic Image geo-localization
- 2026OpenEarthAgent: A Unified Framework for Tool-Augmented Geospatial Agents