GeoViS: Geospatially Rewarded Visual Search for Remote Sensing Visual Grounding
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
Recent advances in multimodal large language models(MLLMs) have led to remarkable progress in visual grounding, enabling fine-grained cross-modal alignment between textual queries and image regions. However, transferring such capabilities to remote sensing imagery remains challenging, as targets are often extremely small within kilometer-scale scenes, and queries typically involve intricate geospatial relations such as relative positions, spatial hierarchies, or contextual dependencies across distant objects. To address these challenges, we propose GeoViS, a Geospatially Rewarded Visual Search framework that reformulates remote sensing visual grounding as a progressive search-and-reasoning process. Rather than directly predicting the target location in a single step, GeoViS actively explores the global image through a tree-structured sequence of visual cues, integrating multimodal perception, spatial reasoning, and reward-guided exploration to refine geospatial hypotheses iteratively. This design enables the model to detect subtle small-scale targets while maintaining holistic scene awareness. Extensive experiments on five remote sensing grounding benchmarks demonstrate that GeoViS achieves precise geospatial understanding and consistently surpasses existing methods across key visual grounding metrics, highlighting its strong cross-domain generalization and interpretability.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 47 of its 65 references that are in the map. First posted on arXiv 2 Dec 2025.
Builds on
47 of 65 references.
Closest ancestors · 9
Same direction, newest first
- 2025Adaptive Chain-of-Focus Reasoning via Dynamic Visual Search and Zooming for Efficient VLMs21 May
- 2024EarthDial: Turning Multi-sensory Earth Observations to Interactive Dialogues19 Dec
- 2024GeoGround: A Unified Large Vision-Language Model for Remote Sensing Visual Grounding16 Nov
- 2024VRSBench: A Versatile Vision-Language Benchmark Dataset for Remote Sensing Image Understanding18 Jun
- 2024SkySenseGPT: A Fine-Grained Instruction Tuning Dataset and Model for Remote Sensing Vision-Language Understanding14 Jun
- 2024VHM: Versatile and Honest Vision Language Model for Remote Sensing Image Analysis29 Mar
- 2024LHRS-Bot: Empowering Remote Sensing with VGI-Enhanced Large Multimodal Language Model4 Feb
- 2024EarthGPT: A Universal Multi-modal Large Language Model for Multi-sensor Image Comprehension in Remote Sensing Domain30 Jan
- 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensing24 Nov
Other references · 38
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024GPT-4o System Cardcited by 4,588
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,141
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
- 2021Grounded Language-Image Pre-trainingcited by 1,156
- 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,089
- 2023SEED-Bench: Benchmarking Multimodal LLMs with Generative Comprehensioncited by 940
26 more
- 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 914
- 2023Shikra: Unleashing Multimodal LLM's Referential Dialogue Magiccited by 906
- 2024Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMscited by 735
- 2023CogVLM: Visual Expert for Pretrained Language Modelscited by 708
- 2023The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)cited by 681
- 2023MiniGPT-v2: large language model as a unified interface for vision-language multi-task learningcited by 625
- 2023Ferret: Refer and Ground Anything Anywhere at Any Granularitycited by 509
- 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 482
- 2024Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought Reasoningcited by 280
- 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learningcited by 278
- 2021TransVG: End-to-End Visual Grounding with Transformerscited by 271
- 2019A Fast and Accurate One-Stage Approach to Visual Groundingcited by 195
- 2024LLaVA-UHD: an LMM Perceiving Any Aspect Ratio and High-Resolution Imagescited by 195
- 2021Referring Transformer: A One-step Approach to Multi-task Visual Groundingcited by 143
- 2020Improving One-stage Visual Grounding by Recursive Sub-query Constructioncited by 138
- 2022RSVG: Exploring Data and Models for Visual Grounding on Remote Sensing Datacited by 123
- 2025Mini-o3: Scaling Up Reasoning Patterns and Interaction Turns for Visual Searchcited by 120
- 2024Groma: Localized Visual Tokenization for Grounding Multimodal Large Language Modelscited by 119
- 2024GroundingGPT:Language Enhanced Multi-modal Grounding Modelcited by 101
- 2019Zero-Shot Grounding of Objects from Natural Language Queriescited by 79
- 2024Visual Agents as Fast and Slow Thinkerscited by 53
- 2025DyFo: A Training-Free Dynamic Focus Visual Search for Enhancing LMMs in Fine-Grained Visual Understandingcited by 49
- 2024VoCoT: Unleashing Visually Grounded Multi-Step Reasoning in Large Multi-Modal Modelscited by 43
- 2024F-LMM: Grounding Frozen Large Multimodal Modelscited by 34
- 2025Scaling Vision Pre-Training to 4K Resolutioncited by 28
- 2024LLaVA-UHD v2: an MLLM Integrating High-Resolution Semantic Pyramid via Hierarchical Window Transformercited by 8
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026WeaveEarth: Structured Evidence Construction and Reasoning for Training-Free UHR Remote Sensing Understandingcited by 2
- 2026BELDE: Building a Large-scale Earth-observation Land-cover Dataset for Europecited by 1
- 2026GrabVG: Graph-Attentive Binding for Visual Grounding in UAV Imagerycited by 0
- 2026Knowing Whether, Not Just Where: Anchor-Probing Distillation for Open-Set Remote Sensing Visual Groundingcited by 0
- 2026Knowing Whether, Not Just Where: Anchor-Probing Distillation for Open-Set Remote Sensing Visual Grounding9 Oct 2026
- 2026GrabVG: Graph-Attentive Binding for Visual Grounding in UAV Imagery19 Aug 2026
- 2026WeaveEarth: Structured Evidence Construction and Reasoning for Training-Free UHR Remote Sensing Understanding11 Jul 2026
- 2026BELDE: Building a Large-scale Earth-observation Land-cover Dataset for Europe18 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026GeoSearcher: Anchor-Guided Progressive Reasoning for Remote Sensing Visual Grounding with Process Supervision
- 2026GeoVista: Visually Grounded Active Perception for Vision-Language Understanding of Ultra-High-Resolution Remote Sensing Images
- 2026Training-Free Open-Vocabulary Visual Grounding for Remote Sensing Images and Videos
- 2026Beyond Zooming: Learning Multi-Tool Visual Reasoning for Ultra-High-Resolution Remote Sensing
- 2026RSGround-R1: Rethinking Remote Sensing Visual Grounding through Spatial Reasoning
- 2025SATGround: A Spatially-Aware Approach for Visual Grounding in Remote Sensing
- 2025GeoPixel: Pixel Grounding Large Multimodal Model in Remote Sensing
- 2025GeoZero: Incentivizing Reasoning from Scratch on Geospatial Scenes