The Earth in One Gaze: Training-Free Active Focus for UHR Remote Sensing Understanding
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models also fits: VLM benchmarks and visual reasoning
Abstract (arXiv)
Multimodal large language models (MLLMs) must balance local detail against scene context when interpreting ultra-high-resolution (UHR) remote sensing (RS) imagery within a limited visual-input budget. Existing selection-based methods either prune tokens and select patches through relevance scoring, or crop actively through repeated inspection. Neither strategy directly redistributes pixels within a continuous full-scene view: the first retains selected tokens or patches, and the second re-encodes a crop detached from its surroundings. Our pilot study finds that a frozen MLLM already produces useful question-guided spatial requests, yet crop-based inspection of the selected regions does not consistently improve its answers. We therefore formulate UHR understanding as a question of where to spend a fixed pixel budget. Based on this, we introduce GazeEarth, a simple-yet-effective training-free framework that couples question-guided region selection with full-scene foveated observation. The MLLM selects evidence cells from an indexed overview; a deterministic, topology-preserving warp resamples the original image onto a fixed-size canvas, enlarging their shared neighborhood while compressing the periphery; the same frozen model answers from this focused view, using at most two MLLM calls and no external selector or iterative search. Across three UHR remote sensing benchmarks and four frozen backbones, GazeEarth improves benchmark-averaged accuracy by 4.6 to 9.4 percentage points over direct answering and 3.4 to 4.3 over overview answering, outperforming task-trained methods. Our analyses show that existing MLLMs can guide where to look in UHR images on their own, and that what they can infer from the selected evidence depends on how that evidence is presented.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 39 of its 44 references that are in the map. First posted on arXiv 23 Sep 2026.
Builds on
39 of 44 references.
Closest ancestors · 13
Same direction, newest first
- 2026Beyond Zooming: Learning Multi-Tool Visual Reasoning for Ultra-High-Resolution Remote Sensing28 Jul
- 2026WeaveEarth: Structured Evidence Construction and Reasoning for Training-Free UHR Remote Sensing Understanding11 Jul
- 2025DescribeEarth: Describe Anything for Remote Sensing Images30 Sep
- 2025Towards Faithful Reasoning in Remote Sensing: A Perceptually-Grounded GeoSpatial Chain-of-Thought for Vision-Language Models26 Sep
- 2025GeoLLaVA-8K: Scaling Remote-Sensing Multimodal Large Language Models to 8K Resolution27 May
- 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
- 2025XLRS-Bench: Could Your Multimodal LLMs Understand Extremely Large Ultra-High-Resolution Remote Sensing Imagery?31 Mar
- 2025When Large Vision-Language Model Meets Large Remote Sensing Imagery: Coarse-to-Fine Text-Guided Token Pruning10 Mar
- 2024VHM: Versatile and Honest Vision Language Model for Remote Sensing Image Analysis29 Mar
- 2024LHRS-Bot: Empowering Remote Sensing with VGI-Enhanced Large Multimodal Language Model4 Feb
- 2024EarthGPT: A Universal Multi-modal Large Language Model for Multi-sensor Image Comprehension in Remote Sensing Domain30 Jan
- 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensing24 Nov
1 more
Other references · 26
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 459
- 2024Mini-Gemini: Mining the Potential of Multi-modality Vision Language Modelscited by 361
- 2024MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?cited by 284
- 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learningcited by 267
- 2024LLaVA-UHD: an LMM Perceiving Any Aspect Ratio and High-Resolution Imagescited by 193
- 2025MLLMs Know Where to Look: Training-free Perception of Small Visual Details with Multimodal LLMscited by 172
- 2024ZoomEye: Enhancing Multimodal LLMs with Human-Like Zooming Capabilities through Tree-Based Image Explorationcited by 99
- 2018Learning to Zoom: a Saliency-Based Sampling Layer for Neural Networkscited by 56
- 2023EarthVQA: Towards Queryable Earth via Relational Reasoning-Based Remote Sensing Visual Question Answeringcited by 51
- 2023HiLM-D: Enhancing MLLMs with Multi-Scale High-Resolution Details for Autonomous Drivingcited by 48
- 2021FOVEA: Foveated Image Magnification for Autonomous Navigationcited by 31
14 more
- 2025Retrieval-Augmented Perception: High-Resolution Image Perception Meets Visual RAGcited by 22
- 2025FALCON: Resolving Visual Redundancy and Fragmentation in High-resolution Multimodal Large Language Models via Visual Registerscited by 20
- 2025ZoomEarth: Active Perception for Ultra-High-Resolution Geospatial Vision-Language Taskscited by 19
- 2025AdaptVision: Efficient Vision-Language Models via Adaptive Visual Acquisitioncited by 19
- 2023Towards Perceiving Small Visual Details in Zero-shot Visual Question Answering with Multimodal LLMscited by 14
- 2025Constructive Distortion: Improving MLLMs with Attention-Guided Image Warpingcited by 13
- 2023Learning to Zoom and Unzoomcited by 11
- 2025Look Where It Matters: Training-Free Ultra-HR Remote Sensing VQA via Adaptive Zoom Searchcited by 11
- 2025SegEarth-R2: Towards Comprehensive Language-guided Segmentation for Remote Sensing Imagescited by 10
- 2025Catching the Details: Self-Distilled RoI Predictors for Fine-Grained MLLM Perceptioncited by 8
- 2026DeepScan: A Training-Free Framework for Visually Grounded Reasoning in Large Vision-Language Modelscited by 6
- 2026Text Before Vision: Staged Knowledge Injection Matters for Agentic RLVR in Ultra-High-Resolution Remote Sensing Understandingcited by 4
- 2025ERGO: Efficient High-Resolution Visual Understanding for Vision-Language Modelscited by 3
- 2026Seeing Clearly without Training: Mitigating Hallucinations in Multimodal LLMs for Remote Sensingcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026GeoEyes: On-Demand Visual Focusing for Evidence-Grounded Understanding of Ultra-High-Resolution Remote Sensing Imagery
- 2026GeoVista: Visually Grounded Active Perception for Vision-Language Understanding of Ultra-High-Resolution Remote Sensing Images
- 2025A Benchmark for Ultra-High-Resolution Remote Sensing MLLMs
- 2024ImageRAG: Enhancing Ultra High Resolution Remote Sensing Imagery Analysis with ImageRAG
- 2026Multimodal Large Language Models for Remote Sensing Image Understanding: Domain-Specific or General-Purpose?
- 2026RRS-10K: A Multitask Vision-Language Model Benchmark for Rare Remote Sensing Image Interpretation
- 2026GRASP: Guided Region-Aware Sparse Prompting for Adapting MLLMs to Remote Sensing
- 2026UHR-Micro: Diagnosing and Mitigating the Resolution Illusion in Earth Observation VLMs