From Coordinates to Candidate Regions: Temporal Change Localization via Region Selection in Remote Sensing Multimodal LLMs
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
Remote sensing multimodal large language models (RS-MLLMs) have advanced scene understanding and visual question answering over satellite imagery, yet localizing specific objects or changed regions remains challenging. Existing approaches rely on generating bounding box coordinates as token sequences, which is fragile for the small, densely packed objects common in remote sensing and increasingly error-prone when multiple targets must be localized simultaneously. In this work, we present an RS-specific formulation of the region selection paradigm, previously explored in natural-image MLLMs, and extend it to temporal change localization over multi-image sequences. Our framework employs a text-conditioned region proposal module, encodes each candidate as special tokens carrying per-frame visual features enriched with spatial and temporal cues, and lets the LLM localize targets by selecting region tokens in its response. We construct a multi-task training and evaluation suite spanning localization, referring expression, visual grounding, and understanding tasks across single-image and multi-temporal settings. Experiments show that our approach substantially outperforms coordinate-generation baselines on temporal change localization, while improving single-image visual grounding and maintaining competitive understanding performance. Oracle analysis decomposes the contributions of the region proposer and the LLM selector, providing diagnostic insight unique to this framework. Our code will be available at https://github.com/juwan-kr/RS-RegionSelect.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 32 of its 50 references that are in the map. First posted on arXiv 8 Sep 2026.
Builds on
32 of 50 references.
Closest ancestors · 8
Same direction, newest first
- 2025Remote Sensing Large Vision-Language Model: Semantic-augmented Multi-level Alignment and Semantic-aware Expert Modeling27 Jun
- 2025EarthMind: Leveraging Cross-Sensor Data for Advanced Earth Observation Interpretation with a Unified Multimodal LLM2 Jun
- 2025GeoPixel: Pixel Grounding Large Multimodal Model in Remote Sensing23 Jan
- 2024CDChat: A Large Multimodal Model for Remote Sensing Change Description24 Sep
- 2024SkySenseGPT: A Fine-Grained Instruction Tuning Dataset and Model for Remote Sensing Vision-Language Understanding14 Jun
- 2024LHRS-Bot: Empowering Remote Sensing with VGI-Enhanced Large Multimodal Language Model4 Feb
- 2024EarthGPT: A Universal Multi-modal Large Language Model for Multi-sensor Image Comprehension in Remote Sensing Domain30 Jan
- 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensing24 Nov
Other references · 24
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2017Mask R-CNNcited by 7,277
- 2016Layer Normalizationcited by 5,669
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,463
- 2015Flickr30k Entities: Collecting Region-to-Phrase Correspondences for Richer Image-to-Sentence Modelscited by 1,362
- 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,301
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
- 2023Shikra: Unleashing Multimodal LLM's Referential Dialogue Magiccited by 906
- 2019Object Detection in Optical Remote Sensing Images: A Survey and A New Benchmarkcited by 340
- 2017Functional Map of the Worldcited by 338
12 more
- 2023GPT4RoI: Instruction Tuning Large Language Model on Region-of-Interestcited by 302
- 2023Patch n' Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolutioncited by 229
- 2023Osprey: Pixel Understanding with Visual Instruction Tuningcited by 159
- 2018xView: Objects in Context in Overhead Imagerycited by 146
- 2019xBD: A Dataset for Assessing Building Damage from Satellite Imagerycited by 139
- 2022Towards Large-Scale Small Object Detection: Survey and Benchmarkscited by 122
- 2023V3Det: Vast Vocabulary Visual Detection Datasetcited by 81
- 2021S2Looking: A Satellite Side-Looking Dataset for Building Change Detectioncited by 77
- 2024An Open and Comprehensive Pipeline for Unified Object Grounding and Detectioncited by 65
- 2024Change-Agent: Towards Interactive Comprehensive Remote Sensing Change Interpretation and Analysiscited by 63
- 2024ChatRex: Taming Multimodal LLM for Joint Perception and Understandingcited by 30
- 2024ChangeChat: An Interactive Model for Remote Sensing Change Analysis via Multimodal Instruction Tuningcited by 23
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Decoding the Delta: Unifying Remote Sensing Change Detection and Understanding with Multimodal Large Language Models
- 2026Revisiting Change VQA in Remote Sensing with Structured and Native Multimodal Qwen Models
- 2024Remote Sensing SpatioTemporal Vision-Language Models: A Comprehensive Survey
- 2025Foundation Models for Remote Sensing: An Analysis of MLLMs for Object Localization
- 2026Multimodal Large Language Models for Remote Sensing Image Understanding: Domain-Specific or General-Purpose?
- 2026GRASP: Guided Region-Aware Sparse Prompting for Adapting MLLMs to Remote Sensing
- 2026Selective Tool Use for Agentic Change Visual Question Answering in Remote Sensing
- 2025A Vision Centric Remote Sensing Benchmark