SegEarth-R2: Towards Comprehensive Language-guided Segmentation for Remote Sensing Images
Not on the map. Why?
Abstract (arXiv)
Effectively grounding complex language to pixels in remote sensing (RS) images is a critical challenge for applications like disaster response and environmental monitoring. Current models can parse simple, single-target commands but fail when presented with complex geospatial scenarios, e.g., segmenting objects at various granularities, executing multi-target instructions, and interpreting implicit user intent. To drive progress against these failures, we present LaSeRS, the first large-scale dataset built for comprehensive training and evaluation across four critical dimensions of language-guided segmentation: hierarchical granularity, target multiplicity, reasoning requirements, and linguistic variability. By capturing these dimensions, LaSeRS moves beyond simple commands, providing a benchmark for complex geospatial reasoning. This addresses a critical gap: existing datasets oversimplify, leading to sensitivity-prone real-world models. We also propose SegEarth-R2, an MLLM architecture designed for comprehensive language-guided segmentation in RS, which directly confronts these challenges. The model's effectiveness stems from two key improvements: (1) a spatial attention supervision mechanism specifically handles the localization of small objects and their components, and (2) a flexible and efficient segmentation query mechanism that handles both single-target and multi-target scenarios. Experimental results demonstrate that our SegEarth-R2 achieves outstanding performance on LaSeRS and other benchmarks, establishing a powerful baseline for the next generation of geospatial segmentation. All data and code will be released at https://github.com/earth-insights/SegEarth-R2.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 70 of its 79 references that are in the map. First posted on arXiv 23 Dec 2025.
Builds on
70 of 79 references.
References · 70
- 2017Attention Is All You Needcited by 59,932
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2023Segment Anythingcited by 8,158
- 2023Visual Instruction Tuningcited by 7,792
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,855
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
- 2023LISA: Reasoning Segmentation via Large Language Modelcited by 770
- 2023GLaMM: Pixel Grounding Large Multimodal Modelcited by 447
38 more
- 2023RemoteCLIP: A Vision Language Foundation Model for Remote Sensingcited by 357
- 2021CRIS: CLIP-Driven Referring Image Segmentationcited by 353
- 2021LAVT: Language-Aware Vision Transformer for Referring Image Segmentationcited by 347
- 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensingcited by 320
- 2023GPT4RoI: Instruction Tuning Large Language Model on Region-of-Interestcited by 300
- 2021Vision-Language Transformer and Query Generation for Referring Segmentationcited by 239
- 2023RSGPT: A Remote Sensing Vision Language Model and Benchmarkcited by 204
- 2024InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and Outputcited by 195
- 2020FloodNet: A High Resolution Aerial Imagery Dataset for Post Flood Scene Understandingcited by 181
- 2024EarthGPT: A Universal Multi-modal Large Language Model for Multi-sensor Image Comprehension in Remote Sensing Domaincited by 181
- 2025Sa2VA: Marrying SAM2 with MLLM for Dense Grounded Understanding of Images and Videoscited by 154
- 2023GSVA: Generalized Segmentation via Multimodal Large Language Modelscited by 153
- 2023PolyFormer: Referring Image Segmentation as Sequential Polygon Generationcited by 147
- 2024VISA: Reasoning Video Object Segmentation via Large Language Modelscited by 123
- 2020PhraseCut: Language-based Image Segmentation in the Wildcited by 116
- 2024VRSBench: A Versatile Vision-Language Benchmark Dataset for Remote Sensing Image Understandingcited by 116
- 2021Cross-Modal Progressive Comprehension for Referring Segmentationcited by 102
- 2024PSALM: Pixelwise SegmentAtion with Large Multi-Modal Modelcited by 100
- 2024VHM: Versatile and Honest Vision Language Model for Remote Sensing Image Analysiscited by 84
- 2024EarthDial: Turning Multi-sensory Earth Observations to Interactive Dialoguescited by 81
- 2024Mission Critical -- Satellite Data is a Distinct Modality in Machine Learningcited by 76
- 2024RegionGPT: Towards Region Understanding Vision Language Modelcited by 71
- 2024TEOChat: A Large Vision-Language Assistant for Temporal Earth Observation Datacited by 69
- 2023Beyond One-to-One: Rethinking the Referring Image Segmentationcited by 68
- 2023RRSIS: Referring Remote Sensing Image Segmentationcited by 59
- 2024Text4Seg: Reimagining Image Segmentation as Text Generationcited by 59
- 2024LaSagnA: Language-based Segmentation Assistant for Complex Queriescited by 55
- 2025GeoPixel: Pixel Grounding Large Multimodal Model in Remote Sensingcited by 55
- 2024Vision Foundation Models in Remote Sensing: A Surveycited by 52
- 2023EarthVQA: Towards Queryable Earth via Relational Reasoning-Based Remote Sensing Visual Question Answeringcited by 51
- 2024GEOBench-VLM: Benchmarking Vision-Language Models for Geospatial Taskscited by 50
- 2024GeoGround: A Unified Large Vision-Language Model for Remote Sensing Visual Groundingcited by 46
- 2025GeoLLaVA-8K: Scaling Remote-Sensing Multimodal Large Language Models to 8K Resolutioncited by 41
- 2025SegEarth-R1: Geospatial Pixel Reasoning via Large Language Modelcited by 40
- 2025DisasterM3: A Remote Sensing Vision-Language Dataset for Disaster Damage Assessment and Responsecited by 35
- 2024HyperSeg: Towards Universal Visual Segmentation with Large Language Modelcited by 33
- 2024InstructSeg: Unifying Instructed Visual Segmentation with Multi-modal Large Language Modelscited by 31
- 2025X-SAM: From Segment Anything to Any Segmentationcited by 30
50 most cited of 70 All 70 (JSON)
Built on by
Citing papers per year: 2026: 10.
10 papers.
- 2026RemoteAgent: Bridging Vague Human Intents and Earth Observation with RL-based Agentic MLLMscited by 7
- 2026GeoSeg: Training-Free Reasoning-Driven Segmentation in Remote Sensing Imagerycited by 1
- 2026GeoHeight-Bench: Towards Height-Aware Multimodal Reasoning in Remote Sensingcited by 1
- 2026AgroVG: A Large-Scale Multi-Source Benchmark for Agricultural Visual Groundingcited by 0
- 2026More with Less: a Large Scale Remote Sensing VLM with a Simple Recipecited by 0
- 2026Evaluating Semantic and Spatial Guidance for Foundation Model Segmentation of Small-Scale PV in Remote Sensing Imagerycited by 0
- 2026DiCoR: Decoupled Referent Disambiguation and Contour Recalibration for Efficient Referring Remote Sensing Image Segmentationcited by 0
- 2026GeBDA: Building Damage Assessment as Text-Based Sequence Predictioncited by 0
- 2026GeoRefer-Bench: A Benchmark from Referring Pixels to Verifiable Geospatial Reasoningcited by 0
- 2026The Earth in One Gaze: Training-Free Active Focus for UHR Remote Sensing Understandingcited by 0
- 2026The Earth in One Gaze: Training-Free Active Focus for UHR Remote Sensing Understanding23 Sep 2026
- 2026GeBDA: Building Damage Assessment as Text-Based Sequence Prediction28 Aug 2026
- 2026GeoRefer-Bench: A Benchmark from Referring Pixels to Verifiable Geospatial Reasoning25 Aug 2026
- 2026DiCoR: Decoupled Referent Disambiguation and Contour Recalibration for Efficient Referring Remote Sensing Image Segmentation13 Aug 2026
- 2026Evaluating Semantic and Spatial Guidance for Foundation Model Segmentation of Small-Scale PV in Remote Sensing Imagery11 Aug 2026
- 2026More with Less: a Large Scale Remote Sensing VLM with a Simple Recipe17 Jul 2026
- 2026AgroVG: A Large-Scale Multi-Source Benchmark for Agricultural Visual Grounding21 May 2026
- 2026RemoteAgent: Bridging Vague Human Intents and Earth Observation with RL-based Agentic MLLMs9 Apr 2026
- 2026GeoHeight-Bench: Towards Height-Aware Multimodal Reasoning in Remote Sensing26 Mar 2026
- 2026GeoSeg: Training-Free Reasoning-Driven Segmentation in Remote Sensing Imagery4 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2025GeoRSMLLM: A Multimodal Large Language Model for Vision-Language Tasks in Geoscience and Remote Sensing
- 2025UniGeoSeg: Towards Unified Open-World Segmentation for Geospatial Scenes
- 2025GeoPix: Multi-Modal Large Language Model for Pixel-level Image Understanding in Remote Sensing
- 2026Enabling Training-Free Text-Based Remote Sensing Segmentation
- 2026Multimodal Large Language Models for Remote Sensing Image Understanding: Domain-Specific or General-Purpose?
- 2024SkyEyeGPT: Unifying Remote Sensing Vision-Language Tasks via Instruction Tuning with Large Language Model
- 2025DGL-RSIS: Decoupling Global Spatial Context and Local Class Semantics for Training-Free Remote Sensing Image Segmentation
- 2026ConInfer: Context-Aware Inference for Training-Free Open-Vocabulary Remote Sensing Segmentation