mlsanityData to 7 Oct 2026

SegEarth-R2: Towards Comprehensive Language-guided Segmentation for Remote Sensing Images

arXiv 2512.20013 ↗First posted 23 Dec 2025cs.CVcited by 10

Not on the map. Why?

Abstract (arXiv)

Effectively grounding complex language to pixels in remote sensing (RS) images is a critical challenge for applications like disaster response and environmental monitoring. Current models can parse simple, single-target commands but fail when presented with complex geospatial scenarios, e.g., segmenting objects at various granularities, executing multi-target instructions, and interpreting implicit user intent. To drive progress against these failures, we present LaSeRS, the first large-scale dataset built for comprehensive training and evaluation across four critical dimensions of language-guided segmentation: hierarchical granularity, target multiplicity, reasoning requirements, and linguistic variability. By capturing these dimensions, LaSeRS moves beyond simple commands, providing a benchmark for complex geospatial reasoning. This addresses a critical gap: existing datasets oversimplify, leading to sensitivity-prone real-world models. We also propose SegEarth-R2, an MLLM architecture designed for comprehensive language-guided segmentation in RS, which directly confronts these challenges. The model's effectiveness stems from two key improvements: (1) a spatial attention supervision mechanism specifically handles the localization of small objects and their components, and (2) a flexible and efficient segmentation query mechanism that handles both single-target and multi-target scenarios. Experimental results demonstrate that our SegEarth-R2 achieves outstanding performance on LaSeRS and other benchmarks, establishing a powerful baseline for the next generation of geospatial segmentation. All data and code will be released at https://github.com/earth-insights/SegEarth-R2.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 70 of its 79 references that are in the map. First posted on arXiv 23 Dec 2025.

Builds on

70 of 79 references.

References · 70

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  3. 2023Segment Anythingcited by 8,158
  4. 2023Visual Instruction Tuningcited by 7,792
  5. 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
  6. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  7. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,855
  8. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  9. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  10. 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
  11. 2023LISA: Reasoning Segmentation via Large Language Modelcited by 770
  12. 2023GLaMM: Pixel Grounding Large Multimodal Modelcited by 447
38 more
  1. 2023RemoteCLIP: A Vision Language Foundation Model for Remote Sensingcited by 357
  2. 2021CRIS: CLIP-Driven Referring Image Segmentationcited by 353
  3. 2021LAVT: Language-Aware Vision Transformer for Referring Image Segmentationcited by 347
  4. 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensingcited by 320
  5. 2023GPT4RoI: Instruction Tuning Large Language Model on Region-of-Interestcited by 300
  6. 2021Vision-Language Transformer and Query Generation for Referring Segmentationcited by 239
  7. 2023RSGPT: A Remote Sensing Vision Language Model and Benchmarkcited by 204
  8. 2024InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and Outputcited by 195
  9. 2020FloodNet: A High Resolution Aerial Imagery Dataset for Post Flood Scene Understandingcited by 181
  10. 2024EarthGPT: A Universal Multi-modal Large Language Model for Multi-sensor Image Comprehension in Remote Sensing Domaincited by 181
  11. 2025Sa2VA: Marrying SAM2 with MLLM for Dense Grounded Understanding of Images and Videoscited by 154
  12. 2023GSVA: Generalized Segmentation via Multimodal Large Language Modelscited by 153
  13. 2023PolyFormer: Referring Image Segmentation as Sequential Polygon Generationcited by 147
  14. 2024VISA: Reasoning Video Object Segmentation via Large Language Modelscited by 123
  15. 2020PhraseCut: Language-based Image Segmentation in the Wildcited by 116
  16. 2024VRSBench: A Versatile Vision-Language Benchmark Dataset for Remote Sensing Image Understandingcited by 116
  17. 2021Cross-Modal Progressive Comprehension for Referring Segmentationcited by 102
  18. 2024PSALM: Pixelwise SegmentAtion with Large Multi-Modal Modelcited by 100
  19. 2024VHM: Versatile and Honest Vision Language Model for Remote Sensing Image Analysiscited by 84
  20. 2024EarthDial: Turning Multi-sensory Earth Observations to Interactive Dialoguescited by 81
  21. 2024Mission Critical -- Satellite Data is a Distinct Modality in Machine Learningcited by 76
  22. 2024RegionGPT: Towards Region Understanding Vision Language Modelcited by 71
  23. 2024TEOChat: A Large Vision-Language Assistant for Temporal Earth Observation Datacited by 69
  24. 2023Beyond One-to-One: Rethinking the Referring Image Segmentationcited by 68
  25. 2023RRSIS: Referring Remote Sensing Image Segmentationcited by 59
  26. 2024Text4Seg: Reimagining Image Segmentation as Text Generationcited by 59
  27. 2024LaSagnA: Language-based Segmentation Assistant for Complex Queriescited by 55
  28. 2025GeoPixel: Pixel Grounding Large Multimodal Model in Remote Sensingcited by 55
  29. 2024Vision Foundation Models in Remote Sensing: A Surveycited by 52
  30. 2023EarthVQA: Towards Queryable Earth via Relational Reasoning-Based Remote Sensing Visual Question Answeringcited by 51
  31. 2024GEOBench-VLM: Benchmarking Vision-Language Models for Geospatial Taskscited by 50
  32. 2024GeoGround: A Unified Large Vision-Language Model for Remote Sensing Visual Groundingcited by 46
  33. 2025GeoLLaVA-8K: Scaling Remote-Sensing Multimodal Large Language Models to 8K Resolutioncited by 41
  34. 2025SegEarth-R1: Geospatial Pixel Reasoning via Large Language Modelcited by 40
  35. 2025DisasterM3: A Remote Sensing Vision-Language Dataset for Disaster Damage Assessment and Responsecited by 35
  36. 2024HyperSeg: Towards Universal Visual Segmentation with Large Language Modelcited by 33
  37. 2024InstructSeg: Unifying Instructed Visual Segmentation with Multi-modal Large Language Modelscited by 31
  38. 2025X-SAM: From Segment Anything to Any Segmentationcited by 30

50 most cited of 70 All 70 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 10.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025GeoRSMLLM: A Multimodal Large Language Model for Vision-Language Tasks in Geoscience and Remote Sensing
  2. 2025UniGeoSeg: Towards Unified Open-World Segmentation for Geospatial Scenes
  3. 2025GeoPix: Multi-Modal Large Language Model for Pixel-level Image Understanding in Remote Sensing
  4. 2026Enabling Training-Free Text-Based Remote Sensing Segmentation
  5. 2026Multimodal Large Language Models for Remote Sensing Image Understanding: Domain-Specific or General-Purpose?
  6. 2024SkyEyeGPT: Unifying Remote Sensing Vision-Language Tasks via Instruction Tuning with Large Language Model
  7. 2025DGL-RSIS: Decoupling Global Spatial Context and Local Class Semantics for Training-Free Remote Sensing Image Segmentation
  8. 2026ConInfer: Context-Aware Inference for Training-Free Open-Vocabulary Remote Sensing Segmentation