mlsanityData to 7 Oct 2026

SegEarth-R1: Geospatial Pixel Reasoning via Large Language Model

arXiv 2504.09644 ↗First posted 13 Apr 2025cs.CVcited by 40

On the map: LLM reasoning → Spatial and embodied reasoning

Abstract (arXiv)

Remote sensing has become critical for understanding environmental dynamics, urban planning, and disaster management. However, traditional remote sensing workflows often rely on explicit segmentation or detection methods, which struggle to handle complex, implicit queries that require reasoning over spatial context, domain knowledge, and implicit user intent. Motivated by this, we introduce a new task, ie, geospatial pixel reasoning, which allows implicit querying and reasoning and generates the mask of the target region. To advance this task, we construct and release the first large-scale benchmark dataset called EarthReason, which comprises 5,434 manually annotated image masks with over 30,000 implicit question-answer pairs. Moreover, we propose SegEarth-R1, a simple yet effective language-guided segmentation baseline that integrates a hierarchical visual encoder, a large language model (LLM) for instruction parsing, and a tailored mask generator for spatial correlation. The design of SegEarth-R1 incorporates domain-specific adaptations, including aggressive visual token compression to handle ultra-high-resolution remote sensing images, a description projection module to fuse language and multi-scale features, and a streamlined mask prediction pipeline that directly queries description embeddings. Extensive experiments demonstrate that SegEarth-R1 achieves state-of-the-art performance on both reasoning and referring segmentation tasks, significantly outperforming traditional and LLM-based segmentation methods. Our data and code will be released at https://github.com/earth-insights/SegEarth-R1.

Key facts. Cited by 40 papers in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 25 of its 95 references that are in the map. First posted on arXiv 13 Apr 2025.

Builds on

25 of 95 references.

References · 25

  1. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  2. 2024Qwen2.5 Technical Reportcited by 4,713
  3. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  4. 2024PaliGemma: A versatile 3B VLM for transfercited by 679
  5. 2023Textbooks Are All You Need II: phi-1.5 technical reportcited by 559
  6. 2021LoveDA: A Remote Sensing Land-Cover Dataset for Domain Adaptive Semantic Segmentationcited by 259
  7. 2024PaliGemma 2: A Family of Versatile VLMs for Transfercited by 204
  8. 2025Sa2VA: Marrying SAM2 with MLLM for Dense Grounded Understanding of Images and Videoscited by 154
  9. 2019xBD: A Dataset for Assessing Building Damage from Satellite Imagerycited by 138
  10. 2024VHM: Versatile and Honest Vision Language Model for Remote Sensing Image Analysiscited by 84
  11. 2023NExT-Chat: An LMM for Chat, Detection and Segmentationcited by 79
  12. 2024Mission Critical -- Satellite Data is a Distinct Modality in Machine Learningcited by 76
13 more
  1. 2024DeCo: Decoupling Token Compression from Semantic Abstraction in Multimodal Large Language Modelscited by 74
  2. 2023LISA++: An Improved Baseline for Reasoning Segmentation with Large Language Modelcited by 70
  3. 2024EVF-SAM: Early Vision-Language Fusion for Text-Prompted Segment Anything Modelcited by 63
  4. 2024Text4Seg: Reimagining Image Segmentation as Text Generationcited by 59
  5. 2025GeoPixel: Pixel Grounding Large Multimodal Model in Remote Sensingcited by 55
  6. 2025XLRS-Bench: Could Your Multimodal LLMs Understand Extremely Large Ultra-High-Resolution Remote Sensing Imagery?cited by 50
  7. 2024GeoGround: A Unified Large Vision-Language Model for Remote Sensing Visual Groundingcited by 46
  8. 2024InstructSeg: Unifying Instructed Visual Segmentation with Multi-modal Large Language Modelscited by 31
  9. 2024RSUniVLM: A Unified Vision Language Model for Remote Sensing via Granularity-oriented Mixture of Expertscited by 29
  10. 2024Cross-Modal Bidirectional Interaction Model for Referring Remote Sensing Image Segmentationcited by 26
  11. 2024SegEarth-OV: Towards Training-Free Open-Vocabulary Segmentation for Remote Sensing Imagescited by 25
  12. 2025GeoPix: Multi-Modal Large Language Model for Pixel-level Image Understanding in Remote Sensingcited by 10
  13. 2024Instruction-guided Multi-Granularity Segmentation and Captioning with Large Multimodal Modelcited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 20; 2026: 20.

40 papers.

Sort:

By area:

  1. 2025RemoteReasoner: Towards Unifying Geospatial Reasoning Workflowcited by 25
  2. 2025Geo-R1: Improving Few-Shot Geospatial Referring Expression Understanding with Reinforcement Fine-Tuningcited by 19
  3. 2025RSRefSeg 2: Decoupling Referring Remote Sensing Image Segmentation with Foundation Modelscited by 17
  4. 2025Towards Faithful Reasoning in Remote Sensing: A Perceptually-Grounded GeoSpatial Chain-of-Thought for Vision-Language Modelscited by 17
  5. 2025Designing Domain-Specific Agents via Hierarchical Task Abstraction Mechanismcited by 16
  6. 2025GeoZero: Incentivizing Reasoning from Scratch on Geospatial Scenescited by 13
  7. 2025Reasoning Segmentation for Images and Videos: A Surveycited by 12
  8. 2025UniGeoSeg: Towards Unified Open-World Segmentation for Geospatial Scenescited by 10
  9. 2025SegEarth-R2: Towards Comprehensive Language-guided Segmentation for Remote Sensing Imagescited by 10
  10. 2025InstructSAM: A Training-Free Framework for Instruction-Oriented Remote Sensing Object Recognitioncited by 8
  11. 2025Text4Seg++: Advancing Image Segmentation via Generative Language Modelingcited by 8
  12. 2026RSGround-R1: Rethinking Remote Sensing Visual Grounding through Spatial Reasoningcited by 8
28 more
  1. 2025Annotation-Free Open-Vocabulary Segmentation for Remote-Sensing Imagescited by 7
  2. 2025CangLing-KnowFlow: A Unified Knowledge-and-Flow-fused Agent for Comprehensive Remote Sensing Applicationscited by 7
  3. 2026RemoteAgent: Bridging Vague Human Intents and Earth Observation with RL-based Agentic MLLMscited by 7
  4. 2025Bridging Semantics and Geometry: A Decoupled LVLM-SAM Framework for Reasoning Segmentation in Optical Remote Sensingcited by 6
  5. 2025GRASP: Geospatial pixel Reasoning viA Structured Policy learningcited by 4
  6. 2025TerraGen: A Unified Multi-Task Layout Generation Framework for Remote Sensing Data Augmentationcited by 4
  7. 2026DVGBench: Implicit-to-Explicit Visual Grounding Benchmark in UAV Imagery with Large Vision-Language Modelscited by 4
  8. 2026Earth-OneVision: Extending Remote Sensing Multimodal Large Language Models to More Sensor Modalities and Taskscited by 3
  9. 2025Generalized Referring Expression Segmentation on Aerial Photoscited by 2
  10. 2026Urban Socio-Semantic Segmentation with Vision-Language Reasoningcited by 2
  11. 2026Enabling Training-Free Text-Based Remote Sensing Segmentationcited by 2
  12. 2026GeoSolver: Scaling Test-Time Reasoning in Remote Sensing with Fine-Grained Process Supervisioncited by 2
  13. 2026RemoteShield: Enable Robust Multimodal Large Language Models for Earth Observationcited by 2
  14. 2026GeoHeight-Bench: Towards Height-Aware Multimodal Reasoning in Remote Sensingcited by 1
  15. 2026RemoteZero: Geospatial Reasoning with Zero Labelscited by 1
  16. 2026An Open-Source Benchmark and Baseline for Multi-temporal Referring Segmentationcited by 1
  17. 2026CROSS: Cascaded Distillation and Dual-Constraint Grounding for Remote Sensing Referring Segmentationcited by 1
  18. 2025From Pixels to Images: A Structural Survey of Deep Learning Paradigms in Remote Sensing Image Semantic Segmentationcited by 0
  19. 2025Cross-Modal Urban Sensing: Evaluating Sound-Vision Alignment Across Street-Level and Aerial Imagerycited by 0
  20. 2025Understanding What Is Not Said:Referring Remote Sensing Image Segmentation with Scarce Expressionscited by 0
  21. 2026Uni-RS: A Spatially Faithful Unified Understanding and Generation Model for Remote Sensingcited by 0
  22. 2026Think and Answer ME: Benchmarking and Exploring Multi-Entity Reasoning Grounding in Remote Sensingcited by 0
  23. 2026Training-Free Open-Vocabulary Visual Grounding for Remote Sensing Images and Videoscited by 0
  24. 2026GeoSelect: Spatial-Program Execution for Training-Free Referring Remote Sensing Image Segmentationcited by 0
  25. 2026More with Less: a Large Scale Remote Sensing VLM with a Simple Recipecited by 0
  26. 2026Better, Stronger, Faster, and Broader: Structured All-Mask Prediction for MLLM-Based Segmentationcited by 0
  27. 2026DiCoR: Decoupled Referent Disambiguation and Contour Recalibration for Efficient Referring Remote Sensing Image Segmentationcited by 0
  28. 2026GeoRefer-Bench: A Benchmark from Referring Pixels to Verifiable Geospatial Reasoningcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025LISAT: Language-Instructed Segmentation Assistant for Satellite Imagery
  2. 2026LongEarth-R1: Benchmarking and Aligning Vision-Language Models for Long-Horizon Earth Observation Reasoning
  3. 2026GeoSeg: Training-Free Reasoning-Driven Segmentation in Remote Sensing Imagery
  4. 2026TerraScope: Pixel-Grounded Visual Reasoning for Earth Observation
  5. 2026OmniEarth: A Benchmark for Evaluating Vision-Language Models in Geospatial Tasks
  6. 2026Beyond Zooming: Learning Multi-Tool Visual Reasoning for Ultra-High-Resolution Remote Sensing
  7. 2024VRSBench: A Versatile Vision-Language Benchmark Dataset for Remote Sensing Image Understanding
  8. 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensing