SegEarth-R1: Geospatial Pixel Reasoning via Large Language Model
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Remote sensing has become critical for understanding environmental dynamics, urban planning, and disaster management. However, traditional remote sensing workflows often rely on explicit segmentation or detection methods, which struggle to handle complex, implicit queries that require reasoning over spatial context, domain knowledge, and implicit user intent. Motivated by this, we introduce a new task, ie, geospatial pixel reasoning, which allows implicit querying and reasoning and generates the mask of the target region. To advance this task, we construct and release the first large-scale benchmark dataset called EarthReason, which comprises 5,434 manually annotated image masks with over 30,000 implicit question-answer pairs. Moreover, we propose SegEarth-R1, a simple yet effective language-guided segmentation baseline that integrates a hierarchical visual encoder, a large language model (LLM) for instruction parsing, and a tailored mask generator for spatial correlation. The design of SegEarth-R1 incorporates domain-specific adaptations, including aggressive visual token compression to handle ultra-high-resolution remote sensing images, a description projection module to fuse language and multi-scale features, and a streamlined mask prediction pipeline that directly queries description embeddings. Extensive experiments demonstrate that SegEarth-R1 achieves state-of-the-art performance on both reasoning and referring segmentation tasks, significantly outperforming traditional and LLM-based segmentation methods. Our data and code will be released at https://github.com/earth-insights/SegEarth-R1.
Key facts. Cited by 40 papers in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 25 of its 95 references that are in the map. First posted on arXiv 13 Apr 2025.
Builds on
25 of 95 references.
References · 25
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2024PaliGemma: A versatile 3B VLM for transfercited by 679
- 2023Textbooks Are All You Need II: phi-1.5 technical reportcited by 559
- 2021LoveDA: A Remote Sensing Land-Cover Dataset for Domain Adaptive Semantic Segmentationcited by 259
- 2024PaliGemma 2: A Family of Versatile VLMs for Transfercited by 204
- 2025Sa2VA: Marrying SAM2 with MLLM for Dense Grounded Understanding of Images and Videoscited by 154
- 2019xBD: A Dataset for Assessing Building Damage from Satellite Imagerycited by 138
- 2024VHM: Versatile and Honest Vision Language Model for Remote Sensing Image Analysiscited by 84
- 2023NExT-Chat: An LMM for Chat, Detection and Segmentationcited by 79
- 2024Mission Critical -- Satellite Data is a Distinct Modality in Machine Learningcited by 76
13 more
- 2024DeCo: Decoupling Token Compression from Semantic Abstraction in Multimodal Large Language Modelscited by 74
- 2023LISA++: An Improved Baseline for Reasoning Segmentation with Large Language Modelcited by 70
- 2024EVF-SAM: Early Vision-Language Fusion for Text-Prompted Segment Anything Modelcited by 63
- 2024Text4Seg: Reimagining Image Segmentation as Text Generationcited by 59
- 2025GeoPixel: Pixel Grounding Large Multimodal Model in Remote Sensingcited by 55
- 2025XLRS-Bench: Could Your Multimodal LLMs Understand Extremely Large Ultra-High-Resolution Remote Sensing Imagery?cited by 50
- 2024GeoGround: A Unified Large Vision-Language Model for Remote Sensing Visual Groundingcited by 46
- 2024InstructSeg: Unifying Instructed Visual Segmentation with Multi-modal Large Language Modelscited by 31
- 2024RSUniVLM: A Unified Vision Language Model for Remote Sensing via Granularity-oriented Mixture of Expertscited by 29
- 2024Cross-Modal Bidirectional Interaction Model for Referring Remote Sensing Image Segmentationcited by 26
- 2024SegEarth-OV: Towards Training-Free Open-Vocabulary Segmentation for Remote Sensing Imagescited by 25
- 2025GeoPix: Multi-Modal Large Language Model for Pixel-level Image Understanding in Remote Sensingcited by 10
- 2024Instruction-guided Multi-Granularity Segmentation and Captioning with Large Multimodal Modelcited by 8
Built on by
Citing papers per year: 2025: 20; 2026: 20.
40 papers.
Sort:
By area:
- 2025RemoteReasoner: Towards Unifying Geospatial Reasoning Workflowcited by 25
- 2025Geo-R1: Improving Few-Shot Geospatial Referring Expression Understanding with Reinforcement Fine-Tuningcited by 19
- 2025RSRefSeg 2: Decoupling Referring Remote Sensing Image Segmentation with Foundation Modelscited by 17
- 2025Towards Faithful Reasoning in Remote Sensing: A Perceptually-Grounded GeoSpatial Chain-of-Thought for Vision-Language Modelscited by 17
- 2025Designing Domain-Specific Agents via Hierarchical Task Abstraction Mechanismcited by 16
- 2025GeoZero: Incentivizing Reasoning from Scratch on Geospatial Scenescited by 13
- 2025Reasoning Segmentation for Images and Videos: A Surveycited by 12
- 2025UniGeoSeg: Towards Unified Open-World Segmentation for Geospatial Scenescited by 10
- 2025SegEarth-R2: Towards Comprehensive Language-guided Segmentation for Remote Sensing Imagescited by 10
- 2025InstructSAM: A Training-Free Framework for Instruction-Oriented Remote Sensing Object Recognitioncited by 8
- 2025Text4Seg++: Advancing Image Segmentation via Generative Language Modelingcited by 8
- 2026RSGround-R1: Rethinking Remote Sensing Visual Grounding through Spatial Reasoningcited by 8
28 more
- 2025Annotation-Free Open-Vocabulary Segmentation for Remote-Sensing Imagescited by 7
- 2025CangLing-KnowFlow: A Unified Knowledge-and-Flow-fused Agent for Comprehensive Remote Sensing Applicationscited by 7
- 2026RemoteAgent: Bridging Vague Human Intents and Earth Observation with RL-based Agentic MLLMscited by 7
- 2025Bridging Semantics and Geometry: A Decoupled LVLM-SAM Framework for Reasoning Segmentation in Optical Remote Sensingcited by 6
- 2025GRASP: Geospatial pixel Reasoning viA Structured Policy learningcited by 4
- 2025TerraGen: A Unified Multi-Task Layout Generation Framework for Remote Sensing Data Augmentationcited by 4
- 2026DVGBench: Implicit-to-Explicit Visual Grounding Benchmark in UAV Imagery with Large Vision-Language Modelscited by 4
- 2026Earth-OneVision: Extending Remote Sensing Multimodal Large Language Models to More Sensor Modalities and Taskscited by 3
- 2025Generalized Referring Expression Segmentation on Aerial Photoscited by 2
- 2026Urban Socio-Semantic Segmentation with Vision-Language Reasoningcited by 2
- 2026Enabling Training-Free Text-Based Remote Sensing Segmentationcited by 2
- 2026GeoSolver: Scaling Test-Time Reasoning in Remote Sensing with Fine-Grained Process Supervisioncited by 2
- 2026RemoteShield: Enable Robust Multimodal Large Language Models for Earth Observationcited by 2
- 2026GeoHeight-Bench: Towards Height-Aware Multimodal Reasoning in Remote Sensingcited by 1
- 2026RemoteZero: Geospatial Reasoning with Zero Labelscited by 1
- 2026An Open-Source Benchmark and Baseline for Multi-temporal Referring Segmentationcited by 1
- 2026CROSS: Cascaded Distillation and Dual-Constraint Grounding for Remote Sensing Referring Segmentationcited by 1
- 2025From Pixels to Images: A Structural Survey of Deep Learning Paradigms in Remote Sensing Image Semantic Segmentationcited by 0
- 2025Cross-Modal Urban Sensing: Evaluating Sound-Vision Alignment Across Street-Level and Aerial Imagerycited by 0
- 2025Understanding What Is Not Said:Referring Remote Sensing Image Segmentation with Scarce Expressionscited by 0
- 2026Uni-RS: A Spatially Faithful Unified Understanding and Generation Model for Remote Sensingcited by 0
- 2026Think and Answer ME: Benchmarking and Exploring Multi-Entity Reasoning Grounding in Remote Sensingcited by 0
- 2026Training-Free Open-Vocabulary Visual Grounding for Remote Sensing Images and Videoscited by 0
- 2026GeoSelect: Spatial-Program Execution for Training-Free Referring Remote Sensing Image Segmentationcited by 0
- 2026More with Less: a Large Scale Remote Sensing VLM with a Simple Recipecited by 0
- 2026Better, Stronger, Faster, and Broader: Structured All-Mask Prediction for MLLM-Based Segmentationcited by 0
- 2026DiCoR: Decoupled Referent Disambiguation and Contour Recalibration for Efficient Referring Remote Sensing Image Segmentationcited by 0
- 2026GeoRefer-Bench: A Benchmark from Referring Pixels to Verifiable Geospatial Reasoningcited by 0
- 2026GeoRefer-Bench: A Benchmark from Referring Pixels to Verifiable Geospatial Reasoning25 Aug 2026
- 2026DiCoR: Decoupled Referent Disambiguation and Contour Recalibration for Efficient Referring Remote Sensing Image Segmentation13 Aug 2026
- 2026CROSS: Cascaded Distillation and Dual-Constraint Grounding for Remote Sensing Referring Segmentation4 Aug 2026
- 2026Better, Stronger, Faster, and Broader: Structured All-Mask Prediction for MLLM-Based Segmentation3 Aug 2026
- 2026More with Less: a Large Scale Remote Sensing VLM with a Simple Recipe17 Jul 2026
- 2026GeoSelect: Spatial-Program Execution for Training-Free Referring Remote Sensing Image Segmentation4 Jul 2026
- 2026Training-Free Open-Vocabulary Visual Grounding for Remote Sensing Images and Videos15 Jun 2026
- 2026Earth-OneVision: Extending Remote Sensing Multimodal Large Language Models to More Sensor Modalities and Tasks9 Jun 2026
- 2026An Open-Source Benchmark and Baseline for Multi-temporal Referring Segmentation31 May 2026
- 2026RemoteZero: Geospatial Reasoning with Zero Labels6 May 2026
- 2026RemoteShield: Enable Robust Multimodal Large Language Models for Earth Observation19 Apr 2026
- 2026RemoteAgent: Bridging Vague Human Intents and Earth Observation with RL-based Agentic MLLMs9 Apr 2026
28 more
- 2026GeoHeight-Bench: Towards Height-Aware Multimodal Reasoning in Remote Sensing26 Mar 2026
- 2026Think and Answer ME: Benchmarking and Exploring Multi-Entity Reasoning Grounding in Remote Sensing13 Mar 2026
- 2026GeoSolver: Scaling Test-Time Reasoning in Remote Sensing with Fine-Grained Process Supervision10 Mar 2026
- 2026Enabling Training-Free Text-Based Remote Sensing Segmentation19 Feb 2026
- 2026RSGround-R1: Rethinking Remote Sensing Visual Grounding through Spatial Reasoning29 Jan 2026
- 2026Uni-RS: A Spatially Faithful Unified Understanding and Generation Model for Remote Sensing25 Jan 2026
- 2026Urban Socio-Semantic Segmentation with Vision-Language Reasoning15 Jan 2026
- 2026DVGBench: Implicit-to-Explicit Visual Grounding Benchmark in UAV Imagery with Large Vision-Language Models2 Jan 2026
- 2025SegEarth-R2: Towards Comprehensive Language-guided Segmentation for Remote Sensing Images23 Dec 2025
- 2025Bridging Semantics and Geometry: A Decoupled LVLM-SAM Framework for Reasoning Segmentation in Optical Remote Sensing22 Dec 2025
- 2025CangLing-KnowFlow: A Unified Knowledge-and-Flow-fused Agent for Comprehensive Remote Sensing Applications17 Dec 2025
- 2025Generalized Referring Expression Segmentation on Aerial Photos8 Dec 2025
- 2025UniGeoSeg: Towards Unified Open-World Segmentation for Geospatial Scenes28 Nov 2025
- 2025GeoZero: Incentivizing Reasoning from Scratch on Geospatial Scenes27 Nov 2025
- 2025Designing Domain-Specific Agents via Hierarchical Task Abstraction Mechanism21 Nov 2025
- 2025Understanding What Is Not Said:Referring Remote Sensing Image Segmentation with Scarce Expressions26 Oct 2025
- 2025TerraGen: A Unified Multi-Task Layout Generation Framework for Remote Sensing Data Augmentation24 Oct 2025
- 2025Towards Faithful Reasoning in Remote Sensing: A Perceptually-Grounded GeoSpatial Chain-of-Thought for Vision-Language Models26 Sep 2025
- 2025Geo-R1: Improving Few-Shot Geospatial Referring Expression Understanding with Reinforcement Fine-Tuning26 Sep 2025
- 2025Text4Seg++: Advancing Image Segmentation via Generative Language Modeling8 Sep 2025
- 2025Annotation-Free Open-Vocabulary Segmentation for Remote-Sensing Images25 Aug 2025
- 2025GRASP: Geospatial pixel Reasoning viA Structured Policy learning23 Aug 2025
- 2025RemoteReasoner: Towards Unifying Geospatial Reasoning Workflow25 Jul 2025
- 2025RSRefSeg 2: Decoupling Referring Remote Sensing Image Segmentation with Foundation Models8 Jul 2025
- 2025Cross-Modal Urban Sensing: Evaluating Sound-Vision Alignment Across Street-Level and Aerial Imagery3 Jun 2025
- 2025Reasoning Segmentation for Images and Videos: A Survey24 May 2025
- 2025InstructSAM: A Training-Free Framework for Instruction-Oriented Remote Sensing Object Recognition21 May 2025
- 2025From Pixels to Images: A Structural Survey of Deep Learning Paradigms in Remote Sensing Image Semantic Segmentation21 May 2025
- 2025RemoteReasoner: Towards Unifying Geospatial Reasoning Workflowcited by 25
- 2025Towards Faithful Reasoning in Remote Sensing: A Perceptually-Grounded GeoSpatial Chain-of-Thought for Vision-Language Modelscited by 17
- 2025GeoZero: Incentivizing Reasoning from Scratch on Geospatial Scenescited by 13
- 2026RSGround-R1: Rethinking Remote Sensing Visual Grounding through Spatial Reasoningcited by 8
- 2025Bridging Semantics and Geometry: A Decoupled LVLM-SAM Framework for Reasoning Segmentation in Optical Remote Sensingcited by 6
- 2025GRASP: Geospatial pixel Reasoning viA Structured Policy learningcited by 4
- 2026Earth-OneVision: Extending Remote Sensing Multimodal Large Language Models to More Sensor Modalities and Taskscited by 3
- 2026Urban Socio-Semantic Segmentation with Vision-Language Reasoningcited by 2
- 2026GeoSolver: Scaling Test-Time Reasoning in Remote Sensing with Fine-Grained Process Supervisioncited by 2
- 2026RemoteZero: Geospatial Reasoning with Zero Labelscited by 1
- 2026An Open-Source Benchmark and Baseline for Multi-temporal Referring Segmentationcited by 1
- 2026Think and Answer ME: Benchmarking and Exploring Multi-Entity Reasoning Grounding in Remote Sensingcited by 0
- 2026Earth-OneVision: Extending Remote Sensing Multimodal Large Language Models to More Sensor Modalities and Tasks9 Jun 2026
- 2026An Open-Source Benchmark and Baseline for Multi-temporal Referring Segmentation31 May 2026
- 2026RemoteZero: Geospatial Reasoning with Zero Labels6 May 2026
- 2026Think and Answer ME: Benchmarking and Exploring Multi-Entity Reasoning Grounding in Remote Sensing13 Mar 2026
- 2026GeoSolver: Scaling Test-Time Reasoning in Remote Sensing with Fine-Grained Process Supervision10 Mar 2026
- 2026RSGround-R1: Rethinking Remote Sensing Visual Grounding through Spatial Reasoning29 Jan 2026
- 2026Urban Socio-Semantic Segmentation with Vision-Language Reasoning15 Jan 2026
- 2025Bridging Semantics and Geometry: A Decoupled LVLM-SAM Framework for Reasoning Segmentation in Optical Remote Sensing22 Dec 2025
- 2025GeoZero: Incentivizing Reasoning from Scratch on Geospatial Scenes27 Nov 2025
- 2025Towards Faithful Reasoning in Remote Sensing: A Perceptually-Grounded GeoSpatial Chain-of-Thought for Vision-Language Models26 Sep 2025
- 2025GRASP: Geospatial pixel Reasoning viA Structured Policy learning23 Aug 2025
- 2025RemoteReasoner: Towards Unifying Geospatial Reasoning Workflow25 Jul 2025
- 2025Text4Seg++: Advancing Image Segmentation via Generative Language Modelingcited by 8
- 2026DVGBench: Implicit-to-Explicit Visual Grounding Benchmark in UAV Imagery with Large Vision-Language Modelscited by 4
- 2026Enabling Training-Free Text-Based Remote Sensing Segmentationcited by 2
- 2026RemoteShield: Enable Robust Multimodal Large Language Models for Earth Observationcited by 2
- 2026GeoHeight-Bench: Towards Height-Aware Multimodal Reasoning in Remote Sensingcited by 1
- 2026More with Less: a Large Scale Remote Sensing VLM with a Simple Recipecited by 0
- 2026More with Less: a Large Scale Remote Sensing VLM with a Simple Recipe17 Jul 2026
- 2026RemoteShield: Enable Robust Multimodal Large Language Models for Earth Observation19 Apr 2026
- 2026GeoHeight-Bench: Towards Height-Aware Multimodal Reasoning in Remote Sensing26 Mar 2026
- 2026Enabling Training-Free Text-Based Remote Sensing Segmentation19 Feb 2026
- 2026DVGBench: Implicit-to-Explicit Visual Grounding Benchmark in UAV Imagery with Large Vision-Language Models2 Jan 2026
- 2025Text4Seg++: Advancing Image Segmentation via Generative Language Modeling8 Sep 2025
- 2025Designing Domain-Specific Agents via Hierarchical Task Abstraction Mechanismcited by 16
- 2025CangLing-KnowFlow: A Unified Knowledge-and-Flow-fused Agent for Comprehensive Remote Sensing Applicationscited by 7
- 2026RemoteAgent: Bridging Vague Human Intents and Earth Observation with RL-based Agentic MLLMscited by 7
- 2026RemoteAgent: Bridging Vague Human Intents and Earth Observation with RL-based Agentic MLLMs9 Apr 2026
- 2025CangLing-KnowFlow: A Unified Knowledge-and-Flow-fused Agent for Comprehensive Remote Sensing Applications17 Dec 2025
- 2025Designing Domain-Specific Agents via Hierarchical Task Abstraction Mechanism21 Nov 2025
- 2025Geo-R1: Improving Few-Shot Geospatial Referring Expression Understanding with Reinforcement Fine-Tuningcited by 19
- 2025RSRefSeg 2: Decoupling Referring Remote Sensing Image Segmentation with Foundation Modelscited by 17
- 2025Reasoning Segmentation for Images and Videos: A Surveycited by 12
- 2025UniGeoSeg: Towards Unified Open-World Segmentation for Geospatial Scenescited by 10
- 2025SegEarth-R2: Towards Comprehensive Language-guided Segmentation for Remote Sensing Imagescited by 10
- 2025InstructSAM: A Training-Free Framework for Instruction-Oriented Remote Sensing Object Recognitioncited by 8
- 2025Annotation-Free Open-Vocabulary Segmentation for Remote-Sensing Imagescited by 7
- 2025TerraGen: A Unified Multi-Task Layout Generation Framework for Remote Sensing Data Augmentationcited by 4
- 2025Generalized Referring Expression Segmentation on Aerial Photoscited by 2
- 2026CROSS: Cascaded Distillation and Dual-Constraint Grounding for Remote Sensing Referring Segmentationcited by 1
- 2025From Pixels to Images: A Structural Survey of Deep Learning Paradigms in Remote Sensing Image Semantic Segmentationcited by 0
- 2025Cross-Modal Urban Sensing: Evaluating Sound-Vision Alignment Across Street-Level and Aerial Imagerycited by 0
12 most cited of 19 All 19 (JSON)
- 2026GeoRefer-Bench: A Benchmark from Referring Pixels to Verifiable Geospatial Reasoning25 Aug 2026
- 2026DiCoR: Decoupled Referent Disambiguation and Contour Recalibration for Efficient Referring Remote Sensing Image Segmentation13 Aug 2026
- 2026CROSS: Cascaded Distillation and Dual-Constraint Grounding for Remote Sensing Referring Segmentation4 Aug 2026
- 2026Better, Stronger, Faster, and Broader: Structured All-Mask Prediction for MLLM-Based Segmentation3 Aug 2026
- 2026GeoSelect: Spatial-Program Execution for Training-Free Referring Remote Sensing Image Segmentation4 Jul 2026
- 2026Training-Free Open-Vocabulary Visual Grounding for Remote Sensing Images and Videos15 Jun 2026
- 2026Uni-RS: A Spatially Faithful Unified Understanding and Generation Model for Remote Sensing25 Jan 2026
- 2025SegEarth-R2: Towards Comprehensive Language-guided Segmentation for Remote Sensing Images23 Dec 2025
- 2025Generalized Referring Expression Segmentation on Aerial Photos8 Dec 2025
- 2025UniGeoSeg: Towards Unified Open-World Segmentation for Geospatial Scenes28 Nov 2025
- 2025Understanding What Is Not Said:Referring Remote Sensing Image Segmentation with Scarce Expressions26 Oct 2025
- 2025TerraGen: A Unified Multi-Task Layout Generation Framework for Remote Sensing Data Augmentation24 Oct 2025
12 newest of 19 All 19 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025LISAT: Language-Instructed Segmentation Assistant for Satellite Imagery
- 2026LongEarth-R1: Benchmarking and Aligning Vision-Language Models for Long-Horizon Earth Observation Reasoning
- 2026GeoSeg: Training-Free Reasoning-Driven Segmentation in Remote Sensing Imagery
- 2026TerraScope: Pixel-Grounded Visual Reasoning for Earth Observation
- 2026OmniEarth: A Benchmark for Evaluating Vision-Language Models in Geospatial Tasks
- 2026Beyond Zooming: Learning Multi-Tool Visual Reasoning for Ultra-High-Resolution Remote Sensing
- 2024VRSBench: A Versatile Vision-Language Benchmark Dataset for Remote Sensing Image Understanding
- 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensing