The Segment Anything Model (SAM) for Remote Sensing Applications: From Zero to One Shot
Not on the map. Why?
Abstract (arXiv)
Segmentation is an essential step for remote sensing image processing. This study aims to advance the application of the Segment Anything Model (SAM), an innovative image segmentation model by Meta AI, in the field of remote sensing image analysis. SAM is known for its exceptional generalization capabilities and zero-shot learning, making it a promising approach to processing aerial and orbital images from diverse geographical contexts. Our exploration involved testing SAM across multi-scale datasets using various input prompts, such as bounding boxes, individual points, and text descriptors. To enhance the model's performance, we implemented a novel automated technique that combines a text-prompt-derived general example with one-shot training. This adjustment resulted in an improvement in accuracy, underscoring SAM's potential for deployment in remote sensing imagery and reducing the need for manual annotation. Despite the limitations encountered with lower spatial resolution images, SAM exhibits promising adaptability to remote sensing data analysis. We recommend future research to enhance the model's proficiency through integration with supplementary fine-tuning techniques and other networks. Furthermore, we provide the open-source code of our modifications on online repositories, encouraging further and broader adaptations of SAM to the remote sensing domain.
Key facts. Cited by 83 papers in the map (data through 7 Oct 2026). Builds on 34 of its 77 references that are in the map. First posted on arXiv 29 Jun 2023.
Builds on
34 of 77 references.
References · 34
- 2023GPT-4 Technical Reportcited by 18,132
- 2023Segment Anythingcited by 8,158
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,306
- 2021Grounded Language-Image Pre-trainingcited by 1,147
- 2023Vision-Language Models for Vision Tasks: A Surveycited by 834
- 2020Image Segmentation Using Deep Learning: A Surveycited by 659
- 2023Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Modelscited by 659
- 2020Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlationcited by 420
- 2023Augmented Language Models: a Surveycited by 398
22 more
- 2023RemoteCLIP: A Vision Language Foundation Model for Remote Sensingcited by 357
- 2022GLIPv2: Unifying Localization and Vision-Language Understandingcited by 275
- 2021LoveDA: A Remote Sensing Land-Cover Dataset for Domain Adaptive Semantic Segmentationcited by 259
- 2023Personalize Segment Anything Model with One Shotcited by 250
- 2022UniFormer: Unifying Convolution and Self-attention for Visual Recognitioncited by 206
- 2021Object Detection in Aerial Images: A Large-Scale Benchmark and Challengescited by 202
- 2020RSVQA: Visual Question Answering for Remote Sensing Datacited by 197
- 2020FloodNet: A High Resolution Aerial Imagery Dataset for Post Flood Scene Understandingcited by 181
- 2023Transformer-Based Visual Segmentation: A Surveycited by 124
- 2018Land-Cover Classification with High-Resolution Remote Sensing Images Using Transferable Deep Modelscited by 118
- 2023On the Opportunities and Challenges of Foundation Models for Geospatial Artificial Intelligencecited by 88
- 2020Foreground-Aware Relation Network for Geospatial Object Segmentation in High Spatial Resolution Remote Sensing Imagerycited by 73
- 2022Transformers in Remote Sensing: A Surveycited by 61
- 2019Unsupervised Domain Adaptation using Generative Adversarial Networks for Semantic Segmentation of Aerial Imagescited by 32
- 2021A Review on Deep Learning in UAV Remote Sensingcited by 32
- 2021Semantic Segmentation of Remote Sensing Images with Sparse Annotationscited by 30
- 2020Few-shot Object Detection on Remote Sensing Imagescited by 23
- 2022AI Security for Geoscience and Remote Sensing: Challenges and Future Trendscited by 23
- 2021Panoptic Segmentation Meets Remote Sensingcited by 14
- 2021Semantic Segmentation with Labeling Uncertainty and Class Imbalancecited by 12
- 2020A CNN Approach to Simultaneously Count Plants and Detect Plantation-Rows from UAV Imagerycited by 11
- 2023The Potential of Visual ChatGPT For Remote Sensingcited by 10
Built on by
Citing papers per year: 2023: 11; 2024: 30; 2025: 27; 2026: 15.
83 papers.
Sort:
By area:
- 2023Adapting Segment Anything Model for Change Detection in HR Remote Sensing Imagescited by 56
- 2023SAM-Assisted Remote Sensing Imagery Semantic Segmentation with Object and Boundary Constraintscited by 35
- 2024EarthMarker: A Visual Prompting Multi-modal Large Language Model for Remote Sensingcited by 29
- 2024PointSAM: Pointly-Supervised Segment Anything Model for Remote Sensing Imagescited by 24
- 2024On Efficient Variants of Segment Anything Model: A Surveycited by 16
- 2025ROS-SAM: High-Quality Interactive Segmentation for Remote Sensing Moving Objectcited by 15
- 2024OAM-TCD: A globally diverse dataset of high-resolution tree cover mapscited by 14
- 2023When Geoscience Meets Foundation Models: Towards General Geoscience Artificial Intelligence Systemcited by 13
- 2024Change Detection Between Optical Remote Sensing Imagery and Map Data via Segment Anything Model (SAM)cited by 12
- 2024Towards Satellite Image Road Graph Extraction: A Global-Scale Dataset and A Novel Methodcited by 10
- 2024ASANet: Asymmetric Semantic Aligning Network for RGB and SAR image land cover classificationcited by 10
- 2025No time to train! Training-Free Reference-Based Instance Segmentationcited by 9
38 more
- 2024A Multispectral Automated Transfer Technique (MATT) for machine-driven image labeling utilizing the Segment Anything Model (SAM)cited by 8
- 2024Learning without Exact Guidance: Updating Large-scale High-resolution Land Cover Maps from Low-resolution Historical Labelscited by 8
- 2024Prompt-Based Segmentation at Multiple Resolutions and Lighting Conditions using Segment Anything Model 2cited by 8
- 2025UrbanSAM: Learning Invariance-Inspired Adapters for Segment Anything Models in Urban Constructioncited by 8
- 2023GeoSAM: Fine-tuning SAM with Multi-Modal Prompts for Mobility Infrastructure Segmentationcited by 7
- 2025Bringing SAM to new heights: Leveraging elevation data for tree crown segmentation from drone imagerycited by 6
- 2023SAM-OCTA: Prompting Segment-Anything for OCTA Image Segmentationcited by 5
- 2024Zero-Shot Automatic Annotation and Instance Segmentation using LLM-Generated Datasets: Eliminating Field Imaging and Manual Annotation for Deep Learning Model Developmentcited by 5
- 2025Delineate Anything: Resolution-Agnostic Field Boundary Delineation on Satellite Imagerycited by 5
- 2025OccuFly: A 3D Vision Benchmark for Semantic Scene Completion from the Aerial Perspectivecited by 5
- 2023Industrial Segment Anything -- a Case Study in Aircraft Manufacturing, Intralogistics, Maintenance, Repair, and Overhaulcited by 4
- 2024FMARS: Annotating Remote Sensing Images for Disaster Management using Foundation Modelscited by 4
- 2024ALPS: An Auto-Labeling and Pre-training Scheme for Remote Sensing Segmentation With Segment Anything Modelcited by 4
- 2024EchoONE: Segmenting Multiple echocardiography Planes in One Modelcited by 4
- 2025Rethinking Few-Shot Medical Image Segmentation by SAM2: A Training-Free Framework with Augmentative Prompting and Dynamic Matchingcited by 4
- 2025Assessing SAM for Tree Crown Instance Segmentation from Drone Imagerycited by 4
- 2026Farmland Extent and Visible Boundary Mapping from 1 m NAIP Imagery Using Residual U-Net and Text-Prompted SAM 3 Refinementcited by 4
- 2023GEM: Boost Simple Network for Glass Surface Segmentation via Vision Foundation Modelscited by 3
- 2023OBSUM: An object-based spatial unmixing model for spatiotemporal fusion of remote sensing imagescited by 3
- 2024MoPEFT: A Mixture-of-PEFTs for the Segment Anything Modelcited by 3
- 2024Investigating the Segment Anything Foundation Model for Mapping Smallholder Agriculture Field Boundaries Without Training Labelscited by 3
- 2024Earth System Data Cubes: Avenues for advancing Earth system researchcited by 3
- 2025On the Effectiveness of Textual Prompting with Lightweight Fine-Tuning for SAM3 Remote Sensing Segmentationcited by 3
- 2026Boosting Segment Anything Model to Generalize Visually Non-Salient Scenarioscited by 3
- 2026From crown candidates to neighborhood screening: integrating optical GeoAI and spatial modeling for urban-canopy assessment in Davis, Californiacited by 3
- 2023Prompt-Driven Building Footprint Extraction in Aerial Images with Offset-Building Modelcited by 2
- 2024SA-MixNet: Structure-aware Mixup and Invariance Learning for Scribble-supervised Road Extraction in Remote Sensing Imagescited by 2
- 2024TransLandSeg: A Transfer Learning Approach for Landslide Semantic Segmentation Based on Vision Foundation Modelcited by 2
- 2024Tuning a SAM-Based Model with Multi-Cognitive Visual Adapter to Remote Sensing Instance Segmentationcited by 2
- 2025UCS: A Universal Model for Curvilinear Structure Segmentationcited by 2
- 2025Post-Hurricane Debris Segmentation Using Fine-Tuned Foundational Vision Modelscited by 2
- 2025SRMF: A Data Augmentation and Multimodal Fusion Approach for Long-Tail UHR Satellite Image Segmentationcited by 2
- 2026LLM Agent Framework for Intelligent Change Analysis in Urban Environment using Remote Sensing Imagerycited by 2
- 2023Zero-Shot Refinement of Buildings' Segmentation Models using SAMcited by 1
- 2024FusionVision: A comprehensive approach of 3D object reconstruction and segmentation from RGB-D cameras using YOLO and fast segment anythingcited by 1
- 2024Leveraging Segment Anything Model in Identifying Buildings within Refugee Camps (SAM4Refugee) from Satellite Imagery for Humanitarian Operationscited by 1
- 2024VideoSAM: A Large Vision Foundation Model for High-Speed Video Segmentationcited by 1
- 2024Slender Object Scene Segmentation in Remote Sensing Image Based on Learnable Morphological Skeleton with Segment Anything Modelcited by 1
50 most cited of 83 All 83 (JSON)
- 2026COBICount: Separating Object and Background Responses for Remote Sensing Object Counting Without Training on Target Data30 Sep 2026
- 2026Learning Woody Clearing With Loss Alignment for Zero-Shot Regrowth and Woody Segmentation27 Aug 2026
- 2026From crown candidates to neighborhood screening: integrating optical GeoAI and spatial modeling for urban-canopy assessment in Davis, California14 Aug 2026
- 2026CROSS: Cascaded Distillation and Dual-Constraint Grounding for Remote Sensing Referring Segmentation4 Aug 2026
- 2026Farmland Extent and Visible Boundary Mapping from 1 m NAIP Imagery Using Residual U-Net and Text-Prompted SAM 3 Refinement24 Jul 2026
- 2026Delineate Anything v2: A Global Foundation Model for Field Delineation21 Jul 2026
- 2026iSAGE: A Human-in-the-Loop Framework for Remote Sensing Semantic Segmentation via Sparse Point Supervision8 Jun 2026
- 2026Remote SAMsing: From Segment Anything to Segment Everything30 Apr 2026
- 2026WILD-SAM: Phase-Aware Expert Adaptation of SAM for Landslide Detection in Wrapped InSAR Interferograms16 Apr 2026
- 2026SegFly: A Dataset and 2D-3D-2D Paradigm for Aerial RGB-Thermal Semantic Segmentation at Scale18 Mar 2026
- 2026A High-Level Survey of Optical Remote Sensing19 Feb 2026
- 2026SAM-Aug: Leveraging SAM Priors for Few-Shot Parcel Segmentation in Satellite Time Series14 Jan 2026
38 more
- 2026LLM Agent Framework for Intelligent Change Analysis in Urban Environment using Remote Sensing Imagery6 Jan 2026
- 2026Towards Any-Quality Image Segmentation via Generative and Adaptive Latent Space Enhancement5 Jan 2026
- 2026Boosting Segment Anything Model to Generalize Visually Non-Salient Scenarios2 Jan 2026
- 2025OccuFly: A 3D Vision Benchmark for Semantic Scene Completion from the Aerial Perspective23 Dec 2025
- 2025On the Effectiveness of Textual Prompting with Lightweight Fine-Tuning for SAM3 Remote Sensing Segmentation17 Dec 2025
- 2025NAS-LoRA: Empowering Parameter-Efficient Fine-Tuning for Visual Foundation Models with Searchable Adaptation3 Dec 2025
- 2025VFM-ISRefiner: Towards Better Adapting Vision Foundation Models for Interactive Segmentation of Remote Sensing Images30 Nov 2025
- 2025ReSAM: Refine, Requery, and Reinforce: Self-Prompting Point-Supervised Segmentation for Remote Sensing Images26 Nov 2025
- 2025Ref-SAM3D: Bridging SAM3D with Text for Reference 3D Reconstruction24 Nov 2025
- 2025Riverbank Erosion Analysis in Bangladesh Using Spatiotemporal Segmentation20 Oct 2025
- 2025Adapting SAM with Dynamic Similarity Graphs for Few-Shot Parameter-Efficient Small Dense Object Detection: A Case Study of Chickpea Pods in Field Conditions30 Sep 2025
- 2025WHU-STree: A Multi-modal Benchmark Dataset for Street Tree Inventory16 Sep 2025
- 2025Olive Tree Satellite Image Segmentation Based On SAM and Multi-Phase Refinement28 Aug 2025
- 2025AGI for the Earth, the path, possibilities and how to evaluate intelligence of models that work with Earth Observation Data?8 Aug 2025
- 2025No time to train! Training-Free Reference-Based Instance Segmentation3 Jul 2025
- 2025Segment Anything for Satellite Imagery: A Strong Baseline and a Regional Dataset for Automatic Field Delineation19 Jun 2025
- 2025Bringing SAM to new heights: Leveraging elevation data for tree crown segmentation from drone imagery5 Jun 2025
- 2025Industrial Synthetic Segment Pre-training19 May 2025
- 2025WaveInst: A Frequency-Domain Enhanced Network for Fine-Grained Thin Tree Trunk Extraction in Forest Scenes3 May 2025
- 2025XeMap: Contextual Referring in Large-Scale Remote Sensing Environments30 Apr 2025
- 2025SRMF: A Data Augmentation and Multimodal Fusion Approach for Long-Tail UHR Satellite Image Segmentation28 Apr 2025
- 2025Post-Hurricane Debris Segmentation Using Fine-Tuned Foundational Vision Models17 Apr 2025
- 2025UCS: A Universal Model for Curvilinear Structure Segmentation5 Apr 2025
- 2025Delineate Anything: Resolution-Agnostic Field Boundary Delineation on Satellite Imagery3 Apr 2025
- 2025Assessing SAM for Tree Crown Instance Segmentation from Drone Imagery26 Mar 2025
- 2025Transport-Related Surface Detection with Machine Learning: Analyzing Temporal Trends in Madrid and Vienna19 Mar 2025
- 2025Breaking the Box: Enhancing Remote Sensing Image Segmentation with Freehand Sketches15 Mar 2025
- 2025ROS-SAM: High-Quality Interactive Segmentation for Remote Sensing Moving Object15 Mar 2025
- 2025Rethinking Few-Shot Medical Image Segmentation by SAM2: A Training-Free Framework with Augmentative Prompting and Dynamic Matching5 Mar 2025
- 2025UrbanSAM: Learning Invariance-Inspired Adapters for Segment Anything Models in Urban Construction21 Feb 2025
- 2024EchoONE: Segmenting Multiple echocardiography Planes in One Model4 Dec 2024
- 2024ASANet: Asymmetric Semantic Aligning Network for RGB and SAR image land cover classification3 Dec 2024
- 2024Rapid Distributed Fine-tuning of a Segmentation Model Onboard Satellites26 Nov 2024
- 2024Towards Satellite Image Road Graph Extraction: A Global-Scale Dataset and A Novel Method23 Nov 2024
- 2024Zero-Shot Automatic Annotation and Instance Segmentation using LLM-Generated Datasets: Eliminating Field Imaging and Manual Annotation for Deep Learning Model Development18 Nov 2024
- 2024Slender Object Scene Segmentation in Remote Sensing Image Based on Learnable Morphological Skeleton with Segment Anything Model13 Nov 2024
- 2024MSEG-VCUQ: Multimodal SEGmentation with Enhanced Vision Foundation Models, Convolutional Neural Networks, and Uncertainty Quantification for High-Speed Video Phase Detection Data12 Nov 2024
- 2024VideoSAM: A Large Vision Foundation Model for High-Speed Video Segmentation22 Oct 2024
50 newest of 83 All 83 (JSON)
- 2023Adapting Segment Anything Model for Change Detection in HR Remote Sensing Imagescited by 56
- 2023SAM-Assisted Remote Sensing Imagery Semantic Segmentation with Object and Boundary Constraintscited by 35
- 2024PointSAM: Pointly-Supervised Segment Anything Model for Remote Sensing Imagescited by 24
- 2024On Efficient Variants of Segment Anything Model: A Surveycited by 16
- 2025ROS-SAM: High-Quality Interactive Segmentation for Remote Sensing Moving Objectcited by 15
- 2024OAM-TCD: A globally diverse dataset of high-resolution tree cover mapscited by 14
- 2023When Geoscience Meets Foundation Models: Towards General Geoscience Artificial Intelligence Systemcited by 13
- 2024Change Detection Between Optical Remote Sensing Imagery and Map Data via Segment Anything Model (SAM)cited by 12
- 2024Towards Satellite Image Road Graph Extraction: A Global-Scale Dataset and A Novel Methodcited by 10
- 2024ASANet: Asymmetric Semantic Aligning Network for RGB and SAR image land cover classificationcited by 10
- 2025No time to train! Training-Free Reference-Based Instance Segmentationcited by 9
- 2024A Multispectral Automated Transfer Technique (MATT) for machine-driven image labeling utilizing the Segment Anything Model (SAM)cited by 8
12 most cited of 79 All 79 (JSON)
- 2026COBICount: Separating Object and Background Responses for Remote Sensing Object Counting Without Training on Target Data30 Sep 2026
- 2026Learning Woody Clearing With Loss Alignment for Zero-Shot Regrowth and Woody Segmentation27 Aug 2026
- 2026From crown candidates to neighborhood screening: integrating optical GeoAI and spatial modeling for urban-canopy assessment in Davis, California14 Aug 2026
- 2026CROSS: Cascaded Distillation and Dual-Constraint Grounding for Remote Sensing Referring Segmentation4 Aug 2026
- 2026Farmland Extent and Visible Boundary Mapping from 1 m NAIP Imagery Using Residual U-Net and Text-Prompted SAM 3 Refinement24 Jul 2026
- 2026Delineate Anything v2: A Global Foundation Model for Field Delineation21 Jul 2026
- 2026iSAGE: A Human-in-the-Loop Framework for Remote Sensing Semantic Segmentation via Sparse Point Supervision8 Jun 2026
- 2026Remote SAMsing: From Segment Anything to Segment Everything30 Apr 2026
- 2026WILD-SAM: Phase-Aware Expert Adaptation of SAM for Landslide Detection in Wrapped InSAR Interferograms16 Apr 2026
- 2026SegFly: A Dataset and 2D-3D-2D Paradigm for Aerial RGB-Thermal Semantic Segmentation at Scale18 Mar 2026
- 2026A High-Level Survey of Optical Remote Sensing19 Feb 2026
- 2026SAM-Aug: Leveraging SAM Priors for Few-Shot Parcel Segmentation in Satellite Time Series14 Jan 2026
12 newest of 79 All 79 (JSON)