ROS-SAM: High-Quality Interactive Segmentation for Remote Sensing Moving Object
Not on the map. Why?
Abstract (arXiv)
The availability of large-scale remote sensing video data underscores the importance of high-quality interactive segmentation. However, challenges such as small object sizes, ambiguous features, and limited generalization make it difficult for current methods to achieve this goal. In this work, we propose ROS-SAM, a method designed to achieve high-quality interactive segmentation while preserving generalization across diverse remote sensing data. The ROS-SAM is built upon three key innovations: 1) LoRA-based fine-tuning, which enables efficient domain adaptation while maintaining SAM's generalization ability, 2) Enhancement of deep network layers to improve the discriminability of extracted features, thereby reducing misclassifications, and 3) Integration of global context with local boundary details in the mask decoder to generate high-quality segmentation masks. Additionally, we design the data pipeline to ensure the model learns to better handle objects at varying scales during training while focusing on high-quality predictions during inference. Experiments on remote sensing video datasets show that the redesigned data pipeline boosts the IoU by 6%, while ROS-SAM increases the IoU by 13%. Finally, when evaluated on existing remote sensing object tracking datasets, ROS-SAM demonstrates impressive zero-shot capabilities, generating masks that closely resemble manual annotations. These results confirm ROS-SAM as a powerful tool for fine-grained segmentation in remote sensing applications. Code is available at https://github.com/ShanZard/ROS-SAM.
Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Builds on 44 of its 73 references that are in the map. First posted on arXiv 15 Mar 2025.
Builds on
44 of 73 references.
References · 44
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023Segment Anythingcited by 8,234
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2020Simple Copy-Paste is a Strong Data Augmentation Method for Instance Segmentationcited by 596
- 2023Medical SAM Adapter: Adapting Segment Anything Model for Medical Image Segmentationcited by 490
- 2023Segment Anything in High Qualitycited by 376
- 2023Segment Anything Model for Medical Image Analysis: an Experimental Studycited by 291
- 2023Track Anything: Segment Anything Meets Videoscited by 234
- 2019iSAID: A Large-scale Dataset for Instance Segmentation in Aerial Imagescited by 197
- 2021Boundary IoU: Improving Object-Centric Image Segmentation Evaluationcited by 188
- 2022SatlasPretrain: A Large-Scale Dataset for Remote Sensing Image Understandingcited by 167
32 more
- 2024Medical SAM 2: Segment medical images as video via Segment Anything Model 2cited by 154
- 2023Matcher: Segment Anything with One Shot Using All-Purpose Feature Matchingcited by 142
- 2021A Survey on Deep Learning Technique for Video Segmentationcited by 132
- 2022An Empirical Study of Remote Sensing Pretrainingcited by 105
- 2023SAI3D: Segment Any Instance in 3D Scenescited by 90
- 2023The Segment Anything Model (SAM) for Remote Sensing Applications: From Zero to One Shotcited by 83
- 20233DSAM-adapter: Holistic adaptation of SAM from 2D to 3D for promptable tumor segmentationcited by 70
- 2024Convolution Meets LoRA: Parameter Efficient Finetuning for Segment Anything Modelcited by 69
- 2024SAM2-UNet: Segment Anything 2 Makes Strong Encoder for Natural and Medical Image Segmentationcited by 64
- 2023A Billion-scale Foundation Model for Remote Sensing Imagescited by 62
- 2024SAM2-Adapter: Evaluating & Adapting Segment Anything 2 in Downstream Tasks: Camouflage, Shadow, Medical Image Segmentation, and Morecited by 60
- 2023AV-SAM: Segment Anything Model Meets Audio-Visual Localization and Segmentationcited by 53
- 2023How to Efficiently Adapt Large Segmentation Model(SAM) to Medical Imagescited by 53
- 2021Learning Statistical Texture for Semantic Segmentationcited by 51
- 2024EmbodiedSAM: Online Segment Any 3D Thing in Real Timecited by 40
- 2023Structural and Statistical Texture Knowledge Distillation for Semantic Segmentationcited by 36
- 2023SAM-Assisted Remote Sensing Imagery Semantic Segmentation with Object and Boundary Constraintscited by 35
- 2022Self-supervised remote sensing feature learning: Learning Paradigms, Challenges, and Future Workscited by 24
- 2023Can SAM Boost Video Super-Resolution?cited by 21
- 2021Detecting and Tracking Small and Dense Moving Objects in Satellite Videos: A Benchmarkcited by 18
- 2024PA-SAM: Prompt Adapter SAM for High-Quality Image Segmentationcited by 17
- 2024On Efficient Variants of Segment Anything Model: A Surveycited by 16
- 2023UVOSAM: A Mask-free Paradigm for Unsupervised Video Object Segmentation via Segment Anything Modelcited by 14
- 2024FastSAM3D: An Efficient Segment Anything Model for 3D Volumetric Medical Imagescited by 14
- 2024Segment Anything with Multiple Modalitiescited by 12
- 2024SAM-based instance segmentation models for the automation of structural damage detectioncited by 10
- 2024Task-Aware Low-Rank Adaptation of Segment Anything Modelcited by 6
- 2024Generalized SAM: Efficient Fine-Tuning of SAM for Variable Input Image Sizescited by 6
- 2023Attack-SAM: Towards Attacking Segment Anything Model With Adversarial Examplescited by 5
- 2024SAM-Guided Masked Token Prediction for 3D Scene Understandingcited by 3
- 2024Tuning a SAM-Based Model with Multi-Cognitive Visual Adapter to Remote Sensing Instance Segmentationcited by 2
- 2024CAD: Memory Efficient Convolutional Adapter for Segment Anythingcited by 2
Built on by
Citing papers per year: 2025: 10; 2026: 5.
15 papers.
Sort:
- 2025InstructSAM: A Training-Free Framework for Instruction-Oriented Remote Sensing Object Recognitioncited by 8
- 2025RSVG-ZeroOV: Exploring a Training-Free Framework for Zero-Shot Open-Vocabulary Visual Grounding in Remote Sensing Imagescited by 8
- 2025FICGen: Frequency-Inspired Contextual Disentanglement for Layout-driven Degraded Image Generationcited by 4
- 2025SOPSeg: Prompt-based Small Object Instance Segmentation in Remote Sensing Imagerycited by 3
- 2025Expose Camouflage in the Water: Underwater Camouflaged Instance Segmentation and Datasetcited by 2
- 2025Non-Registration Change Detection: A Novel Change Detection Task and Benchmark Datasetcited by 1
- 2025ViRefSAM: Visual Reference-Guided Segment Anything Model for Remote Sensing Segmentationcited by 1
- 2025ReSAM: Refine, Requery, and Reinforce: Self-Prompting Point-Supervised Segmentation for Remote Sensing Imagescited by 1
- 2025PAUL: Uncertainty-Guided Partition and Augmentation for Robust Cross-View Geo-Localization under Noisy Correspondencecited by 0
- 2025SatSAM2: Motion-Constrained Video Object Tracking in Satellite Imagery using Promptable SAM2 and Kalman Priorscited by 0
- 2026Leveraging Large Vision Model for Multi-UAV Co-perception in Low-Altitude Wireless Networkscited by 0
- 2026ZMIS-SAM: Segment Anything Model Enhanced with Wavelet Transform for Zooplankton Microscopy Image Instance Segmentationcited by 0
3 more
- 2026ISRS-DETR: Detection-Guided Click Propagation for Remote Sensing Interactive Segmentationcited by 0
- 2026CSGen: A Multi-Domain Curvilinear Structure Generation Model via Hierarchical Multimodal Diffusioncited by 0
- 2026Frequency and Edge-Guided Segment Anything Model for Remote Sensing Image Semantic Segmentationcited by 0
- 2026Frequency and Edge-Guided Segment Anything Model for Remote Sensing Image Semantic Segmentation15 Aug 2026
- 2026CSGen: A Multi-Domain Curvilinear Structure Generation Model via Hierarchical Multimodal Diffusion5 Aug 2026
- 2026ISRS-DETR: Detection-Guided Click Propagation for Remote Sensing Interactive Segmentation3 Aug 2026
- 2026ZMIS-SAM: Segment Anything Model Enhanced with Wavelet Transform for Zooplankton Microscopy Image Instance Segmentation30 Jul 2026
- 2026Leveraging Large Vision Model for Multi-UAV Co-perception in Low-Altitude Wireless Networks13 Mar 2026
- 2025ReSAM: Refine, Requery, and Reinforce: Self-Prompting Point-Supervised Segmentation for Remote Sensing Images26 Nov 2025
- 2025SatSAM2: Motion-Constrained Video Object Tracking in Satellite Imagery using Promptable SAM2 and Kalman Priors23 Nov 2025
- 2025Expose Camouflage in the Water: Underwater Camouflaged Instance Segmentation and Dataset20 Oct 2025
- 2025RSVG-ZeroOV: Exploring a Training-Free Framework for Zero-Shot Open-Vocabulary Visual Grounding in Remote Sensing Images23 Sep 2025
- 2025SOPSeg: Prompt-based Small Object Instance Segmentation in Remote Sensing Imagery3 Sep 2025
- 2025FICGen: Frequency-Inspired Contextual Disentanglement for Layout-driven Degraded Image Generation1 Sep 2025
- 2025PAUL: Uncertainty-Guided Partition and Augmentation for Robust Cross-View Geo-Localization under Noisy Correspondence27 Aug 2025
3 more
- 2025ViRefSAM: Visual Reference-Guided Segment Anything Model for Remote Sensing Segmentation3 Jul 2025
- 2025InstructSAM: A Training-Free Framework for Instruction-Oriented Remote Sensing Object Recognition21 May 2025
- 2025Non-Registration Change Detection: A Novel Change Detection Task and Benchmark Dataset15 May 2025
- 2025InstructSAM: A Training-Free Framework for Instruction-Oriented Remote Sensing Object Recognitioncited by 8
- 2025RSVG-ZeroOV: Exploring a Training-Free Framework for Zero-Shot Open-Vocabulary Visual Grounding in Remote Sensing Imagescited by 8
- 2025FICGen: Frequency-Inspired Contextual Disentanglement for Layout-driven Degraded Image Generationcited by 4
- 2025SOPSeg: Prompt-based Small Object Instance Segmentation in Remote Sensing Imagerycited by 3
- 2025Expose Camouflage in the Water: Underwater Camouflaged Instance Segmentation and Datasetcited by 2
- 2025Non-Registration Change Detection: A Novel Change Detection Task and Benchmark Datasetcited by 1
- 2025ViRefSAM: Visual Reference-Guided Segment Anything Model for Remote Sensing Segmentationcited by 1
- 2025ReSAM: Refine, Requery, and Reinforce: Self-Prompting Point-Supervised Segmentation for Remote Sensing Imagescited by 1
- 2025PAUL: Uncertainty-Guided Partition and Augmentation for Robust Cross-View Geo-Localization under Noisy Correspondencecited by 0
- 2025SatSAM2: Motion-Constrained Video Object Tracking in Satellite Imagery using Promptable SAM2 and Kalman Priorscited by 0
- 2026Leveraging Large Vision Model for Multi-UAV Co-perception in Low-Altitude Wireless Networkscited by 0
- 2026ZMIS-SAM: Segment Anything Model Enhanced with Wavelet Transform for Zooplankton Microscopy Image Instance Segmentationcited by 0
12 most cited of 15 All 15 (JSON)
- 2026Frequency and Edge-Guided Segment Anything Model for Remote Sensing Image Semantic Segmentation15 Aug 2026
- 2026CSGen: A Multi-Domain Curvilinear Structure Generation Model via Hierarchical Multimodal Diffusion5 Aug 2026
- 2026ISRS-DETR: Detection-Guided Click Propagation for Remote Sensing Interactive Segmentation3 Aug 2026
- 2026ZMIS-SAM: Segment Anything Model Enhanced with Wavelet Transform for Zooplankton Microscopy Image Instance Segmentation30 Jul 2026
- 2026Leveraging Large Vision Model for Multi-UAV Co-perception in Low-Altitude Wireless Networks13 Mar 2026
- 2025ReSAM: Refine, Requery, and Reinforce: Self-Prompting Point-Supervised Segmentation for Remote Sensing Images26 Nov 2025
- 2025SatSAM2: Motion-Constrained Video Object Tracking in Satellite Imagery using Promptable SAM2 and Kalman Priors23 Nov 2025
- 2025Expose Camouflage in the Water: Underwater Camouflaged Instance Segmentation and Dataset20 Oct 2025
- 2025RSVG-ZeroOV: Exploring a Training-Free Framework for Zero-Shot Open-Vocabulary Visual Grounding in Remote Sensing Images23 Sep 2025
- 2025SOPSeg: Prompt-based Small Object Instance Segmentation in Remote Sensing Imagery3 Sep 2025
- 2025FICGen: Frequency-Inspired Contextual Disentanglement for Layout-driven Degraded Image Generation1 Sep 2025
- 2025PAUL: Uncertainty-Guided Partition and Augmentation for Robust Cross-View Geo-Localization under Noisy Correspondence27 Aug 2025
12 newest of 15 All 15 (JSON)