iSAID: A Large-scale Dataset for Instance Segmentation in Aerial Images
Not on the map. Why?
Abstract (arXiv)
Existing Earth Vision datasets are either suitable for semantic segmentation or object detection. In this work, we introduce the first benchmark dataset for instance segmentation in aerial imagery that combines instance-level object detection and pixel-level segmentation tasks. In comparison to instance segmentation in natural scenes, aerial images present unique challenges e.g., a huge number of instances per image, large object-scale variations and abundant tiny objects. Our large-scale and densely annotated Instance Segmentation in Aerial Images Dataset (iSAID) comes with 655,451 object instances for 15 categories across 2,806 high-resolution images. Such precise per-pixel annotations for each instance ensure accurate localization that is essential for detailed scene analysis. Compared to existing small-scale aerial image based instance segmentation datasets, iSAID contains 15× the number of object categories and 5× the number of instances. We benchmark our dataset using two popular instance segmentation approaches for natural images, namely Mask R-CNN and PANet. In our experiments we show that direct application of off-the-shelf Mask R-CNN and PANet on aerial images provide suboptimal instance segmentation results, thus requiring specialized solutions from the research community. The dataset is publicly available at: https://captain-whu.github.io/iSAID/index.html
Key facts. Cited by 197 papers in the map (data through 14 Oct 2026). First posted on arXiv 30 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 18; 2022: 22; 2023: 34; 2024: 43; 2025: 48; 2026: 32.
197 papers.
Sort:
By area:
- 2023RemoteCLIP: A Vision Language Foundation Model for Remote Sensingcited by 363
- 2021LoveDA: A Remote Sensing Land-Cover Dataset for Domain Adaptive Semantic Segmentationcited by 261
- 2022SegNeXt: Rethinking Convolutional Attention Design for Semantic Segmentationcited by 252
- 2023CAT-Seg: Cost Aggregation for Open-Vocabulary Semantic Segmentationcited by 219
- 2023SkySense: A Multi-Modal Remote Sensing Foundation Model Towards Universal Interpretation for Earth Observation Imagerycited by 205
- 2021Object Detection in Aerial Images: A Large-Scale Benchmark and Challengescited by 204
- 2023SegGPT: Segmenting Everything In Contextcited by 194
- 2024EarthGPT: A Universal Multi-modal Large Language Model for Multi-sensor Image Comprehension in Remote Sensing Domaincited by 184
- 2022SatlasPretrain: A Large-Scale Dataset for Remote Sensing Image Understandingcited by 167
- 2022Advancing Plain Vision Transformer Towards Remote Sensing Foundation Modelcited by 149
- 2023RepViT: Revisiting Mobile CNN From ViT Perspectivecited by 123
- 2022An Empirical Study of Remote Sensing Pretrainingcited by 105
38 more
- 2023Vision-Language Models in Remote Sensing: Current Progress and Future Trendscited by 93
- 2021Open-Vocabulary Instance Segmentation via Robust Cross-Modal Pseudo-Labelingcited by 84
- 2022DynamicEarthNet: Daily Multi-Spectral Satellite Dataset for Semantic Change Segmentationcited by 78
- 2024HyperSIGMA: Hyperspectral Intelligence Comprehension Foundation Modelcited by 73
- 2024PANGAEA: A Global and Inclusive Benchmark for Geospatial Foundation Modelscited by 68
- 2022Transformers in Remote Sensing: A Surveycited by 61
- 2021Factors of Influence for Transfer Learning across Diverse Appearance Domains and Task Typescited by 54
- 2021Transferability Estimation using Bhattacharyya Class Separabilitycited by 54
- 2025UAVs Meet LLMs: Overviews and Perspectives Toward Agentic Low-Altitude Mobilitycited by 49
- 2025ThinkGeo: Evaluating Tool-Augmented Agents for Remote Sensing Taskscited by 46
- 2022Box-supervised Instance Segmentation with Level Set Evolutioncited by 41
- 2024SatSynth: Augmenting Image-Mask Pairs through Diffusion Models for Aerial Semantic Segmentationcited by 41
- 2022EarthNets: Empowering AI in Earth Observationcited by 40
- 2025RemoteSAM: Towards Segment Anything for Earth Observationcited by 39
- 2023SAMRS: Scaling-up Remote Sensing Segmentation Dataset with Segment Anything Modelcited by 38
- 2023MosaicFusion: Diffusion Models as Data Augmenters for Large Vocabulary Instance Segmentationcited by 35
- 2024Bridge the Points: Graph-based Few-shot Segment Anything Semanticallycited by 35
- 2021INTERN: A New Learning Paradigm Towards General Visioncited by 33
- 2022How stable are Transferability Metrics evaluations?cited by 30
- 2021PointFlow: Flowing Semantics Through Points for Aerial Image Segmentationcited by 29
- 2024EarthMarker: A Visual Prompting Multi-modal Large Language Model for Remote Sensingcited by 29
- 2025SkySense V2: A Unified Foundation Model for Multi-modal Remote Sensingcited by 26
- 2024SegEarth-OV: Towards Training-Free Open-Vocabulary Segmentation for Remote Sensing Imagescited by 25
- 2021Transferability Metrics for Selecting Source Model Ensemblescited by 24
- 2022Learning Local and Global Temporal Contexts for Video Semantic Segmentationcited by 24
- 2023What a MESS: Multi-Domain Evaluation of Zero-Shot Semantic Segmentationcited by 24
- 2023AerialFormer: Multi-resolution Transformer for Aerial Image Segmentationcited by 23
- 2022Unsupervised Change Detection Based on Image Reconstruction Losscited by 22
- 2022Box2Mask: Box-supervised Instance Segmentation via Level-set Evolutioncited by 22
- 2024Masked Angle-Aware Autoencoder for Remote Sensing Imagescited by 22
- 2022Self-Pair: Synthesizing Changes from Single Source for Object Change Detection in Remote Sensing Imagerycited by 19
- 2024Towards Open-Vocabulary Remote Sensing Image Semantic Segmentationcited by 19
- 2025A Survey on Remote Sensing Foundation Models: From Vision to Multimodalitycited by 19
- 2021Gaussian Bounding Boxes and Probabilistic Intersection-over-Union for Object Detectioncited by 18
- 2025Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectivescited by 18
- 2023A Survey on Semi-Supervised Semantic Segmentationcited by 17
- 2024Discrete Latent Perspective Learning for Segmentation and Detectioncited by 16
- 2025RingMoE: Mixture-of-Modality-Experts Multi-Modal Foundation Models for Universal Remote Sensing Image Interpretationcited by 16
50 most cited of 197 All 197 (JSON)
- 2026TAG: Calibrating SAM3 for Universal Image Segmentation without Dense Supervision10 Oct 2026
- 2026A Geometric-Transformation Feature-Adaptive Manifold Restoration Method for Open-Vocabulary Semantic Segmentation of Remote Sensing Images3 Oct 2026
- 2026Preference-Guided Adaptation for Open-Vocabulary Semantic Segmentation via Prompt Disagreement28 Sep 2026
- 2026When Do Frozen VLMs Respond to Image-Free Object-Token Edits? An Answer-Key-Free Protocol and What It Reveals3 Sep 2026
- 2026RingMoClaw: An Experience-Inspired Multi-Agent Framework for Self-Evolving Research in Remote Sensing1 Sep 2026
- 2026GeoRefer-Bench: A Benchmark from Referring Pixels to Verifiable Geospatial Reasoning25 Aug 2026
- 2026Remote-Sensing City Layout Extraction with MLLM17 Aug 2026
- 2026UniEvo-RS: Omni-Prompt Unified Remote Sensing Segmentation with Representative Exemplar-Driven Prototype Evolution4 Aug 2026
- 2026ISRS-DETR: Detection-Guided Click Propagation for Remote Sensing Interactive Segmentation3 Aug 2026
- 2026Training-Free Entity-Level Few-Shot Segmentation of Remote Sensing Images with Advection Refinement31 Jul 2026
- 2026OVEarth-Bench: Evaluating Category Breadth and Query Diversity for Open-Vocabulary Earth Observation29 Jul 2026
- 2026Few-Shot Open-Vocabulary Remote Sensing Segmentation via Textual Inversion28 Jul 2026
38 more
- 2026Promptable Concept Segmentation from Above: Evaluating SAM 3's Zero-Shot and One-Shot Capabilities in Remote Sensing10 Jul 2026
- 2026UAV-OVVIS: Unmanned Aerial Vehicles Also Need Open-Vocabulary Video Instance Segmentation9 Jul 2026
- 2026A Large-Scale Dataset and a New Method for RemoteSensing Traffic Object Segmentation4 Jul 2026
- 2026FROST: Training-Free Few-Shot Segmentation with Frozen Features and Nonparametric Statistics30 Jun 2026
- 2026VIP: Visual-guided Prompt Evolution for Efficient Dense Vision-Language Inference12 May 2026
- 2026MPerS: Dynamic MLLM MixExperts Perception-Guided Remote Sensing Scene Segmentation11 May 2026
- 2026A generalised pre-training strategy for deep learning networks in semantic segmentation of remotely sensed images30 Apr 2026
- 2026Seeking Consensus: Geometric-Semantic On-the-Fly Recalibration for Open-Vocabulary Remote Sensing Semantic Segmentation29 Apr 2026
- 2026RemoteAgent: Bridging Vague Human Intents and Earth Observation with RL-based Agentic MLLMs9 Apr 2026
- 2026ProtoFlow: Mitigating Forgetting in Class-Incremental Remote Sensing Segmentation via Low-Curvature Prototype Flow3 Apr 2026
- 2026ConInfer: Context-Aware Inference for Training-Free Open-Vocabulary Remote Sensing Segmentation31 Mar 2026
- 2026Transferring Physical Priors into Remote Sensing Segmentation via Large Language Models29 Mar 2026
- 2026LoD-Loc v3: Generalized Aerial Localization in Dense Cities using Instance Silhouette Alignment20 Mar 2026
- 2026VehAnchor: Metadata-Free Metric Scale Recovery from Vehicle Cues in Aerial Imagery4 Mar 2026
- 2026SAPNet++: Evolving Point-Prompted Instance Segmentation with Semantic and Spatial Awareness25 Feb 2026
- 2026Enabling Training-Free Text-Based Remote Sensing Segmentation19 Feb 2026
- 2026OpenEarthAgent: A Unified Framework for Tool-Augmented Geospatial Agents19 Feb 2026
- 2026A High-Level Survey of Optical Remote Sensing19 Feb 2026
- 2026Taming SAM3 in the Wild: A Concept Bank for Open-Vocabulary Segmentation6 Feb 2026
- 2026Spatial-Regularization-Aware Dual-Branch Collaborative Inference for Training-Free OVSS in Remote Sensing Imagery29 Jan 2026
- 2025MMLANDMARKS: a Cross-View Instance-Level Benchmark for Geo-Spatial Understanding19 Dec 2025
- 2025SegEarth-OV3: Exploring SAM 3 for Open-Vocabulary Semantic Segmentation in Remote Sensing Images9 Dec 2025
- 2025Generalized Referring Expression Segmentation on Aerial Photos8 Dec 2025
- 2025VFM-ISRefiner: Towards Better Adapting Vision Foundation Models for Interactive Segmentation of Remote Sensing Images30 Nov 2025
- 2025ReSAM: Refine, Requery, and Reinforce: Self-Prompting Point-Supervised Segmentation for Remote Sensing Images26 Nov 2025
- 2025Look Where It Matters: Training-Free Ultra-HR Remote Sensing VQA via Adaptive Zoom Search25 Nov 2025
- 2025SAM-MI: A Mask-Injected Framework for Enhancing Open-Vocabulary Semantic Segmentation with SAM25 Nov 2025
- 2025DOGE: Differentiable Bezier Graph Optimization for Road Network Extraction25 Nov 2025
- 2025Aerial View River Landform Video segmentation: A Weakly Supervised Context-aware Temporal Consistency Distillation Approach20 Nov 2025
- 2025FarSLIP: Discovering Effective CLIP Adaptation for Fine-Grained Remote Sensing Understanding18 Nov 2025
- 2025Survey of Multimodal Geospatial Foundation Models: Techniques, Applications, and Challenges27 Oct 2025
- 2025Getting the Numbers Rightunicodex2014Modelling Multi-Class Object Counting in Dense and Varied Scenes2 Oct 2025
- 2025DescribeEarth: Describe Anything for Remote Sensing Images30 Sep 2025
- 2025Visual Instruction Pretraining for Domain-Specific Foundation Models22 Sep 2025
- 2025TASAM: Terrain-and-Aware Segment Anything Model for Temporal-Scale Remote Sensing Segmentation19 Sep 2025
- 2025Differential Morphological Profile Neural Networks for Semantic Segmentation4 Sep 2025
- 2025SOPSeg: Prompt-based Small Object Instance Segmentation in Remote Sensing Imagery3 Sep 2025
- 2025RiverScope: High-Resolution River Masking Dataset2 Sep 2025
50 newest of 197 All 197 (JSON)
- 2023RemoteCLIP: A Vision Language Foundation Model for Remote Sensingcited by 363
- 2024EarthGPT: A Universal Multi-modal Large Language Model for Multi-sensor Image Comprehension in Remote Sensing Domaincited by 184
- 2023Vision-Language Models in Remote Sensing: Current Progress and Future Trendscited by 93
- 2024EarthMarker: A Visual Prompting Multi-modal Large Language Model for Remote Sensingcited by 29
- 2025Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectivescited by 18
- 2024Multilingual Vision-Language Pre-training for the Remote Sensing Domaincited by 7
- 2024High-Quality Mask Tuning Matters for Open-Vocabulary Segmentationcited by 5
- 2025DescribeEarth: Describe Anything for Remote Sensing Imagescited by 5
- 2025DGTRSD & DGTRS-CLIP: A Dual-Granularity Remote Sensing Image-Text Dataset and Vision Language Foundation Model for Alignmentcited by 4
- 2025Show or Tell? Effectively prompting Vision-Language Models for semantic segmentationcited by 4
- 2025Remote Sensing Semantic Segmentation Quality Assessment based on Vision Language Modelcited by 3
- 2026ConInfer: Context-Aware Inference for Training-Free Open-Vocabulary Remote Sensing Segmentationcited by 3
12 most cited of 16 All 16 (JSON)
- 2026UniEvo-RS: Omni-Prompt Unified Remote Sensing Segmentation with Representative Exemplar-Driven Prototype Evolution4 Aug 2026
- 2026ConInfer: Context-Aware Inference for Training-Free Open-Vocabulary Remote Sensing Segmentation31 Mar 2026
- 2026Enabling Training-Free Text-Based Remote Sensing Segmentation19 Feb 2026
- 2025DescribeEarth: Describe Anything for Remote Sensing Images30 Sep 2025
- 2025DGL-RSIS: Decoupling Global Spatial Context and Local Class Semantics for Training-Free Remote Sensing Image Segmentation30 Aug 2025
- 2025Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectives20 May 2025
- 2025Show or Tell? Effectively prompting Vision-Language Models for semantic segmentation25 Mar 2025
- 2025DGTRSD & DGTRS-CLIP: A Dual-Granularity Remote Sensing Image-Text Dataset and Vision Language Foundation Model for Alignment25 Mar 2025
- 2025Remote Sensing Semantic Segmentation Quality Assessment based on Vision Language Model19 Feb 2025
- 2024High-Quality Mask Tuning Matters for Open-Vocabulary Segmentation16 Dec 2024
- 2024Multilingual Vision-Language Pre-training for the Remote Sensing Domain30 Oct 2024
- 2024Advancements in Visual Language Models for Remote Sensing: Datasets, Capabilities, and Enhancement Techniques15 Oct 2024
12 newest of 16 All 16 (JSON)
- 2021LoveDA: A Remote Sensing Land-Cover Dataset for Domain Adaptive Semantic Segmentationcited by 261
- 2022SegNeXt: Rethinking Convolutional Attention Design for Semantic Segmentationcited by 252
- 2023CAT-Seg: Cost Aggregation for Open-Vocabulary Semantic Segmentationcited by 219
- 2023SkySense: A Multi-Modal Remote Sensing Foundation Model Towards Universal Interpretation for Earth Observation Imagerycited by 205
- 2021Object Detection in Aerial Images: A Large-Scale Benchmark and Challengescited by 204
- 2023SegGPT: Segmenting Everything In Contextcited by 194
- 2022SatlasPretrain: A Large-Scale Dataset for Remote Sensing Image Understandingcited by 167
- 2022Advancing Plain Vision Transformer Towards Remote Sensing Foundation Modelcited by 149
- 2023RepViT: Revisiting Mobile CNN From ViT Perspectivecited by 123
- 2022An Empirical Study of Remote Sensing Pretrainingcited by 105
- 2021Open-Vocabulary Instance Segmentation via Robust Cross-Modal Pseudo-Labelingcited by 84
- 2022DynamicEarthNet: Daily Multi-Spectral Satellite Dataset for Semantic Change Segmentationcited by 78
12 most cited of 168 All 168 (JSON)
- 2026TAG: Calibrating SAM3 for Universal Image Segmentation without Dense Supervision10 Oct 2026
- 2026A Geometric-Transformation Feature-Adaptive Manifold Restoration Method for Open-Vocabulary Semantic Segmentation of Remote Sensing Images3 Oct 2026
- 2026Preference-Guided Adaptation for Open-Vocabulary Semantic Segmentation via Prompt Disagreement28 Sep 2026
- 2026When Do Frozen VLMs Respond to Image-Free Object-Token Edits? An Answer-Key-Free Protocol and What It Reveals3 Sep 2026
- 2026RingMoClaw: An Experience-Inspired Multi-Agent Framework for Self-Evolving Research in Remote Sensing1 Sep 2026
- 2026GeoRefer-Bench: A Benchmark from Referring Pixels to Verifiable Geospatial Reasoning25 Aug 2026
- 2026Remote-Sensing City Layout Extraction with MLLM17 Aug 2026
- 2026ISRS-DETR: Detection-Guided Click Propagation for Remote Sensing Interactive Segmentation3 Aug 2026
- 2026Training-Free Entity-Level Few-Shot Segmentation of Remote Sensing Images with Advection Refinement31 Jul 2026
- 2026OVEarth-Bench: Evaluating Category Breadth and Query Diversity for Open-Vocabulary Earth Observation29 Jul 2026
- 2026Few-Shot Open-Vocabulary Remote Sensing Segmentation via Textual Inversion28 Jul 2026
- 2026Promptable Concept Segmentation from Above: Evaluating SAM 3's Zero-Shot and One-Shot Capabilities in Remote Sensing10 Jul 2026
12 newest of 168 All 168 (JSON)