STAR: A First-Ever Dataset and A Large-Scale Benchmark for Scene Graph Generation in Large-Size Satellite Imagery
Not on the map. Why?
Abstract (arXiv)
Scene graph generation (SGG) in satellite imagery (SAI) benefits promoting understanding of geospatial scenarios from perception to cognition. In SAI, objects exhibit great variations in scales and aspect ratios, and there exist rich relationships between objects (even between spatially disjoint objects), which makes it attractive to holistically conduct SGG in large-size very-high-resolution (VHR) SAI. However, there lack such SGG datasets. Due to the complexity of large-size SAI, mining triplets <subject, relationship, object> heavily relies on long-range contextual reasoning. Consequently, SGG models designed for small-size natural imagery are not directly applicable to large-size SAI. This paper constructs a large-scale dataset for SGG in large-size VHR SAI with image sizes ranging from 512 x 768 to 27,860 x 31,096 pixels, named STAR (Scene graph generaTion in lArge-size satellite imageRy), encompassing over 210K objects and over 400K triplets. To realize SGG in large-size SAI, we propose a context-aware cascade cognition (CAC) framework to understand SAI regarding object detection (OBD), pair pruning and relationship prediction for SGG. We also release a SAI-oriented SGG toolkit with about 30 OBD and 10 SGG methods which need further adaptation by our devised modules on our challenging STAR dataset. The dataset and toolkit are available at: https://linlin-dev.github.io/project/STAR.
Key facts. Cited by 31 papers in the map (data through 7 Oct 2026). Builds on 65 of its 107 references that are in the map. First posted on arXiv 13 Jun 2024.
Builds on
65 of 107 references.
References · 65
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2017Graph Attention Networkscited by 8,854
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
- 2015Fast R-CNNcited by 2,930
- 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,646
- 2019FCOS: Fully Convolutional One-Stage Object Detectioncited by 1,573
- 2019MMDetection: Open MMLab Detection Toolbox and Benchmarkcited by 1,379
- 2017Remote Sensing Image Scene Classification: Benchmark and State of the Artcited by 791
- 2017DOTA: A Large-scale Dataset for Object Detection in Aerial Imagescited by 622
38 more
- 2019Bridging the Gap Between Anchor-based and Anchor-free Detection via Adaptive Training Sample Selectioncited by 539
- 2017Scene Graph Generation by Iterative Message Passingcited by 462
- 2019Cascade R-CNN: High Quality Object Detection and Instance Segmentationcited by 428
- 2017Neural Motifs: Scene Graph Parsing with Global Contextcited by 413
- 2020Unbiased Scene Graph Generation from Biased Trainingcited by 355
- 2019Object Detection in Optical Remote Sensing Images: A Survey and A New Benchmarkcited by 339
- 2016Visual Relationship Detection with Language Priorscited by 333
- 2018Graph R-CNN for Scene Graph Generationcited by 296
- 2019RepPoints: Point Set Representation for Object Detectioncited by 264
- 2018Learning to Compose Dynamic Tree Structures for Visual Contextscited by 258
- 2018Auto-Encoding Scene Graphs for Image Captioningcited by 254
- 2021Oriented R-CNN for Object Detectioncited by 230
- 2021TOOD: Task-aligned One-stage Object Detectioncited by 218
- 2021Object Detection in Aerial Images: A Large-Scale Benchmark and Challengescited by 202
- 2021ReDet: A Rotation-equivariant Detector for Aerial Object Detectioncited by 202
- 2017Exploring Models and Data for Remote Sensing Image Caption Generationcited by 195
- 2019R3Det: Refined Single-Stage Detector with Feature Refinement for Rotating Objectcited by 193
- 2020Align Deep Features for Oriented Object Detectioncited by 186
- 2020FCOS: A simple and strong anchor-free object detectorcited by 171
- 2020GPS-Net: Graph Property Sensing Network for Scene Graph Generationcited by 165
- 2021Rethinking Rotated Object Detection with Gaussian Wasserstein Distance Losscited by 156
- 2021FAIR1M: A Benchmark Dataset for Fine-grained Object Recognition in High-Resolution Remote Sensing Imagerycited by 143
- 2021Bipartite Graph Network with Adaptive Message Passing for Unbiased Scene Graph Generationcited by 137
- 2019Gliding vertex on the horizontal bounding box for multi-oriented object detectioncited by 134
- 2021Learning High-Precision Bounding Box for Rotated Object Detection via Kullback-Leibler Divergencecited by 130
- 2021A Comprehensive Survey of Scene Graphs: Generation and Applicationcited by 125
- 2019Relation-Aware Graph Attention Network for Visual Question Answeringcited by 119
- 2022MMRotate: A Rotated Object Detection Benchmark using PyTorchcited by 115
- 2021Anchor-free Oriented Proposal Generator for Object Detectioncited by 104
- 2021Oriented RepPoints for Aerial Object Detectioncited by 102
- 2022Slicing Aided Hyper Inference and Fine-tuning for Small Object Detectioncited by 101
- 2023Large Selective Kernel Network for Remote Sensing Object Detectioncited by 98
- 2022The KFIoU Loss for Rotated Object Detectioncited by 73
- 2022Stacked Hybrid-Attention and Group Collaborative Learning for Unbiased Scene Graph Generationcited by 67
- 2020SCRDet++: Detecting Small, Cluttered and Rotated Objects via Instance-Level Feature Denoising and Rotation Loss Smoothingcited by 62
- 2018Automatic Ship Detection of Remote Sensing Images from Google Earth in Complex Scenes Based on Multi-Scale Rotation Dense Feature Pyramid Networkscited by 54
- 2024Poly Kernel Inception Network for Remote Sensing Detectioncited by 52
- 2023Dynamic Coarse-to-Fine Learning for Oriented Tiny Object Detectioncited by 43
50 most cited of 65 All 65 (JSON)
Built on by
Citing papers per year: 2024: 5; 2025: 17; 2026: 9.
31 papers.
Sort:
By area:
- 2024SkySenseGPT: A Fine-Grained Instruction Tuning Dataset and Model for Remote Sensing Vision-Language Understandingcited by 101
- 2024LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via a Hybrid Architecturecited by 100
- 2025GeoLLaVA-8K: Scaling Remote-Sensing Multimodal Large Language Models to 8K Resolutioncited by 41
- 2025When Large Vision-Language Model Meets Large Remote Sensing Imagery: Coarse-to-Fine Text-Guided Token Pruningcited by 35
- 20245%>100%: Breaking Performance Shackles of Full Fine-Tuning on Visual Recognition Taskscited by 34
- 2025Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectivescited by 18
- 2025ATRNet-STAR: A Large Dataset and Benchmark Towards Remote Sensing Object Recognition in the Wildcited by 12
- 2025Point2RBox-v2: Rethinking Point-supervised Oriented Object Detection with Spatial Layout Among Instancescited by 11
- 2025PointOBB-v3: Expanding Performance Boundaries of Single Point-Supervised Oriented Object Detectioncited by 9
- 2024ImageRAG: Enhancing Ultra High Resolution Remote Sensing Imagery Analysis with ImageRAGcited by 6
- 2025Wholly-WOOD: Wholly Leveraging Diversified-quality Labels for Weakly-supervised Oriented Object Detectioncited by 6
- 2024Exploiting Unlabeled Data with Multiple Expert Teachers for Open Vocabulary Aerial Object Detection and Its Orientation Adaptationcited by 4
19 more
- 2025MEET: A Million-Scale Dataset for Fine-Grained Geospatial Scene Classification with Zoom-Free Remote Sensing Imagerycited by 4
- 2025HoliTracer: Holistic Vectorization of Geographic Objects from Large-Size Remote Sensing Imagerycited by 4
- 2025Open-Vocabulary Object Detection in UAV Imagery: A Review and Future Perspectivescited by 3
- 2025S5: Scalable Semi-Supervised Semantic Segmentation in Remote Sensingcited by 3
- 2025Co-Training Vision Language Models for Remote Sensing Multi-task Learningcited by 3
- 2025SMART-Ship: A Comprehensive Synchronized Multi-modal Aligned Remote Sensing Targets Dataset and Benchmark for Berthed Ships Analysiscited by 2
- 2025FUSAR-KLIP: Towards Multimodal Foundation Models for Remote Sensingcited by 2
- 2025Point2RBox-v3: Self-Bootstrapping from Point Annotations via Integrated Pseudo-Label Refinement and Utilizationcited by 2
- 2026FUSAR-GPT : A Spatiotemporal Feature-Embedded and Two-Stage Decoupled Visual Language Model for SAR Imagerycited by 1
- 2026Beyond GSD-as-Token: Continuous Scale Conditioning for Remote Sensing VLMscited by 1
- 2026PhysScene: A Scene Graph Dataset for Scientific Visual Reasoning in Physics Experimentscited by 1
- 2025FOGMACHINE -- Leveraging Discrete-Event Simulation and Scene Graphs for Modeling Hierarchical, Interconnected Environments under Partial Observations from Mobile Agentscited by 0
- 2025Cross-modal Context-aware Learning for Visual Prompt Guided Multimodal Image Understanding in Remote Sensingcited by 0
- 20261%>100%: High-Efficiency Visual Adapter with Complex Linear Projection Optimizationcited by 0
- 2026UHR-DETR: Efficient End-to-End Small Object Detection for Ultra-High-Resolution Remote Sensing Imagerycited by 0
- 2026AeroVerse-SatAgent: UAV-Satellite Collaborative Spatial Reasoning Inspired by the Dual Visual Pathway Theory of Cognitive Neurosciencecited by 0
- 2026GeoSelect: Spatial-Program Execution for Training-Free Referring Remote Sensing Image Segmentationcited by 0
- 2026T-STAR: A Large-Scale Benchmark for Spatio-Temporal Panoptic Scene Graph Generation in Satellite Videocited by 0
- 2026Modeling Scientific Experiment Scenes: Dataset and Modelcited by 0
- 2026Modeling Scientific Experiment Scenes: Dataset and Model3 Aug 2026
- 2026T-STAR: A Large-Scale Benchmark for Spatio-Temporal Panoptic Scene Graph Generation in Satellite Video23 Jul 2026
- 2026GeoSelect: Spatial-Program Execution for Training-Free Referring Remote Sensing Image Segmentation4 Jul 2026
- 2026AeroVerse-SatAgent: UAV-Satellite Collaborative Spatial Reasoning Inspired by the Dual Visual Pathway Theory of Cognitive Neuroscience30 Jun 2026
- 2026PhysScene: A Scene Graph Dataset for Scientific Visual Reasoning in Physics Experiments8 Jun 2026
- 2026Beyond GSD-as-Token: Continuous Scale Conditioning for Remote Sensing VLMs8 May 2026
- 2026UHR-DETR: Efficient End-to-End Small Object Detection for Ultra-High-Resolution Remote Sensing Imagery23 Apr 2026
- 2026FUSAR-GPT : A Spatiotemporal Feature-Embedded and Two-Stage Decoupled Visual Language Model for SAR Imagery22 Feb 2026
- 20261%>100%: High-Efficiency Visual Adapter with Complex Linear Projection Optimization11 Feb 2026
- 2025Cross-modal Context-aware Learning for Visual Prompt Guided Multimodal Image Understanding in Remote Sensing12 Dec 2025
- 2025Co-Training Vision Language Models for Remote Sensing Multi-task Learning26 Nov 2025
- 2025FOGMACHINE -- Leveraging Discrete-Event Simulation and Scene Graphs for Modeling Hierarchical, Interconnected Environments under Partial Observations from Mobile Agents10 Oct 2025
19 more
- 2025Point2RBox-v3: Self-Bootstrapping from Point Annotations via Integrated Pseudo-Label Refinement and Utilization30 Sep 2025
- 2025FUSAR-KLIP: Towards Multimodal Foundation Models for Remote Sensing28 Sep 2025
- 2025S5: Scalable Semi-Supervised Semantic Segmentation in Remote Sensing17 Aug 2025
- 2025SMART-Ship: A Comprehensive Synchronized Multi-modal Aligned Remote Sensing Targets Dataset and Benchmark for Berthed Ships Analysis4 Aug 2025
- 2025HoliTracer: Holistic Vectorization of Geographic Objects from Large-Size Remote Sensing Imagery22 Jul 2025
- 2025Open-Vocabulary Object Detection in UAV Imagery: A Review and Future Perspectives4 Jul 2025
- 2025GeoLLaVA-8K: Scaling Remote-Sensing Multimodal Large Language Models to 8K Resolution27 May 2025
- 2025Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectives20 May 2025
- 2025MEET: A Million-Scale Dataset for Fine-Grained Geospatial Scene Classification with Zoom-Free Remote Sensing Imagery14 Mar 2025
- 2025When Large Vision-Language Model Meets Large Remote Sensing Imagery: Coarse-to-Fine Text-Guided Token Pruning10 Mar 2025
- 2025Wholly-WOOD: Wholly Leveraging Diversified-quality Labels for Weakly-supervised Oriented Object Detection13 Feb 2025
- 2025Point2RBox-v2: Rethinking Point-supervised Oriented Object Detection with Spatial Layout Among Instances6 Feb 2025
- 2025PointOBB-v3: Expanding Performance Boundaries of Single Point-Supervised Oriented Object Detection23 Jan 2025
- 2025ATRNet-STAR: A Large Dataset and Benchmark Towards Remote Sensing Object Recognition in the Wild23 Jan 2025
- 2024ImageRAG: Enhancing Ultra High Resolution Remote Sensing Imagery Analysis with ImageRAG12 Nov 2024
- 2024Exploiting Unlabeled Data with Multiple Expert Teachers for Open Vocabulary Aerial Object Detection and Its Orientation Adaptation4 Nov 2024
- 2024LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via a Hybrid Architecture4 Sep 2024
- 20245%>100%: Breaking Performance Shackles of Full Fine-Tuning on Visual Recognition Tasks15 Aug 2024
- 2024SkySenseGPT: A Fine-Grained Instruction Tuning Dataset and Model for Remote Sensing Vision-Language Understanding14 Jun 2024
- 2024SkySenseGPT: A Fine-Grained Instruction Tuning Dataset and Model for Remote Sensing Vision-Language Understandingcited by 101
- 2024LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via a Hybrid Architecturecited by 100
- 2025GeoLLaVA-8K: Scaling Remote-Sensing Multimodal Large Language Models to 8K Resolutioncited by 41
- 2025When Large Vision-Language Model Meets Large Remote Sensing Imagery: Coarse-to-Fine Text-Guided Token Pruningcited by 35
- 2025Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectivescited by 18
- 2025Co-Training Vision Language Models for Remote Sensing Multi-task Learningcited by 3
- 2025FUSAR-KLIP: Towards Multimodal Foundation Models for Remote Sensingcited by 2
- 2026Beyond GSD-as-Token: Continuous Scale Conditioning for Remote Sensing VLMscited by 1
- 2026Beyond GSD-as-Token: Continuous Scale Conditioning for Remote Sensing VLMs8 May 2026
- 2025Co-Training Vision Language Models for Remote Sensing Multi-task Learning26 Nov 2025
- 2025FUSAR-KLIP: Towards Multimodal Foundation Models for Remote Sensing28 Sep 2025
- 2025GeoLLaVA-8K: Scaling Remote-Sensing Multimodal Large Language Models to 8K Resolution27 May 2025
- 2025Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectives20 May 2025
- 2025When Large Vision-Language Model Meets Large Remote Sensing Imagery: Coarse-to-Fine Text-Guided Token Pruning10 Mar 2025
- 2024LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via a Hybrid Architecture4 Sep 2024
- 2024SkySenseGPT: A Fine-Grained Instruction Tuning Dataset and Model for Remote Sensing Vision-Language Understanding14 Jun 2024
- 2026PhysScene: A Scene Graph Dataset for Scientific Visual Reasoning in Physics Experimentscited by 1
- 2025Cross-modal Context-aware Learning for Visual Prompt Guided Multimodal Image Understanding in Remote Sensingcited by 0
- 2026AeroVerse-SatAgent: UAV-Satellite Collaborative Spatial Reasoning Inspired by the Dual Visual Pathway Theory of Cognitive Neurosciencecited by 0
- 2026AeroVerse-SatAgent: UAV-Satellite Collaborative Spatial Reasoning Inspired by the Dual Visual Pathway Theory of Cognitive Neuroscience30 Jun 2026
- 2026PhysScene: A Scene Graph Dataset for Scientific Visual Reasoning in Physics Experiments8 Jun 2026
- 2025Cross-modal Context-aware Learning for Visual Prompt Guided Multimodal Image Understanding in Remote Sensing12 Dec 2025
- 20245%>100%: Breaking Performance Shackles of Full Fine-Tuning on Visual Recognition Taskscited by 34
- 2025ATRNet-STAR: A Large Dataset and Benchmark Towards Remote Sensing Object Recognition in the Wildcited by 12
- 2025Point2RBox-v2: Rethinking Point-supervised Oriented Object Detection with Spatial Layout Among Instancescited by 11
- 2025PointOBB-v3: Expanding Performance Boundaries of Single Point-Supervised Oriented Object Detectioncited by 9
- 2024ImageRAG: Enhancing Ultra High Resolution Remote Sensing Imagery Analysis with ImageRAGcited by 6
- 2025Wholly-WOOD: Wholly Leveraging Diversified-quality Labels for Weakly-supervised Oriented Object Detectioncited by 6
- 2024Exploiting Unlabeled Data with Multiple Expert Teachers for Open Vocabulary Aerial Object Detection and Its Orientation Adaptationcited by 4
- 2025MEET: A Million-Scale Dataset for Fine-Grained Geospatial Scene Classification with Zoom-Free Remote Sensing Imagerycited by 4
- 2025HoliTracer: Holistic Vectorization of Geographic Objects from Large-Size Remote Sensing Imagerycited by 4
- 2025Open-Vocabulary Object Detection in UAV Imagery: A Review and Future Perspectivescited by 3
- 2025S5: Scalable Semi-Supervised Semantic Segmentation in Remote Sensingcited by 3
- 2025SMART-Ship: A Comprehensive Synchronized Multi-modal Aligned Remote Sensing Targets Dataset and Benchmark for Berthed Ships Analysiscited by 2
12 most cited of 19 All 19 (JSON)
- 2026Modeling Scientific Experiment Scenes: Dataset and Model3 Aug 2026
- 2026T-STAR: A Large-Scale Benchmark for Spatio-Temporal Panoptic Scene Graph Generation in Satellite Video23 Jul 2026
- 2026GeoSelect: Spatial-Program Execution for Training-Free Referring Remote Sensing Image Segmentation4 Jul 2026
- 2026UHR-DETR: Efficient End-to-End Small Object Detection for Ultra-High-Resolution Remote Sensing Imagery23 Apr 2026
- 2026FUSAR-GPT : A Spatiotemporal Feature-Embedded and Two-Stage Decoupled Visual Language Model for SAR Imagery22 Feb 2026
- 20261%>100%: High-Efficiency Visual Adapter with Complex Linear Projection Optimization11 Feb 2026
- 2025Point2RBox-v3: Self-Bootstrapping from Point Annotations via Integrated Pseudo-Label Refinement and Utilization30 Sep 2025
- 2025S5: Scalable Semi-Supervised Semantic Segmentation in Remote Sensing17 Aug 2025
- 2025SMART-Ship: A Comprehensive Synchronized Multi-modal Aligned Remote Sensing Targets Dataset and Benchmark for Berthed Ships Analysis4 Aug 2025
- 2025HoliTracer: Holistic Vectorization of Geographic Objects from Large-Size Remote Sensing Imagery22 Jul 2025
- 2025Open-Vocabulary Object Detection in UAV Imagery: A Review and Future Perspectives4 Jul 2025
- 2025MEET: A Million-Scale Dataset for Fine-Grained Geospatial Scene Classification with Zoom-Free Remote Sensing Imagery14 Mar 2025
12 newest of 19 All 19 (JSON)