# S2Teacher: Step-by-step Teacher for Sparsely Annotated Oriented Object Detection

arXiv: https://arxiv.org/abs/2504.11111 · HTML: https://mlsanity.com/paper/2504.11111/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 30 of its 37 references that are in the map.
- First posted on arXiv 15 Apr 2025.

## Builds on (most cited first, 30 of 30)

- [FCOS: Fully Convolutional One-Stage Object Detection](https://mlsanity.com/paper/1904.01355/) (2019)
- [End-to-End Semi-Supervised Object Detection with Soft Teacher](https://mlsanity.com/paper/2106.09018/) (2021)
- [Unbiased Teacher for Semi-Supervised Object Detection](https://mlsanity.com/paper/2102.09480/) (2021)
- [Oriented R-CNN for Object Detection](https://mlsanity.com/paper/2108.05699/) (2021)
- [UnitBox: An Advanced Object Detection Network](https://mlsanity.com/paper/1608.01471/) (2016)
- [Object Detection in Aerial Images: A Large-Scale Benchmark and Challenges](https://mlsanity.com/paper/2102.12219/) (2021)
- [R3Det: Refined Single-Stage Detector with Feature Refinement for Rotating Object](https://mlsanity.com/paper/1908.05612/) (2019)
- [Align Deep Features for Oriented Object Detection](https://mlsanity.com/paper/2008.09397/) (2020)
- [Rethinking Rotated Object Detection with Gaussian Wasserstein Distance Loss](https://mlsanity.com/paper/2101.11952/) (2021)
- [MMRotate: A Rotated Object Detection Benchmark using PyTorch](https://mlsanity.com/paper/2204.13317/) (2022)
- [Scene Text Detection and Recognition: The Deep Learning Era](https://mlsanity.com/paper/1811.04256/) (2018)
- [Large Selective Kernel Network for Remote Sensing Object Detection](https://mlsanity.com/paper/2303.09030/) (2023)
- [PCL: Proposal Cluster Learning for Weakly Supervised Object Detection](https://mlsanity.com/paper/1807.03342/) (2018)
- [The KFIoU Loss for Rotated Object Detection](https://mlsanity.com/paper/2201.12558/) (2022)
- [Adaptive Rotated Convolution for Rotated Object Detection](https://mlsanity.com/paper/2303.07820/) (2023)
- [Dense Teacher: Dense Pseudo-Labels for Semi-supervised Object Detection](https://mlsanity.com/paper/2207.02541/) (2022)
- [Active Teacher for Semi-Supervised Object Detection](https://mlsanity.com/paper/2303.08348/) (2023)
- [H2RBox: Horizontal Box Annotation is All You Need for Oriented Object Detection](https://mlsanity.com/paper/2210.06742/) (2022)
- [Co-mining: Self-Supervised Learning for Sparsely Annotated Object Detection](https://mlsanity.com/paper/2012.01950/) (2020)
- [H2RBox-v2: Incorporating Symmetry for Boosting Horizontal Box Supervised Oriented Object Detection](https://mlsanity.com/paper/2304.04403/) (2023)
- [PointOBB: Learning Oriented Object Detection via Single Point Supervision](https://mlsanity.com/paper/2311.14757/) (2023)
- [Point2RBox: Combine Knowledge from Synthetic Visual Patterns for End-to-end Oriented Object Detection with Single Point Supervision](https://mlsanity.com/paper/2311.14758/) (2023)
- [Rethinking Boundary Discontinuity Problem for Oriented Object Detection](https://mlsanity.com/paper/2305.10061/) (2023)
- [PointOBB-v2: Towards Simpler, Faster, and Stronger Single Point Supervised Oriented Object Detection](https://mlsanity.com/paper/2410.08210/) (2024)
- [Knowledge Combination to Learn Rotated Detection Without Rotated Annotation](https://mlsanity.com/paper/2304.02199/) (2023)
- [Spatial Transform Decoupling for Oriented Object Detection](https://mlsanity.com/paper/2308.10561/) (2023)
- [SOOD++: Leveraging Unlabeled Data to Boost Oriented Object Detection](https://mlsanity.com/paper/2407.01016/) (2024)
- [Multi-clue Consistency Learning to Bridge Gaps Between General and Oriented Object in Semi-supervised Detection](https://mlsanity.com/paper/2407.05909/) (2024)
- [Calibrated Teacher for Sparsely Annotated Object Detection](https://mlsanity.com/paper/2303.07582/) (2023)
- [Theoretically Achieving Continuous Representation of Oriented Bounding Boxes](https://mlsanity.com/paper/2402.18975/) (2024)

## Abstract (arXiv)

Although fully-supervised oriented object detection has made significant progress in multimodal remote sensing image understanding, it comes at the cost of labor-intensive annotation. Recent studies have explored weakly and semi-supervised learning to alleviate this burden. However, these methods overlook the difficulties posed by dense annotations in complex remote sensing scenes. In this paper, we introduce a novel setting called sparsely annotated oriented object detection (SAOOD), which only labels partial instances, and propose a solution to address its challenges. Specifically, we focus on two key issues in the setting: (1) sparse labeling leading to overfitting on limited foreground representations, and (2) unlabeled objects (false negatives) confusing feature learning. To this end, we propose the S2Teacher, a novel method that progressively mines pseudo-labels for unlabeled objects, from easy to hard, to enhance foreground representations. Additionally, it reweights the loss of unlabeled objects to mitigate their impact during training. Extensive experiments demonstrate that S2Teacher not only significantly improves detector performance across different sparse annotation levels but also achieves near-fully-supervised performance on the DOTA dataset with only 10% annotation instances, effectively balancing detection accuracy with annotation efficiency. The code will be public.
