# Weakly Supervised Object Localization Using Things and Stuff Transfer

arXiv: https://arxiv.org/abs/1703.08000 · HTML: https://mlsanity.com/paper/1703.08000/

## Key facts

- Cited by 12 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 23 Mar 2017.

## Built on by (most cited first, 12 of 12)

- [Weakly Supervised Object Localization and Detection: A Survey](https://mlsanity.com/paper/2104.07918/) (2021)
- [Points as Queries: Weakly Semi-supervised Object Detection by Points](https://mlsanity.com/paper/2104.07434/) (2021)
- [Group R-CNN for Weakly Semi-supervised Object Detection with Points](https://mlsanity.com/paper/2205.05920/) (2022)
- [Mixed Supervised Object Detection by Transferring Mask Prior and Semantic Similarity](https://mlsanity.com/paper/2110.14191/) (2021)
- [Scaling Novel Object Detection with Weakly Supervised Detection Transformers](https://mlsanity.com/paper/2207.05205/) (2022)
- [Deep Learning for Weakly-Supervised Object Detection and Object Localization: A Survey](https://mlsanity.com/paper/2105.12694/) (2021)
- [RaSP: Relation-aware Semantic Prior for Weakly Supervised Incremental Segmentation](https://mlsanity.com/paper/2305.19879/) (2023)
- [CaT: Weakly Supervised Object Detection with Category Transfer](https://mlsanity.com/paper/2108.07487/) (2021)
- [Structured Generative Models for Scene Understanding](https://mlsanity.com/paper/2302.03531/) (2023)
- [Two-phase weakly supervised object detection with pseudo ground truth mining](https://mlsanity.com/paper/2104.00231/) (2021)
- [Guided Generative Models using Weak Supervision for Detecting Object Spatial Arrangement in Overhead Images](https://mlsanity.com/paper/2112.05786/) (2021)
- [HUWSOD: Holistic Self-training for Unified Weakly Supervised Object Detection](https://mlsanity.com/paper/2406.19394/) (2024)

## Abstract (arXiv)

We propose to help weakly supervised object localization for classes where location annotations are not available, by transferring things and stuff knowledge from a source set with available annotations. The source and target classes might share similar appearance (e.g. bear fur is similar to cat fur) or appear against similar background (e.g. horse and sheep appear against grass). To exploit this, we acquire three types of knowledge from the source set: a segmentation model trained on both thing and stuff classes; similarity relations between target and source classes; and co-occurrence relations between thing and stuff classes in the source. The segmentation model is used to generate thing and stuff segmentation maps on a target image, while the class similarity and co-occurrence knowledge help refining them. We then incorporate these maps as new cues into a multiple instance learning framework (MIL), propagating the transferred knowledge from the pixel level to the object proposal level. In extensive experiments, we conduct our transfer from the PASCAL Context dataset (source) to the ILSVRC, COCO and PASCAL VOC 2007 datasets (targets). We evaluate our transfer across widely different thing classes, including some that are not similar in appearance, but appear against similar background. The results demonstrate significant improvement over standard MIL, and we outperform the state-of-the-art in the transfer setting.
