# Negative Prototypes Guided Contrastive Learning for WSOD

arXiv: https://arxiv.org/abs/2406.18576 · HTML: https://mlsanity.com/paper/2406.18576/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 31 of its 41 references that are in the map.
- First posted on arXiv 4 Jun 2024.

## Builds on (most cited first, 30 of 31)

- [Very Deep Convolutional Networks for Large-Scale Image Recognition](https://mlsanity.com/paper/1409.1556/) (2014)
- [A Simple Framework for Contrastive Learning of Visual Representations](https://mlsanity.com/paper/2002.05709/) (2020)
- [Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks](https://mlsanity.com/paper/1506.01497/) (2015)
- [Representation Learning with Contrastive Predictive Coding](https://mlsanity.com/paper/1807.03748/) (2018)
- [Momentum Contrast for Unsupervised Visual Representation Learning](https://mlsanity.com/paper/1911.05722/) (2019)
- [Fast R-CNN](https://mlsanity.com/paper/1504.08083/) (2015)
- [Supervised Contrastive Learning](https://mlsanity.com/paper/2004.11362/) (2020)
- [Rich feature hierarchies for accurate object detection and semantic segmentation](https://mlsanity.com/paper/1311.2524/) (2013)
- [Contrastive Multiview Coding](https://mlsanity.com/paper/1906.05849/) (2019)
- [Learning deep representations by mutual information estimation and maximization](https://mlsanity.com/paper/1808.06670/) (2018)
- [Simple Copy-Paste is a Strong Data Augmentation Method for Instance Segmentation](https://mlsanity.com/paper/2012.07177/) (2020)
- [Weakly Supervised Deep Detection Networks](https://mlsanity.com/paper/1511.02853/) (2015)
- [TS-CAM: Token Semantic Coupled Attention Map for Weakly Supervised Object Localization](https://mlsanity.com/paper/2103.14862/) (2021)
- [Multiple Instance Detection Network with Online Instance Classifier Refinement](https://mlsanity.com/paper/1704.00138/) (2017)
- [PCL: Proposal Cluster Learning for Weakly Supervised Object Detection](https://mlsanity.com/paper/1807.03342/) (2018)
- [Instance-aware, Context-focused, and Memory-efficient Weakly Supervised Object Detection](https://mlsanity.com/paper/2004.04725/) (2020)
- [C-MIL: Continuation Multiple Instance Learning for Weakly Supervised Object Detection](https://mlsanity.com/paper/1904.05647/) (2019)
- [WSOD^2: Learning Bottom-up and Top-down Objectness Distillation for Weakly-supervised Object Detection](https://mlsanity.com/paper/1909.04972/) (2019)
- [Min-Entropy Latent Model for Weakly Supervised Object Detection](https://mlsanity.com/paper/1902.06057/) (2019)
- [Towards Precise End-to-end Weakly Supervised Object Detection Network](https://mlsanity.com/paper/1911.12148/) (2019)
- [ContextLocNet: Context-Aware Deep Network Models for Weakly Supervised Localization](https://mlsanity.com/paper/1609.04331/) (2016)
- [SLV: Spatial Likelihood Voting for Weakly Supervised Object Detection](https://mlsanity.com/paper/2006.12884/) (2020)
- [Boosting Weakly Supervised Object Detection with Progressive Knowledge Transfer](https://mlsanity.com/paper/2007.07986/) (2020)
- [C-WSL: Count-guided Weakly Supervised Localization](https://mlsanity.com/paper/1711.05282/) (2017)
- [Boosting Weakly Supervised Object Detection via Learning Bounding Box Adjusters](https://mlsanity.com/paper/2108.01499/) (2021)
- [Object Discovery via Contrastive Learning for Weakly Supervised Object Detection](https://mlsanity.com/paper/2208.07576/) (2022)
- [Object-Aware Instance Labeling for Weakly Supervised Object Detection](https://mlsanity.com/paper/1908.03792/) (2019)
- [Salvage of Supervision in Weakly Supervised Object Detection](https://mlsanity.com/paper/2106.04073/) (2021)
- [Improving Object Detection with Inverted Attention](https://mlsanity.com/paper/1903.12255/) (2019)
- [Absolute Wrong Makes Better: Boosting Weakly Supervised Object Detection via Negative Deterministic Information](https://mlsanity.com/paper/2204.10068/) (2022)

## Abstract (arXiv)

Weakly Supervised Object Detection (WSOD) with only image-level annotation has recently attracted wide attention. Many existing methods ignore the inter-image relationship of instances which share similar characteristics while can certainly be determined not to belong to the same category. Therefore, in order to make full use of the weak label, we propose the Negative Prototypes Guided Contrastive learning (NPGC) architecture. Firstly, we define Negative Prototype as the proposal with the highest confidence score misclassified for the category that does not appear in the label. Unlike other methods that only utilize category positive feature, we construct an online updated global feature bank to store both positive prototypes and negative prototypes. Meanwhile, we propose a pseudo label sampling module to mine reliable instances and discard the easily misclassified instances based on the feature similarity with corresponding prototypes in global feature bank. Finally, we follow the contrastive learning paradigm to optimize the proposal's feature representation by attracting same class samples closer and pushing different class samples away in the embedding space. Extensive experiments have been conducted on VOC07, VOC12 datasets, which shows that our proposed method achieves the state-of-the-art performance.