Instance-aware, Context-focused, and Memory-efficient Weakly Supervised Object Detection
Not on the map. Why?
Abstract (arXiv)
Weakly supervised learning has emerged as a compelling tool for object detection by reducing the need for strong supervision during training. However, major challenges remain: (1) differentiation of object instances can be ambiguous; (2) detectors tend to focus on discriminative parts rather than entire objects; (3) without ground truth, object proposals have to be redundant for high recalls, causing significant memory consumption. Addressing these challenges is difficult, as it often requires to eliminate uncertainties and trivial solutions. To target these issues we develop an instance-aware and context-focused unified framework. It employs an instance-aware self-training algorithm and a learnable Concrete DropBlock while devising a memory-efficient sequential batch back-propagation. Our proposed method achieves state-of-the-art results on COCO (12.1% ~AP, 24.8% ~AP50), VOC 2007 (54.9% ~AP), and VOC 2012 (52.1% ~AP), improving baselines by great margins. In addition, the proposed method is the first to benchmark ResNet based models and weakly supervised video object detection. Code, models, and more details will be made available at: https://github.com/NVlabs/wetectron.
Key facts. Cited by 80 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 22; 2022: 25; 2023: 15; 2024: 11; 2025: 6; 2026: 1.
80 papers.
Sort:
By area:
- 2021Localizing Objects with Self-Supervised Transformers and no Labelscited by 227
- 2022Self-Supervised Transformers for Unsupervised Object Discovery using Normalized Cutcited by 166
- 2021TS-CAM: Token Semantic Coupled Attention Map for Weakly Supervised Object Localizationcited by 122
- 2022TokenCut: Segmenting Objects in Images and Videos with Self-supervised Transformer and Normalized Cutcited by 111
- 2021Weakly Supervised Object Localization and Detection: A Surveycited by 84
- 2021Exploring Simple 3D Multi-Object Tracking for Autonomous Drivingcited by 56
- 2021Refining Pseudo Labels with Clustering Consensus over Generations for Unsupervised Object Re-identificationcited by 45
- 2022ASM-Loc: Action-aware Segment Modeling for Weakly-Supervised Temporal Action Localizationcited by 39
- 2021Weakly Supervised Temporal Adjacent Network for Language Groundingcited by 37
- 20213D Spatial Recognition without Spatially Labeled 3Dcited by 31
- 2022Point-to-Box Network for Accurate Object Detection via Single Point Supervisioncited by 31
- 2021Self-supervised object detection from audio-visual correspondencecited by 29
38 more
- 2022DeepCut: Unsupervised Segmentation using Graph Neural Networks Clusteringcited by 25
- 2023Taming Self-Training for Open-Vocabulary Object Detectioncited by 25
- 2023Fine-grained Visual Classification with High-temperature Refinement and Background Suppressioncited by 22
- 2021Boosting Weakly Supervised Object Detection via Learning Bounding Box Adjusterscited by 20
- 2023What Can Human Sketches Do for Object Detection?cited by 19
- 2022Localized Vision-Language Matching for Open-vocabulary Object Detectioncited by 17
- 2022Active Learning Strategies for Weakly-supervised Object Detectioncited by 17
- 2022Object Discovery via Contrastive Learning for Weakly Supervised Object Detectioncited by 16
- 2023Mask-free OVIS: Open-Vocabulary Instance Segmentation without Manual Mask Annotationscited by 16
- 2021What data do we need for training an AV motion planner?cited by 15
- 2023Knowledge Combination to Learn Rotated Detection Without Rotated Annotationcited by 12
- 2021Mixed Supervised Object Detection by Transferring Mask Prior and Semantic Similaritycited by 11
- 2022A Novel Plug-in Module for Fine-Grained Visual Classificationcited by 11
- 2023Weakly Supervised Open-Vocabulary Object Detectioncited by 11
- 2022Point-Teaching: Weakly Semi-Supervised Object Detection with Point Annotationscited by 10
- 2024Computer Vision for Primate Behavior Analysis in the Wildcited by 10
- 2022W2N:Switching From Weak Supervision to Noisy Supervision for Object Detectioncited by 9
- 2023Spatial Self-Distillation for Object Detection with Inaccurate Bounding Boxescited by 9
- 2024WeakSAM: Segment Anything Meets Weakly-supervised Instance-level Recognitioncited by 9
- 2021Salvage of Supervision in Weakly Supervised Object Detectioncited by 8
- 2022Recent Few-Shot Object Detection Algorithms: A Survey with Performance Comparisoncited by 8
- 2023ALWOD: Active Learning for Weakly-Supervised Object Detectioncited by 8
- 2022Scaling Novel Object Detection with Weakly Supervised Detection Transformerscited by 7
- 2022Self-Supervised Visual Representation Learning via Residual Momentumcited by 7
- 2025Rethinking Pseudo-Label Guided Learning for Weakly Supervised Temporal Action Localization from the Perspective of Noise Correctioncited by 7
- 2021Deep Learning for Weakly-Supervised Object Detection and Object Localization: A Surveycited by 6
- 20223DMODT: Attention-Guided Affinities for Joint Detection & Tracking in 3D Point Cloudscited by 6
- 2024Complete Instances Mining for Weakly Supervised Instance Segmentationcited by 5
- 2024Weakly Supervised Object Detection in Chest X-Rays with Differentiable ROI Proposal Networks and Soft ROI Poolingcited by 5
- 2021CaT: Weakly Supervised Object Detection with Category Transfercited by 4
- 2022Absolute Wrong Makes Better: Boosting Weakly Supervised Object Detection via Negative Deterministic Informationcited by 4
- 2022EM-Paste: EM-guided Cut-Paste with DALL-E Augmentation for Image-level Weakly Supervised Instance Segmentationcited by 4
- 2023Boosting Weakly Supervised Object Detection using Fusion and Priors from Hallucinated Depthcited by 4
- 2023Meta-tuning Loss Functions and Data Augmentation for Few-shot Object Detectioncited by 4
- 2023Cyclic-Bootstrap Labeling for Weakly Supervised Object Detectioncited by 4
- 2021OVIS: Open-Vocabulary Visual Instance Search via Visual-Semantic Aligned Representation Learningcited by 3
- 20223rd Continual Learning Workshop Challenge on Egocentric Category and Instance Level Object Understandingcited by 3
- 2024Towards Two-Stream Foveation-based Active Vision Learningcited by 3
50 most cited of 80 All 80 (JSON)
- 2026WS-IMUBench: Can Weakly Supervised Methods from Audio, Image, and Video Be Adapted for IMU-based Temporal Action Localization?2 Feb 2026
- 2025State and Scene Enhanced Prototypes for Weakly Supervised Open-Vocabulary Object Detection22 Nov 2025
- 2025Dual-Thresholded Heatmap-Guided Proposal Clustering and Negative Certainty Supervision with Enhanced Base Network for Weakly Supervised Object Detection10 Sep 2025
- 2025Weakly Supervised Virus Capsid Detection with Image-Level Annotations in Electron Microscopy Images1 Aug 2025
- 2025Self-Classification Enhancement and Correction for Weakly Supervised Object Detection22 May 2025
- 2025P2Object: Single Point Supervised Object Detection and Instance Segmentation10 Apr 2025
- 2025Rethinking Pseudo-Label Guided Learning for Weakly Supervised Temporal Action Localization from the Perspective of Noise Correction19 Jan 2025
- 2024Endangered Alert: A Field-Validated Self-Training Scheme for Detecting and Protecting Threatened Wildlife on Roads and Roadsides16 Dec 2024
- 2024No Annotations for Object Detection in Art through Stable Diffusion9 Dec 2024
- 2024Enhancing Weakly-Supervised Object Detection on Static Images through (Hallucinated) Motion15 Sep 2024
- 2024HUWSOD: Holistic Self-training for Unified Weakly Supervised Object Detection27 Jun 2024
- 2024Negative Prototypes Guided Contrastive Learning for WSOD4 Jun 2024
38 more
- 2024Predicting Perceived Gloss: Do Weak Labels Suffice?26 Mar 2024
- 2024Towards Two-Stream Foveation-based Active Vision Learning24 Mar 2024
- 2024WeakSAM: Segment Anything Meets Weakly-supervised Instance-level Recognition22 Feb 2024
- 2024Weakly Supervised Object Detection in Chest X-Rays with Differentiable ROI Proposal Networks and Soft ROI Pooling19 Feb 2024
- 2024Complete Instances Mining for Weakly Supervised Instance Segmentation12 Feb 2024
- 2024Computer Vision for Primate Behavior Analysis in the Wild29 Jan 2024
- 2023Weakly Supervised Open-Vocabulary Object Detection19 Dec 2023
- 2023ALWOD: Active Learning for Weakly-Supervised Object Detection14 Sep 2023
- 2023Taming Self-Training for Open-Vocabulary Object Detection11 Aug 2023
- 2023Cyclic-Bootstrap Labeling for Weakly Supervised Object Detection11 Aug 2023
- 2023Spatial Self-Distillation for Object Detection with Inaccurate Bounding Boxes22 Jul 2023
- 2023Read, look and detect: Bounding box annotation from image-caption pairs9 Jun 2023
- 2023Towards Precise Weakly Supervised Object Detection via Interactive Contrastive Learning of Context Information27 Apr 2023
- 2023Meta-tuning Loss Functions and Data Augmentation for Few-shot Object Detection24 Apr 2023
- 2023Knowledge Combination to Learn Rotated Detection Without Rotated Annotation5 Apr 2023
- 2023Mask-free OVIS: Open-Vocabulary Instance Segmentation without Manual Mask Annotations29 Mar 2023
- 2023What Can Human Sketches Do for Object Detection?27 Mar 2023
- 2023Transformer-based Multi-Instance Learning for Weakly Supervised Object Detection27 Mar 2023
- 2023Boosting Weakly Supervised Object Detection using Fusion and Priors from Hallucinated Depth20 Mar 2023
- 2023VEIL: Vetting Extracted Image Labels from In-the-Wild Captions for Weakly-Supervised Object Detection16 Mar 2023
- 2023Fine-grained Visual Classification with High-temperature Refinement and Background Suppression11 Mar 2023
- 2022EM-Paste: EM-guided Cut-Paste with DALL-E Augmentation for Image-level Weakly Supervised Instance Segmentation15 Dec 2022
- 20223rd Continual Learning Workshop Challenge on Egocentric Category and Instance Level Object Understanding13 Dec 2022
- 2022DeepCut: Unsupervised Segmentation using Graph Neural Networks Clustering12 Dec 2022
- 2022D2DF2WOD: Learning Object Proposals for Weakly-Supervised Object Detection via Progressive Domain Adaptation2 Dec 2022
- 2022Self-Supervised Visual Representation Learning via Residual Momentum17 Nov 2022
- 20223DMODT: Attention-Guided Affinities for Joint Detection & Tracking in 3D Point Clouds1 Nov 2022
- 2022Robust Object Detection in Remote Sensing Imagery with Noisy and Sparse Geo-Annotations (Full Version)24 Oct 2022
- 2022Improving Long-tailed Object Detection with Image-Level Supervision by Multi-Task Collaborative Learning11 Oct 2022
- 2022ComplETR: Reducing the cost of annotations for object detection in dense scenes with vision transformers13 Sep 2022
- 2022TokenCut: Segmenting Objects in Images and Videos with Self-supervised Transformer and Normalized Cut1 Sep 2022
- 2022Object Discovery via Contrastive Learning for Weakly Supervised Object Detection16 Aug 2022
- 2022Active Learning Strategies for Weakly-supervised Object Detection25 Jul 2022
- 2022W2N:Switching From Weak Supervision to Noisy Supervision for Object Detection25 Jul 2022
- 2022Point-to-Box Network for Accurate Object Detection via Single Point Supervision14 Jul 2022
- 2022Scaling Novel Object Detection with Weakly Supervised Detection Transformers11 Jul 2022
- 2022Online progressive instance-balanced sampling for weakly supervised object detection21 Jun 2022
- 2022Point-Teaching: Weakly Semi-Supervised Object Detection with Point Annotations1 Jun 2022
50 newest of 80 All 80 (JSON)
- 2023Taming Self-Training for Open-Vocabulary Object Detectioncited by 25
- 2023Taming Self-Training for Open-Vocabulary Object Detection11 Aug 2023
- 2021Localizing Objects with Self-Supervised Transformers and no Labelscited by 227
- 2022Self-Supervised Transformers for Unsupervised Object Discovery using Normalized Cutcited by 166
- 2021TS-CAM: Token Semantic Coupled Attention Map for Weakly Supervised Object Localizationcited by 122
- 2022TokenCut: Segmenting Objects in Images and Videos with Self-supervised Transformer and Normalized Cutcited by 111
- 2021Weakly Supervised Object Localization and Detection: A Surveycited by 84
- 2021Exploring Simple 3D Multi-Object Tracking for Autonomous Drivingcited by 56
- 2021Refining Pseudo Labels with Clustering Consensus over Generations for Unsupervised Object Re-identificationcited by 45
- 2022ASM-Loc: Action-aware Segment Modeling for Weakly-Supervised Temporal Action Localizationcited by 39
- 2021Weakly Supervised Temporal Adjacent Network for Language Groundingcited by 37
- 20213D Spatial Recognition without Spatially Labeled 3Dcited by 31
- 2022Point-to-Box Network for Accurate Object Detection via Single Point Supervisioncited by 31
- 2021Self-supervised object detection from audio-visual correspondencecited by 29
12 most cited of 77 All 77 (JSON)
- 2026WS-IMUBench: Can Weakly Supervised Methods from Audio, Image, and Video Be Adapted for IMU-based Temporal Action Localization?2 Feb 2026
- 2025State and Scene Enhanced Prototypes for Weakly Supervised Open-Vocabulary Object Detection22 Nov 2025
- 2025Dual-Thresholded Heatmap-Guided Proposal Clustering and Negative Certainty Supervision with Enhanced Base Network for Weakly Supervised Object Detection10 Sep 2025
- 2025Weakly Supervised Virus Capsid Detection with Image-Level Annotations in Electron Microscopy Images1 Aug 2025
- 2025Self-Classification Enhancement and Correction for Weakly Supervised Object Detection22 May 2025
- 2025P2Object: Single Point Supervised Object Detection and Instance Segmentation10 Apr 2025
- 2025Rethinking Pseudo-Label Guided Learning for Weakly Supervised Temporal Action Localization from the Perspective of Noise Correction19 Jan 2025
- 2024Endangered Alert: A Field-Validated Self-Training Scheme for Detecting and Protecting Threatened Wildlife on Roads and Roadsides16 Dec 2024
- 2024Enhancing Weakly-Supervised Object Detection on Static Images through (Hallucinated) Motion15 Sep 2024
- 2024HUWSOD: Holistic Self-training for Unified Weakly Supervised Object Detection27 Jun 2024
- 2024Negative Prototypes Guided Contrastive Learning for WSOD4 Jun 2024
- 2024Predicting Perceived Gloss: Do Weak Labels Suffice?26 Mar 2024
12 newest of 77 All 77 (JSON)