Hide-and-Seek: Forcing a Network to be Meticulous for Weakly-supervised Object and Action Localization
Not on the map. Why?
Abstract (arXiv)
We propose `Hide-and-Seek', a weakly-supervised framework that aims to improve object localization in images and action localization in videos. Most existing weakly-supervised methods localize only the most discriminative parts of an object rather than all relevant parts, which leads to suboptimal performance. Our key idea is to hide patches in a training image randomly, forcing the network to seek other relevant parts when the most discriminative part is hidden. Our approach only needs to modify the input image and can work with any network designed for object localization. During testing, we do not need to hide any patches. Our Hide-and-Seek approach obtains superior performance compared to previous methods for weakly-supervised object localization on the ILSVRC dataset. We also demonstrate that our framework can be easily extended to weakly-supervised action localization.
Key facts. Cited by 207 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 Apr 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 64; 2022: 54; 2023: 35; 2024: 29; 2025: 17; 2026: 8.
207 papers.
Sort:
By area:
- 2021BANMo: Building Animatable 3D Neural Models from Many Casual Videoscited by 195
- 2022Self-Supervised Transformers for Unsupervised Object Discovery using Normalized Cutcited by 166
- 2022Masked Discrimination for Self-Supervised Learning on Point Cloudscited by 155
- 2022Multi-class Token Transformer for Weakly Supervised Semantic Segmentationcited by 138
- 2021Anti-Adversarially Manipulated Attributions for Weakly and Semi-Supervised Semantic Segmentationcited by 134
- 2021TS-CAM: Token Semantic Coupled Attention Map for Weakly Supervised Object Localizationcited by 122
- 2021UniTAB: Unifying Text and Box Outputs for Grounded Vision-Language Modelingcited by 122
- 2021Large-scale Unsupervised Semantic Segmentationcited by 98
- 2022A Comprehensive Survey of Image Augmentation Techniques for Deep Learningcited by 95
- 2022Weakly-Supervised Multi-Granularity Map Learning for Vision-and-Language Navigationcited by 86
- 2021Weakly Supervised Object Localization and Detection: A Surveycited by 84
- 2022Learning Affordance Grounding from Exocentric Imagescited by 82
38 more
- 2021Complementary Patch for Weakly Supervised Semantic Segmentationcited by 75
- 2022A Closer Look at Weakly-Supervised Audio-Visual Source Localizationcited by 72
- 2021CoLA: Weakly-Supervised Temporal Action Localization with Snippet Contrastive Learningcited by 69
- 2021Improving Deep Learning Interpretability by Saliency Guided Trainingcited by 68
- 2022Regional Semantic Contrast and Aggregation for Weakly Supervised Semantic Segmentationcited by 64
- 2021Regularization Strategy for Point Cloud via Rigidly Mixed Samplecited by 59
- 2023Segment Anything Model (SAM) Enhanced Pseudo Labels for Weakly Supervised Semantic Segmentationcited by 53
- 2022Correlation Verification for Image Retrievalcited by 47
- 2021Unveiling the Potential of Structure Preserving for Weakly Supervised Object Localizationcited by 46
- 2021A Hybrid Attention Mechanism for Weakly-Supervised Temporal Action Localizationcited by 45
- 2021Learning Action Completeness from Points for Weakly-supervised Temporal Action Localizationcited by 42
- 2022Max Pooling with Vision Transformers reconciles class and shape in weakly supervised semantic segmentationcited by 41
- 2022ASM-Loc: Action-aware Segment Modeling for Weakly-Supervised Temporal Action Localizationcited by 39
- 2024A Comprehensive Survey on Data Augmentationcited by 38
- 2021Weakly Supervised Temporal Adjacent Network for Language Groundingcited by 37
- 2022Expansion and Shrinkage of Localization for Weakly-Supervised Semantic Segmentationcited by 37
- 2021Shallow Feature Matters for Weakly Supervised Object Localizationcited by 34
- 2021SQUID: Deep Feature In-Painting for Unsupervised Anomaly Detectioncited by 34
- 2022Fine-grained Temporal Contrastive Learning for Weakly-supervised Temporal Action Localizationcited by 33
- 2021Deep Learning-based Action Detection in Untrimmed Videos: A Surveycited by 32
- 2021Online Refinement of Low-level Feature Based Activation Map for Weakly Supervised Object Localizationcited by 30
- 2023CUDA: Curriculum of Data Augmentation for Long-Tailed Recognitioncited by 30
- 2021Self-supervised object detection from audio-visual correspondencecited by 29
- 2021Activation Modulation and Recalibration Scheme for Weakly Supervised Semantic Segmentationcited by 29
- 2021Action Unit Memory Network for Weakly Supervised Temporal Action Localizationcited by 26
- 2021Foreground-Action Consistency Network for Weakly Supervised Temporal Action Localizationcited by 26
- 2021F-CAM: Full Resolution Class Activation Maps via Guided Parametric Upscalingcited by 26
- 2022Out-of-Candidate Rectification for Weakly Supervised Semantic Segmentationcited by 26
- 2021Survey: Image Mixing and Deleting for Data Augmentationcited by 25
- 2022Bridging the Gap between Classification and Localization for Weakly Supervised Object Localizationcited by 25
- 2021LCTR: On Awakening the Local Continuity of Transformer for Weakly Supervised Object Localizationcited by 24
- 2021Learning Representational Invariances for Data-Efficient Action Recognitioncited by 22
- 2021Background Activation Suppression for Weakly Supervised Object Localizationcited by 22
- 2023MCTformer+: Multi-Class Token Transformer for Weakly Supervised Semantic Segmentationcited by 22
- 2021Weakly Supervised Action Selection Learning in Videocited by 21
- 2021Improving Pneumonia Localization via Cross-Attention on Medical Images and Reportscited by 21
- 2022Model-Agnostic Augmentation for Accurate Graph Classificationcited by 21
- 2022CREAM: Weakly Supervised Object Localization via Class RE-Activation Mappingcited by 21
50 most cited of 207 All 207 (JSON)
- 2026Domain shift-robust object detection with GenAI image editing2 Sep 2026
- 2026Multi-Modal Anomaly Detection: A Survey24 Aug 2026
- 2026Class Activation Mapping in Explainable Computer Vision: A Method-Centered Review of CNN, Transformer, and Foundation-Model-Era Visual Explanations12 Aug 2026
- 2026Dual-Prompt CLIP with Hybrid Visual Encoders for Occluded Person Re-Identification19 May 2026
- 2026CAMAL: Improving Attention Alignment and Faithfulness with Segmentation Masks8 May 2026
- 2026OASIC: Occlusion-Agnostic and Severity-Informed Classification5 Apr 2026
- 2026Learning from Synthetic Data via Provenance-Based Input Gradient Guidance3 Apr 2026
- 2026TriLite: Efficient Weakly Supervised Object Localization with Universal Visual Features and Tri-Region Disentanglement26 Feb 2026
- 2025MaskAnyNet: Rethinking Masked Image Regions as Valuable Information in Supervised Learning16 Nov 2025
- 2025Beyond Softmax: Dual-Branch Sigmoid Architecture for Accurate Class Activation Maps5 Nov 2025
- 2025Region-CAM: Towards Accurate Object Regions in Class Activation Maps for Weakly Supervised Learning Tasks29 Oct 2025
- 2025On-the-Fly Data Augmentation via Gradient-Guided and Sample-Aware Influence Estimation1 Oct 2025
38 more
- 2025IPF-RDA: An Information-Preserving Framework for Robust Data Augmentation20 Sep 2025
- 2025SAM-TTT: Segment Anything Model via Reverse Parameter Configuration and Test-Time Training for Camouflaged Object Detection15 Sep 2025
- 2025Selective Contrastive Learning for Weakly Supervised Affordance Grounding11 Aug 2025
- 2025Weakly Supervised Virus Capsid Detection with Image-Level Annotations in Electron Microscopy Images1 Aug 2025
- 2025Weakly Supervised Object Segmentation by Background Conditional Divergence25 Jun 2025
- 2025A Flat Minima Perspective on Understanding Augmentations and Model Robustness30 May 2025
- 2025Relevance-driven Input Dropout: an Explanation-guided Regularization Technique27 May 2025
- 2025Intra-class Patch Swap for Self-Distillation20 May 2025
- 2025When Dynamic Data Selection Meets Data Augmentation2 May 2025
- 2025Resilience of Vision Transformers for Domain Generalisation in the Presence of Out-of-Distribution Noisy Images5 Apr 2025
- 2025BackMix: Regularizing Open Set Recognition by Removing Underlying Fore-Background Priors22 Mar 2025
- 2025DOEI: Dual Optimization of Embedding Information for Attention-Enhanced Class Activation Maps21 Feb 2025
- 2025TeD-Loc: Text Distillation for Weakly Supervised Object Localization22 Jan 2025
- 2024Action-Agnostic Point-Level Supervision for Temporal Action Detection30 Dec 2024
- 2024FaceSaliencyAug: Mitigating Geographic, Gender and Stereotypical Biases via Saliency-Based Data Augmentation17 Oct 2024
- 2024MaskBlur: Spatial and Angular Data Augmentation for Light Field Image Super-Resolution9 Oct 2024
- 2024ShapeAug++: More Realistic Shape Augmentation for Event Data17 Sep 2024
- 2024EntAugment: Entropy-Driven Adaptive Data Augmentation Framework for Image Classification10 Sep 2024
- 2024Handling Geometric Domain Shifts in Semantic Segmentation of Surgical RGB and Hyperspectral Images27 Aug 2024
- 2024DePatch: Towards Robust Adversarial Patch for Evading Person Detectors in the Real World13 Aug 2024
- 2024VACoDe: Visual Augmented Contrastive Decoding26 Jul 2024
- 2024Disentangling spatio-temporal knowledge for weakly supervised object detection and segmentation in surgical video22 Jul 2024
- 2024Adaptive Patch Contrast for Weakly Supervised Semantic Segmentation15 Jul 2024
- 2024Leveraging Transformers for Weakly Supervised Object Localization in Unconstrained Videos8 Jul 2024
- 2024ReceiptSense: Beyond Traditional OCR -- A Dataset for Receipt Understanding6 Jun 2024
- 2024Competing for pixels: a self-play algorithm for weakly-supervised segmentation26 May 2024
- 2024Concept Visualization: Explaining the CLIP Multi-modal Embedding Using WordNet23 May 2024
- 2024AdaAugment: A Tuning-Free and Adaptive Approach to Enhance Data Augmentation19 May 2024
- 2024A Comprehensive Survey on Data Augmentation15 May 2024
- 2024Enhancing Weakly Supervised Semantic Segmentation with Multi-modal Foundation Models: An End-to-End Approach10 May 2024
- 2024KeepOriginalAugment: Single Image-based Better Information-Preserving Data Augmentation Approach10 May 2024
- 2024Source-Free Domain Adaptation of Weakly-Supervised Object Localization Models for Histology29 Apr 2024
- 2024STAT: Towards Generalizable Temporal Action Localization20 Apr 2024
- 2024A Realistic Protocol for Evaluation of Weakly Supervised Object Localization15 Apr 2024
- 2024Improving Weakly-Supervised Object Localization Using Adversarial Erasing and Pseudo Label15 Apr 2024
- 2024Guided Masked Self-Distillation Modeling for Distributed Multimedia Sensor Event Analysis12 Apr 2024
- 2024Background Noise Reduction of Attention Map for Weakly Supervised Semantic Segmentation4 Apr 2024
- 2024Exploiting Structural Consistency of Chest Anatomy for Unsupervised Anomaly Detection in Radiography Images13 Mar 2024
50 newest of 207 All 207 (JSON)
- 2021BANMo: Building Animatable 3D Neural Models from Many Casual Videoscited by 195
- 2022Self-Supervised Transformers for Unsupervised Object Discovery using Normalized Cutcited by 166
- 2022Masked Discrimination for Self-Supervised Learning on Point Cloudscited by 155
- 2022Multi-class Token Transformer for Weakly Supervised Semantic Segmentationcited by 138
- 2021Anti-Adversarially Manipulated Attributions for Weakly and Semi-Supervised Semantic Segmentationcited by 134
- 2021TS-CAM: Token Semantic Coupled Attention Map for Weakly Supervised Object Localizationcited by 122
- 2021Large-scale Unsupervised Semantic Segmentationcited by 98
- 2022A Comprehensive Survey of Image Augmentation Techniques for Deep Learningcited by 95
- 2022Weakly-Supervised Multi-Granularity Map Learning for Vision-and-Language Navigationcited by 86
- 2021Weakly Supervised Object Localization and Detection: A Surveycited by 84
- 2022Learning Affordance Grounding from Exocentric Imagescited by 82
- 2021Complementary Patch for Weakly Supervised Semantic Segmentationcited by 75
12 most cited of 204 All 204 (JSON)
- 2026Domain shift-robust object detection with GenAI image editing2 Sep 2026
- 2026Multi-Modal Anomaly Detection: A Survey24 Aug 2026
- 2026Class Activation Mapping in Explainable Computer Vision: A Method-Centered Review of CNN, Transformer, and Foundation-Model-Era Visual Explanations12 Aug 2026
- 2026Dual-Prompt CLIP with Hybrid Visual Encoders for Occluded Person Re-Identification19 May 2026
- 2026CAMAL: Improving Attention Alignment and Faithfulness with Segmentation Masks8 May 2026
- 2026OASIC: Occlusion-Agnostic and Severity-Informed Classification5 Apr 2026
- 2026Learning from Synthetic Data via Provenance-Based Input Gradient Guidance3 Apr 2026
- 2026TriLite: Efficient Weakly Supervised Object Localization with Universal Visual Features and Tri-Region Disentanglement26 Feb 2026
- 2025MaskAnyNet: Rethinking Masked Image Regions as Valuable Information in Supervised Learning16 Nov 2025
- 2025Beyond Softmax: Dual-Branch Sigmoid Architecture for Accurate Class Activation Maps5 Nov 2025
- 2025Region-CAM: Towards Accurate Object Regions in Class Activation Maps for Weakly Supervised Learning Tasks29 Oct 2025
- 2025On-the-Fly Data Augmentation via Gradient-Guided and Sample-Aware Influence Estimation1 Oct 2025
12 newest of 204 All 204 (JSON)