Webly Supervised Learning of Convolutional Networks
Not on the map. Why?
Abstract (arXiv)
We present an approach to utilize large amounts of web data for learning CNNs. Specifically inspired by curriculum learning, we present a two-step approach for CNN training. First, we use easy images to train an initial visual representation. We then use this initial CNN and adapt it to harder, more realistic images by leveraging the structure of data and categories. We demonstrate that our two-stage CNN outperforms a fine-tuned CNN trained on ImageNet on Pascal VOC 2012. We also demonstrate the strength of webly supervised learning by localizing objects in web images and training a R-CNN style detector. It achieves the best performance on VOC 2007 where no VOC training data is used. Finally, we show our approach is quite robust to noise and performs comparably even when we use image search results from March 2013 (pre-CNN image search era).
Key facts. Cited by 95 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 May 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2017: 1; 2018: 0; 2019: 0; 2020: 0; 2021: 24; 2022: 22; 2023: 26; 2024: 14; 2025: 6; 2026: 2.
95 papers.
Sort:
By area:
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021Generalized Out-of-Distribution Detection: A Surveycited by 796
- 2021RegionCLIP: Region-based Language-Image Pretrainingcited by 612
- 2021Curriculum Learning: A Surveycited by 257
- 2022F-VLM: Open-Vocabulary Object Detection upon Frozen Vision and Language Modelscited by 149
- 2022Robust Training under Label Noise by Over-parameterizationcited by 93
- 2023Region-Aware Pretraining for Open-Vocabulary Object Detection with Vision Transformerscited by 91
- 2021Weakly Supervised Object Localization and Detection: A Surveycited by 84
- 2021RECALL: Replay-based Continual Learning in Semantic Segmentationcited by 83
- 2017Hard Mixtures of Experts for Large Scale Weakly Supervised Visioncited by 67
- 2021Learning to Generate Scene Graph from Natural Language Supervisioncited by 64
- 2021Open-set Label Noise Can Improve Robustness Against Inherent Label Noisecited by 58
38 more
- 2021Sample Selection for Fair and Robust Trainingcited by 48
- 2022Webly Supervised Concept Expansion for General Purpose Vision Modelscited by 45
- 2022EfficientTrain: Exploring Generalized Curriculum Learning for Training Visual Backbonescited by 42
- 2021Contrastive Learning Improves Model Robustness Under Label Noisecited by 36
- 2021Webly Supervised Fine-Grained Recognition: Benchmark Datasets and An Approachcited by 32
- 2023Contrastive Feature Masking Open-Vocabulary Vision Transformercited by 31
- 2021An Image is Worth More Than a Thousand Words: Towards Disentanglement in the Wildcited by 30
- 2021WEDGE: Web-Image Assisted Domain Generalization for Semantic Segmentationcited by 25
- 2022No Token Left Behind: Explainability-Aided Image Classification and Generationcited by 25
- 2022Noise-aware Learning from Web-crawled Image-Text Data for Image Captioningcited by 22
- 2023Provable Advantage of Curriculum Learning on Parity Targets with Mixed Inputscited by 22
- 2023Internet Explorer: Targeted Representation Learning on the Open Webcited by 21
- 2023CL-MAE: Curriculum-Learned Masked Autoencoderscited by 21
- 2022FUN-SIS: a Fully UNsupervised approach for Surgical Instrument Segmentationcited by 20
- 2022Identifying Hard Noise in Long-Tailed Sample Distributioncited by 19
- 2023SILT: Shadow-aware Iterative Label Tuning for Learning to Detect Shadows from Noisy Labelscited by 19
- 2023Domain Generalization via Balancing Training Difficulty and Model Capabilitycited by 19
- 2021Two Wrongs Don't Make a Right: Combating Confirmation Bias in Learning with Label Noisecited by 18
- 2023GeoNet: Benchmarking Unsupervised Adaptation across Geographiescited by 17
- 2022SelfD: Self-Learning Large-Scale Driving Policies From the Webcited by 16
- 2023RECLIP: Resource-efficient CLIP by Training with Small Imagescited by 16
- 2024EfficientTrain++: Generalized Curriculum Learning for Efficient Visual Backbone Trainingcited by 16
- 2022Scalable Penalized Regression for Noise Detection in Learning with Noisy Labelscited by 15
- 2021Searching for Robustness: Loss Learning for Noisy Classification Taskscited by 13
- 2024Intent-based Prompt Calibration: Enhancing prompt optimization with synthetic boundary casescited by 13
- 2021Learning to Rectify for Robust Learning with Noisy Labelscited by 12
- 2023Coreset Sampling from Open-Set for Fine-Grained Self-Supervised Learningcited by 12
- 2023SYNAuG: Exploiting Synthetic Data for Data Imbalance Problemscited by 12
- 2021EfficientCLIP: Efficient Cross-Modal Pre-training by Ensemble Confident Learning and Language Modelingcited by 10
- 2022Learning Rate Curriculumcited by 9
- 2022Learning to Learn: How to Continuously Teach Humans and Machinescited by 9
- 2022Learning from Training Dynamics: Identifying Mislabeled Data Beyond Manually Designed Featurescited by 9
- 2024Noisy Label Processing for Classification: A Surveycited by 8
- 2024Learning Discriminative Dynamics with Label Corruption for Noisy Label Detectioncited by 8
- 2023Reverse Stable Diffusion: What prompt was used to generate this image?cited by 7
- 2021Truth Discovery in Sequence Labels from Crowdscited by 6
- 2023Stochastic Re-weighted Gradient Descent via Distributionally Robust Optimizationcited by 6
- 2023Digital Twin-based Anomaly Detection with Curriculum Learning in Cyber-physical Systemscited by 6
50 most cited of 95 All 95 (JSON)
- 2026Webly Supervised Multi-Label Recognition: Evaluation Benchmark and Dual-Branch Multi-Label Contrastive Learning23 Jul 2026
- 2026Can LLMs Learn to Reason Robustly under Noisy Supervision?5 Apr 2026
- 2025Weak-to-Strong Generalization under Distribution Shifts24 Oct 2025
- 2025Curriculum Multi-Task Self-Supervision Improves Lightweight Architectures for Onboard Satellite Hyperspectral Image Segmentation16 Sep 2025
- 2025Sanitizing Manufacturing Dataset Labels Using Vision-Language Models30 Jun 2025
- 2025MoMBS: Mixed-order minibatch sampling enhances model training from diverse-quality images24 May 2025
- 2025Active Learning with a Noisy Annotator6 Apr 2025
- 2025When Preferences Diverge: Aligning Diffusion Models with Minority-Aware Adaptive DPO21 Mar 2025
- 2024Self-Paced Learning Strategy with Easy Sample Prior Based on Confidence for the Flying Bird Object Detection Model Training9 Dec 2024
- 2024TPCL: Task Progressive Curriculum Learning for Robust Visual Question Answering26 Nov 2024
- 2024Theoretical Proportion Label Perturbation for Learning from Label Proportions in Large Bags26 Aug 2024
- 2024DAC: 2D-3D Retrieval with Noisy Labels via Divide-and-Conquer Alignment and Correction25 Jul 2024
38 more
- 2024Learning from the Web: Language Drives Weakly-Supervised Incremental Learning for Semantic Segmentation18 Jul 2024
- 2024CBM: Curriculum by Masking6 Jul 2024
- 2024Learning Discriminative Dynamics with Label Corruption for Noisy Label Detection30 May 2024
- 2024RC-Mixup: A Data Augmentation Strategy against Noisy Data for Regression Tasks28 May 2024
- 2024EfficientTrain++: Generalized Curriculum Learning for Efficient Visual Backbone Training14 May 2024
- 2024Noisy Label Processing for Classification: A Survey5 Apr 2024
- 2024PLReMix: Combating Noisy Labels with Pseudo-Label Relaxed Contrastive Representation Learning27 Feb 2024
- 2024Multimodal Unsupervised Domain Generalization by Retrieving Across the Modality Gap6 Feb 2024
- 2024Intent-based Prompt Calibration: Enhancing prompt optimization with synthetic boundary cases5 Feb 2024
- 2024Curriculum for Crowd Counting -- Is it Worthy?15 Jan 2024
- 2023Zero-shot Retrieval: Augmenting Pre-trained Models with Search Engines29 Nov 2023
- 2023From Categories to Classifiers: Name-Only Continual Learning by Exploring the Web19 Nov 2023
- 2023CLearViD: Curriculum Learning for Video Description8 Nov 2023
- 2023Digital Twin-based Anomaly Detection with Curriculum Learning in Cyber-physical Systems27 Sep 2023
- 2023RECALL+: Adversarial Web-based Replay for Continual Learning in Semantic Segmentation19 Sep 2023
- 2023Domain Generalization via Balancing Training Difficulty and Model Capability2 Sep 2023
- 2023Contrastive Feature Masking Open-Vocabulary Vision Transformer2 Sep 2023
- 2023CL-MAE: Curriculum-Learned Masked Autoencoders31 Aug 2023
- 2023SILT: Shadow-aware Iterative Label Tuning for Learning to Detect Shadows from Noisy Labels23 Aug 2023
- 2023Reverse Stable Diffusion: What prompt was used to generate this image?2 Aug 2023
- 2023SYNAuG: Exploiting Synthetic Data for Data Imbalance Problems2 Aug 2023
- 2023LaplaceConfidence: a Graph-based Approach for Learning with Noisy Labels31 Jul 2023
- 2023Rethinking Noisy Label Learning in Real-world Annotation Scenarios from the Noise-type Perspective28 Jul 2023
- 2023Integrating Curricula with Replays: Its Effects on Continual Learning8 Jul 2023
- 2023Provable Advantage of Curriculum Learning on Parity Targets with Mixed Inputs29 Jun 2023
- 2023Stochastic Re-weighted Gradient Descent via Distributionally Robust Optimization15 Jun 2023
- 2023A Gradient-based Approach for Online Robust Deep Neural Network Training with Noisy Labels8 Jun 2023
- 2023Region-Aware Pretraining for Open-Vocabulary Object Detection with Vision Transformers11 May 2023
- 2023RECLIP: Resource-efficient CLIP by Training with Small Images12 Apr 2023
- 2023GeoNet: Benchmarking Unsupervised Adaptation across Geographies27 Mar 2023
- 2023Information Maximizing Curriculum: A Curriculum-Based Approach for Imitating Diverse Skills27 Mar 2023
- 2023Coreset Sampling from Open-Set for Fine-Grained Self-Supervised Learning20 Mar 2023
- 2023Internet Explorer: Targeted Representation Learning on the Open Web27 Feb 2023
- 2023Learning from Noisy Crowd Labels with Logics13 Feb 2023
- 2023Knockoffs-SPR: Clean Sample Selection in Learning with Noisy Labels2 Jan 2023
- 2023Learning Confident Classifiers in the Presence of Label Noise2 Jan 2023
- 2022Noise-aware Learning from Web-crawled Image-Text Data for Image Captioning27 Dec 2022
- 2022Learning from Training Dynamics: Identifying Mislabeled Data Beyond Manually Designed Features19 Dec 2022
50 newest of 95 All 95 (JSON)
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021Generalized Out-of-Distribution Detection: A Surveycited by 796
- 2021RegionCLIP: Region-based Language-Image Pretrainingcited by 612
- 2021Curriculum Learning: A Surveycited by 257
- 2022F-VLM: Open-Vocabulary Object Detection upon Frozen Vision and Language Modelscited by 149
- 2022Robust Training under Label Noise by Over-parameterizationcited by 93
- 2023Region-Aware Pretraining for Open-Vocabulary Object Detection with Vision Transformerscited by 91
- 2021Weakly Supervised Object Localization and Detection: A Surveycited by 84
- 2021RECALL: Replay-based Continual Learning in Semantic Segmentationcited by 83
- 2021Learning to Generate Scene Graph from Natural Language Supervisioncited by 64
- 2021Open-set Label Noise Can Improve Robustness Against Inherent Label Noisecited by 58
- 2021Sample Selection for Fair and Robust Trainingcited by 48
- 2022Webly Supervised Concept Expansion for General Purpose Vision Modelscited by 45
12 most cited of 87 All 87 (JSON)
- 2026Webly Supervised Multi-Label Recognition: Evaluation Benchmark and Dual-Branch Multi-Label Contrastive Learning23 Jul 2026
- 2025Weak-to-Strong Generalization under Distribution Shifts24 Oct 2025
- 2025Curriculum Multi-Task Self-Supervision Improves Lightweight Architectures for Onboard Satellite Hyperspectral Image Segmentation16 Sep 2025
- 2025MoMBS: Mixed-order minibatch sampling enhances model training from diverse-quality images24 May 2025
- 2025Active Learning with a Noisy Annotator6 Apr 2025
- 2024Self-Paced Learning Strategy with Easy Sample Prior Based on Confidence for the Flying Bird Object Detection Model Training9 Dec 2024
- 2024TPCL: Task Progressive Curriculum Learning for Robust Visual Question Answering26 Nov 2024
- 2024Theoretical Proportion Label Perturbation for Learning from Label Proportions in Large Bags26 Aug 2024
- 2024DAC: 2D-3D Retrieval with Noisy Labels via Divide-and-Conquer Alignment and Correction25 Jul 2024
- 2024Learning from the Web: Language Drives Weakly-Supervised Incremental Learning for Semantic Segmentation18 Jul 2024
- 2024CBM: Curriculum by Masking6 Jul 2024
- 2024Learning Discriminative Dynamics with Label Corruption for Noisy Label Detection30 May 2024
12 newest of 87 All 87 (JSON)