NoisyActions2M: A Multimedia Dataset for Video Understanding from Noisy Labels
Not on the map. Why?
Abstract (arXiv)
Deep learning has shown remarkable progress in a wide range of problems. However, efficient training of such models requires large-scale datasets, and getting annotations for such datasets can be challenging and costly. In this work, we explore the use of user-generated freely available labels from web videos for video understanding. We create a benchmark dataset consisting of around 2 million videos with associated user-generated annotations and other meta information. We utilize the collected dataset for action classification and demonstrate its usefulness with existing small-scale annotated datasets, UCF101 and HMDB51. We study different loss functions and two pretraining strategies, simple and self-supervised learning. We also show how a network pretrained on the proposed dataset can help against video corruption and label noise in downstream datasets. We present this as a benchmark dataset in noisy learning for video understanding. The dataset, code, and trained models will be publicly available for future research.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 28 of its 53 references that are in the map. First posted on arXiv 13 Oct 2021.
Builds on
28 of 53 references.
References · 28
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,656
- 2017Mixed Precision Trainingcited by 1,156
- 2017A Closer Look at Spatiotemporal Convolutions for Action Recognitioncited by 1,143
- 2017The "something something" video database for learning and evaluating visual common sensecited by 1,103
- 2017Dense-Captioning Events in Videoscited by 793
- 2016Making Deep Neural Networks Robust to Label Noise: a Loss Correction Approachcited by 665
- 2018Exploring the Limits of Weakly Supervised Pretrainingcited by 605
- 2017Can Spatiotemporal 3D CNNs Retrace the History of 2D CNNs and ImageNet?cited by 551
- 2016Hollywood in Homes: Crowdsourcing Data Collection for Activity Understandingcited by 537
- 2017AVA: A Video Dataset of Spatio-temporally Localized Atomic Visual Actionscited by 449
16 more
- 2016YouTube-8M: A Large-Scale Video Classification Benchmarkcited by 324
- 2019Benchmarking Zero-shot Text Classification: Datasets, Evaluation and Entailment Approachcited by 308
- 2017WebVision Database: Visual Learning and Understanding from Web Datacited by 262
- 2015YFCC100M: The New Data in Multimedia Researchcited by 235
- 2018Moments in Time Dataset: one million videos for event understandingcited by 215
- 2017CleanNet: Transfer Learning for Scalable Image Classifier Training with Label Noisecited by 181
- 2017Deep Learning is Robust to Massive Label Noisecited by 165
- 2019Large-scale weakly-supervised pre-training for video action recognitioncited by 130
- 2018Charades-Ego: A Large-Scale Dataset of Paired Third and First Person Videoscited by 128
- 2016TGIF: A New Dataset and Benchmark on Animated GIF Descriptioncited by 124
- 2020Distribution-Balanced Loss for Multi-Label Classification in Long-Tailed Datasetscited by 122
- 2015Webly Supervised Learning of Convolutional Networkscited by 95
- 2017Toward Robustness against Label Noise in Training Deep Discriminative Neural Networkscited by 78
- 2018Grounded Video Descriptioncited by 78
- 2021Contrastive Learning Improves Model Robustness Under Label Noisecited by 36
- 2019Quality Estimation for Image Captions Based on Large-scale Human Evaluationscited by 17
Built on by
Citing papers per year: 2022: 1; 2023: 0; 2024: 0; 2025: 1.
2 papers.