mlsanityData to 14 Oct 2026

VIPriors 3: Visual Inductive Priors for Data-Efficient Deep Learning Challenges

arXiv 2305.19688 ↗First posted 31 May 2023cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

The third edition of the "VIPriors: Visual Inductive Priors for Data-Efficient Deep Learning" workshop featured four data-impaired challenges, focusing on addressing the limitations of data availability in training deep learning models for computer vision tasks. The challenges comprised of four distinct data-impaired tasks, where participants were required to train models from scratch using a reduced number of training samples. The primary objective was to encourage novel approaches that incorporate relevant inductive biases to enhance the data efficiency of deep learning models. To foster creativity and exploration, participants were strictly prohibited from utilizing pre-trained checkpoints and other transfer learning techniques. Significant advancements were made compared to the provided baselines, where winning solutions surpassed the baselines by a considerable margin in all four tasks. These achievements were primarily attributed to the effective utilization of extensive data augmentation policies, model ensembling techniques, and the implementation of data-efficient training methods, including self-supervised representation learning. This report highlights the key aspects of the challenges and their outcomes.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 64 of its 73 references that are in the map. First posted on arXiv 31 May 2023.

Builds on

64 of 73 references.

References · 64

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  4. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
  5. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  6. 2017Mask R-CNNcited by 7,277
  7. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
  8. 2016Feature Pyramid Networks for Object Detectioncited by 5,036
  9. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  10. 2022A ConvNet for the 2020scited by 3,579
  11. 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,884
  12. 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,546
38 more
  1. 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,269
  2. 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,962
  3. 2017The Kinetics Human Action Video Datasetcited by 1,909
  4. 2018SlowFast Networks for Video Recognitioncited by 1,867
  5. 2020YOLOv4: Optimal Speed and Accuracy of Object Detectioncited by 1,630
  6. 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,620
  7. 2021An Empirical Study of Training Self-Supervised Vision Transformerscited by 1,616
  8. 2018Group Normalizationcited by 1,524
  9. 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,396
  10. 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,368
  11. 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,322
  12. 2017Cascade R-CNN: Delving into High Quality Object Detectioncited by 1,276
  13. 2018Averaging Weights Leads to Wider Optima and Better Generalizationcited by 1,209
  14. 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,153
  15. 2017A Closer Look at Spatiotemporal Convolutions for Action Recognitioncited by 1,143
  16. 2021Video Swin Transformercited by 1,091
  17. 2022YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectorscited by 982
  18. 2017Revisiting Unreasonable Effectiveness of Data in Deep Learning Eracited by 919
  19. 2016Temporal Segment Networks: Towards Good Practices for Deep Action Recognitioncited by 902
  20. 2018AutoAugment: Learning Augmentation Policies from Datacited by 730
  21. 2020X3D: Expanding Architectures for Efficient Video Recognitioncited by 637
  22. 2020Simple Copy-Paste is a Strong Data Augmentation Method for Instance Segmentationcited by 596
  23. 2019Hybrid Task Cascade for Instance Segmentationcited by 481
  24. 2022Decoupled Knowledge Distillationcited by 388
  25. 2017Soft-NMS -- Improving Object Detection With One Line of Codecited by 382
  26. 2019Video Classification with Channel-Separated Convolutional Networkscited by 290
  27. 2019Mask Scoring R-CNNcited by 266
  28. 2020Temporal Pyramid Network for Action Recognitioncited by 163
  29. 2021Revisiting ResNets: Improved Training and Scaling Strategiescited by 158
  30. 2020Seesaw Loss for Long-Tailed Instance Segmentationcited by 146
  31. 2020On Translation Invariance in CNNs: Convolutional Layers can Exploit Absolute Spatial Locationcited by 142
  32. 2020GridMask Data Augmentationcited by 123
  33. 2021Self-Supervised Learning with Swin Transformerscited by 122
  34. 2017Dual Path Networkscited by 119
  35. 2019TANet: Robust 3D Object Detection from Point Clouds with Triple Attentioncited by 108
  36. 2021You Only Learn One Representation: Unified Network for Multiple Taskscited by 86
  37. 2021CBNet: A Composite Backbone Network Architecture for Object Detectioncited by 77
  38. 2019Augmentation for small object detectioncited by 73

50 most cited of 64 All 64 (JSON)

Built on by

Cited by year

Citing papers per year: 2023: 1; 2024: 3.

4 papers.