VIPriors 3: Visual Inductive Priors for Data-Efficient Deep Learning Challenges
Not on the map. Why?
Abstract (arXiv)
The third edition of the "VIPriors: Visual Inductive Priors for Data-Efficient Deep Learning" workshop featured four data-impaired challenges, focusing on addressing the limitations of data availability in training deep learning models for computer vision tasks. The challenges comprised of four distinct data-impaired tasks, where participants were required to train models from scratch using a reduced number of training samples. The primary objective was to encourage novel approaches that incorporate relevant inductive biases to enhance the data efficiency of deep learning models. To foster creativity and exploration, participants were strictly prohibited from utilizing pre-trained checkpoints and other transfer learning techniques. Significant advancements were made compared to the provided baselines, where winning solutions surpassed the baselines by a considerable margin in all four tasks. These achievements were primarily attributed to the effective utilization of extensive data augmentation policies, model ensembling techniques, and the implementation of data-efficient training methods, including self-supervised representation learning. This report highlights the key aspects of the challenges and their outcomes.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 64 of its 73 references that are in the map. First posted on arXiv 31 May 2023.
Builds on
64 of 73 references.
References · 64
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2017Mask R-CNNcited by 7,277
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2022A ConvNet for the 2020scited by 3,579
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,884
- 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,546
38 more
- 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,269
- 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,962
- 2017The Kinetics Human Action Video Datasetcited by 1,909
- 2018SlowFast Networks for Video Recognitioncited by 1,867
- 2020YOLOv4: Optimal Speed and Accuracy of Object Detectioncited by 1,630
- 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,620
- 2021An Empirical Study of Training Self-Supervised Vision Transformerscited by 1,616
- 2018Group Normalizationcited by 1,524
- 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,396
- 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,368
- 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,322
- 2017Cascade R-CNN: Delving into High Quality Object Detectioncited by 1,276
- 2018Averaging Weights Leads to Wider Optima and Better Generalizationcited by 1,209
- 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,153
- 2017A Closer Look at Spatiotemporal Convolutions for Action Recognitioncited by 1,143
- 2021Video Swin Transformercited by 1,091
- 2022YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectorscited by 982
- 2017Revisiting Unreasonable Effectiveness of Data in Deep Learning Eracited by 919
- 2016Temporal Segment Networks: Towards Good Practices for Deep Action Recognitioncited by 902
- 2018AutoAugment: Learning Augmentation Policies from Datacited by 730
- 2020X3D: Expanding Architectures for Efficient Video Recognitioncited by 637
- 2020Simple Copy-Paste is a Strong Data Augmentation Method for Instance Segmentationcited by 596
- 2019Hybrid Task Cascade for Instance Segmentationcited by 481
- 2022Decoupled Knowledge Distillationcited by 388
- 2017Soft-NMS -- Improving Object Detection With One Line of Codecited by 382
- 2019Video Classification with Channel-Separated Convolutional Networkscited by 290
- 2019Mask Scoring R-CNNcited by 266
- 2020Temporal Pyramid Network for Action Recognitioncited by 163
- 2021Revisiting ResNets: Improved Training and Scaling Strategiescited by 158
- 2020Seesaw Loss for Long-Tailed Instance Segmentationcited by 146
- 2020On Translation Invariance in CNNs: Convolutional Layers can Exploit Absolute Spatial Locationcited by 142
- 2020GridMask Data Augmentationcited by 123
- 2021Self-Supervised Learning with Swin Transformerscited by 122
- 2017Dual Path Networkscited by 119
- 2019TANet: Robust 3D Object Detection from Point Clouds with Triple Attentioncited by 108
- 2021You Only Learn One Representation: Unified Network for Multiple Taskscited by 86
- 2021CBNet: A Composite Backbone Network Architecture for Object Detectioncited by 77
- 2019Augmentation for small object detectioncited by 73
50 most cited of 64 All 64 (JSON)
Built on by
Citing papers per year: 2023: 1; 2024: 3.
4 papers.
- 2023No Data Augmentation? Alternative Regularizations for Effective Training on Small Datasetscited by 1
- 2024Augment Before Copy-Paste: Data and Memory Efficiency-Oriented Instance Segmentation Framework for Sport-scenescited by 0
- 2024MISS: Memory-efficient Instance Segmentation Framework By Visual Inductive Priors Flow Propagationcited by 0
- 2024VIPriors 4: Visual Inductive Priors for Data-Efficient Deep Learning Challengescited by 0
- 2024VIPriors 4: Visual Inductive Priors for Data-Efficient Deep Learning Challenges26 Jun 2024
- 2024MISS: Memory-efficient Instance Segmentation Framework By Visual Inductive Priors Flow Propagation18 Mar 2024
- 2024Augment Before Copy-Paste: Data and Memory Efficiency-Oriented Instance Segmentation Framework for Sport-scenes18 Mar 2024
- 2023No Data Augmentation? Alternative Regularizations for Effective Training on Small Datasets4 Sep 2023