TransBoost: Improving the Best ImageNet Performance using Deep Transduction
Not on the map. Why?
Abstract (arXiv)
This paper deals with deep transductive learning, and proposes TransBoost as a procedure for fine-tuning any deep neural model to improve its performance on any (unlabeled) test set provided at training time. TransBoost is inspired by a large margin principle and is efficient and simple to use. Our method significantly improves the ImageNet classification performance on a wide range of architectures, such as ResNets, MobileNetV3-L, EfficientNetB0, ViT-S, and ConvNext-T, leading to state-of-the-art transductive performance. Additionally we show that TransBoost is effective on a wide variety of image classification datasets. The implementation of TransBoost is provided at: https://github.com/omerb01/TransBoost .
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 23 of its 40 references that are in the map. First posted on arXiv 26 May 2022.
Builds on
23 of 40 references.
References · 23
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
- 2022A ConvNet for the 2020scited by 3,545
- 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,261
- 2013Describing Textures in the Wildcited by 2,110
11 more
- 2019Searching for MobileNetV3cited by 1,984
- 2013Fine-Grained Visual Classification of Aircraftcited by 1,701
- 2020Big Self-Supervised Models are Strong Semi-Supervised Learnerscited by 1,375
- 2019Large Batch Optimization for Deep Learning: Training BERT in 76 minutescited by 671
- 2021ResNet strikes back: An improved training procedure in timmcited by 365
- 2019A Baseline for Few-Shot Image Classificationcited by 298
- 2021Semi-Supervised Learning of Visual Features by Non-Parametrically Predicting View Assignments with Support Samplescited by 114
- 2020Transductive Information Maximization For Few-Shot Learningcited by 44
- 2020Iterative label cleaning for transductive and semi-supervised few-shot learningcited by 40
- 2020MEAL V2: Boosting Vanilla ResNet-50 to 80%+ Top-1 Accuracy on ImageNet without Trickscited by 39
- 2014Transductive Rademacher Complexity and its Applicationscited by 25
Built on by
Citing papers per year: 2024: 2; 2025: 1.
3 papers.