mlsanityData to 7 Oct 2026

Fine-Grained ImageNet Classification in the Wild

arXiv 2303.02400 ↗First posted 4 Mar 2023cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Image classification has been one of the most popular tasks in Deep Learning, seeing an abundance of impressive implementations each year. However, there is a lot of criticism tied to promoting complex architectures that continuously push performance metrics higher and higher. Robustness tests can uncover several vulnerabilities and biases which go unnoticed during the typical model evaluation stage. So far, model robustness under distribution shifts has mainly been examined within carefully curated datasets. Nevertheless, such approaches do not test the real response of classifiers in the wild, e.g. when uncurated web-crawled image data of corresponding classes are provided. In our work, we perform fine-grained classification on closely related categories, which are identified with the help of hierarchical knowledge. Extensive experimentation on a variety of convolutional and transformer-based architectures reveals model robustness in this novel setting. Finally, hierarchical knowledge is again employed to evaluate and explain misclassifications, providing an information-rich evaluation scheme adaptable to any classifier.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 45 of its 52 references that are in the map. First posted on arXiv 4 Mar 2023.

Builds on

45 of 52 references.

References · 45

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  5. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  6. 2016Densely Connected Convolutional Networkscited by 6,691
  7. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
  8. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  9. 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
  10. 2022A ConvNet for the 2020scited by 3,545
  11. 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,857
  12. 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
33 more
  1. 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,320
  2. 2020The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalizationcited by 1,842
  3. 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,623
  4. 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,509
  5. 2019Do ImageNet Classifiers Generalize to ImageNet?cited by 1,507
  6. 2018ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustnesscited by 1,430
  7. 2019Natural Adversarial Examplescited by 1,401
  8. 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,366
  9. 2019Certified Adversarial Robustness via Randomized Smoothingcited by 1,324
  10. 2022CoCa: Contrastive Captioners are Image-Text Foundation Modelscited by 1,265
  11. 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,215
  12. 2017Learning Transferable Architectures for Scalable Image Recognitioncited by 1,097
  13. 2021Transformers in Vision: A Surveycited by 1,009
  14. 2020Designing Network Design Spacescited by 954
  15. 2018Robustness May Be at Odds with Accuracycited by 873
  16. 2017Evasion Attacks against Machine Learning at Test Timecited by 686
  17. 2020Measuring Robustness to Natural Distribution Shifts in Image Classificationcited by 452
  18. 2019A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmarkcited by 419
  19. 2020A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospectscited by 396
  20. 2021Understanding Robustness of Transformers for Image Classificationcited by 250
  21. 2018Generalisation in humans and deep neural networkscited by 237
  22. 2021Vision Transformers are Robust Learnerscited by 208
  23. 2021Data Augmentation Can Improve Robustnesscited by 193
  24. 2016Improving the Robustness of Deep Neural Networks via Stability Trainingcited by 156
  25. 2021On Interaction Between Augmentations and Corruptions in Natural Corruption Robustnesscited by 98
  26. 2022Can CNNs Be More Robust Than Transformers?cited by 38
  27. 2017Improving Deep Learning using Generic Data Augmentationcited by 36
  28. 2022An Impartial Take to the CNN vs Transformer Robustness Contestcited by 34
  29. 2022On the Strong Correlation Between Model Invariance and Generalizationcited by 23
  30. 2019Invariance-inducing regularization using worst-case transformations suffices to boost accuracy and spatial robustnesscited by 18
  31. 2021Using Synthetic Corruptions to Measure Robustness to Natural Distribution Shiftscited by 7
  32. 2021Selection of Source Images Heavily Influences the Effectiveness of Adversarial Attackscited by 6
  33. 2022Adversarial Robustness is at Odds with Lazy Trainingcited by 6

Built on by

Not cited yet.