mlsanityData to 7 Oct 2026

A Comparison for Anti-noise Robustness of Deep Learning Classification Methods on a Tiny Object Image Dataset: from Convolutional Neural Network to Visual Transformer and Performer

arXiv 2106.01927 ↗First posted 3 Jun 2021cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Image classification has achieved unprecedented advance with the the rapid development of deep learning. However, the classification of tiny object images is still not well investigated. In this paper, we first briefly review the development of Convolutional Neural Network and Visual Transformer in deep learning, and introduce the sources and development of conventional noises and adversarial attacks. Then we use various models of Convolutional Neural Network and Visual Transformer to conduct a series of experiments on the image dataset of tiny objects (sperms and impurities), and compare various evaluation metrics in the experimental results to obtain a model with stable performance. Finally, we discuss the problems in the classification of tiny objects and make a prospect for the classification of tiny objects in the future.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 31 of its 57 references that are in the map. First posted on arXiv 3 Jun 2021.

Builds on

31 of 57 references.

References · 31

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  5. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  6. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  7. 2020End-to-End Object Detection with Transformerscited by 7,384
  8. 2014Explaining and Harnessing Adversarial Examplescited by 7,287
  9. 2016Densely Connected Convolutional Networkscited by 6,691
  10. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  11. 2013Intriguing properties of neural networkscited by 5,114
  12. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
19 more
  1. 2017Squeeze-and-Excitation Networkscited by 4,763
  2. 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
  3. 2014Going Deeper with Convolutionscited by 4,231
  4. 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,320
  5. 2016Adversarial examples in the physical worldcited by 1,762
  6. 2015DeepFool: a simple and accurate method to fool deep neural networkscited by 1,315
  7. 2018ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Designcited by 1,132
  8. 2021Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNetcited by 1,096
  9. 2017One pixel attack for fooling deep neural networkscited by 579
  10. 2019Object Detection in 20 Years: A Surveycited by 528
  11. 2020Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlationcited by 420
  12. 2021Bottleneck Transformers for Visual Recognitioncited by 364
  13. 2018Feature Denoising for Improving Adversarial Robustnesscited by 312
  14. 2016Adversarial Training Methods for Semi-Supervised Text Classificationcited by 280
  15. 2016A Survey on Object Detection in Optical Remote Sensing Imagescited by 78
  16. 2015A Review Paper: Noise Models in Digital Image Processingcited by 23
  17. 2017Learning a Rotation Invariant Detector with Rotatable Bounding Boxcited by 21
  18. 2020Global Self-Attention Networks for Image Recognitioncited by 16
  19. 2018What Do We Understand About Convolutional Networks?cited by 6

Built on by

Not cited yet.