Sensitive Image Classification by Vision Transformers
Not on the map. Why?
Abstract (arXiv)
When it comes to classifying child sexual abuse images, managing similar inter-class correlations and diverse intra-class correlations poses a significant challenge. Vision transformer models, unlike conventional deep convolutional network models, leverage a self-attention mechanism to capture global interactions among contextual local elements. This allows them to navigate through image patches effectively, avoiding incorrect correlations and reducing ambiguity in attention maps, thus proving their efficacy in computer vision tasks. Rather than directly analyzing child sexual abuse data, we constructed two datasets: one comprising clean and pornographic images and another with three classes, which additionally include images indicative of pornography, sourced from Reddit and Google Open Images data. In our experiments, we also employ an adult content image benchmark dataset. These datasets served as a basis for assessing the performance of vision transformer models in pornographic image classification. In our study, we conducted a comparative analysis between various popular vision transformer models and traditional pre-trained ResNet models. Furthermore, we compared them with established methods for sensitive image detection such as attention and metric learning based CNN and Bumble. The findings demonstrated that vision transformer networks surpassed the benchmark pre-trained models, showcasing their superior classification and detection capabilities in this task.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 35 references that are in the map. First posted on arXiv 21 Dec 2024.
Builds on
21 of 35 references.
References · 21
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2017The Kinetics Human Action Video Datasetcited by 1,894
- 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,609
- 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,305
- 2017The "something something" video database for learning and evaluating visual common sensecited by 1,092
- 2021Video Swin Transformercited by 1,090
- 2022MultiMAE: Multi-modal Multi-task Masked Autoencoderscited by 287
- 2022Omnivore: A Single Model for Many Visual Modalitiescited by 214
9 more
- 2022Frozen CLIP Models are Efficient Video Learnerscited by 181
- 2021BEVT: BERT Pretraining of Video Transformerscited by 169
- 2022OmniMAE: Single Model Masked Pretraining on Images and Videoscited by 99
- 2022Fast Vision Transformers with HiLo Attentioncited by 78
- 2021PolyViT: Co-training Vision Transformers on Images, Videos and Audiocited by 58
- 2022M&M Mix: A Multimodal Multiview Transformer Ensemblecited by 19
- 2016Survey on the attention based RNN model and its applications in computer visioncited by 14
- 2016Smart Content Recognition from Images Using a Mixture of Convolutional Neural Networkscited by 4
- 2023State-of-the-Art in Nudity Classification: A Comparative Analysiscited by 3
Built on by
Not cited yet.