Fine-Grained Visual Classification using Self Assessment Classifier
Not on the map. Why?
Abstract (arXiv)
Extracting discriminative features plays a crucial role in the fine-grained visual classification task. Most of the existing methods focus on developing attention or augmentation mechanisms to achieve this goal. However, addressing the ambiguity in the top-k prediction classes is not fully investigated. In this paper, we introduce a Self Assessment Classifier, which simultaneously leverages the representation of the image and top-k prediction classes to reassess the classification results. Our method is inspired by continual learning with coarse-grained and fine-grained classifiers to increase the discrimination of features in the backbone and produce attention maps of informative areas on the image. In practice, our method works as an auxiliary branch and can be easily integrated into different architectures. We show that by effectively addressing the ambiguity in the top-k prediction classes, our method achieves new state-of-the-art results on CUB200-2011, Stanford Dog, and FGVC Aircraft datasets. Furthermore, our method also consistently improves the accuracy of different existing fine-grained classifiers with a unified setup.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 55 of its 79 references that are in the map. First posted on arXiv 21 May 2022.
Builds on
55 of 79 references.
References · 55
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,884
- 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,162
- 2013Fine-Grained Visual Classification of Aircraftcited by 1,726
- 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,628
- 2015Spatial Transformer Networkscited by 1,429
- 2018Bilinear Attention Networkscited by 280
38 more
- 2015Stacked Attention Networks for Image Question Answeringcited by 273
- 2015Bilinear CNNs for Fine-grained Visual Recognitioncited by 228
- 2015Weakly Supervised Deep Detection Networkscited by 183
- 2018Large Scale Fine-Grained Categorization and Domain-Specific Transfer Learningcited by 174
- 2018Adversarial Complementary Learning for Weakly Supervised Object Localizationcited by 166
- 2019Attention-based Dropout Layer for Weakly Supervised Object Localizationcited by 125
- 2021Counterfactual Attention Learning for Fine-Grained Visual Categorization and Re-identificationcited by 114
- 2014Part-based R-CNNs for Fine-grained Category Detectioncited by 109
- 2019Looking for the Devil in the Details: Learning Trilinear Attention Sampling Network for Fine-grained Image Recognitioncited by 95
- 2020Learning Attentive Pairwise Interaction for Fine-Grained Classificationcited by 84
- 2022Dual Cross-Attention Learning for Fine-Grained Visual Categorization and Object Re-Identificationcited by 78
- 2020Interpretable and Accurate Fine-grained Recognition via Region Groupingcited by 75
- 2018Self-produced Guidance for Weakly-supervised Object Localizationcited by 72
- 2019Weakly Supervised Complementary Parts Models for Fine-Grained Image Classification from the Bottom Upcited by 66
- 2018Maximum-Entropy Fine-Grained Classificationcited by 65
- 2020The Devil is in the Channels: Mutual-Channel Loss for Fine-Grained Image Classificationcited by 64
- 2018Multi-Attention Multi-Class Constraint for Fine-grained Image Recognitioncited by 58
- 2019See Better Before Looking Closer: Weakly Supervised Data Augmentation Network for Fine-Grained Visual Classificationcited by 56
- 2020SnapMix: Semantically Proportional Mixing for Augmenting Fine-grained Datacited by 56
- 2021Multiple Meta-model Quantifying for Medical Visual Question Answeringcited by 54
- 2021Deep Federated Learning for Autonomous Drivingcited by 54
- 2019Attention Convolutional Binary Neural Tree for Fine-Grained Visual Categorizationcited by 51
- 2014Bird Species Categorization Using Pose Normalized Deep Convolutional Netscited by 50
- 2020Channel Interaction Networks for Fine-Grained Image Categorizationcited by 47
- 2016Selective Convolutional Descriptor Aggregation for Fine-Grained Image Retrievalcited by 44
- 2018Compact Generalized Non-local Networkcited by 36
- 2017Improved Bilinear Pooling with CNNscited by 29
- 2017Fine-grained Recognition in the Wild: A Multi-Task Domain Adaptation Approachcited by 27
- 2021Coarse-to-Fine Reasoning for Visual Question Answeringcited by 25
- 2019Fine-grained Recognition: Accounting for Subtle Differences between Similar Classescited by 24
- 2017Dynamic Computational Time for Visual Attentioncited by 23
- 2017Two-Phase Learning for Weakly Supervised Object Localizationcited by 21
- 2020Look-into-Object: Self-supervised Structure Modeling for Object Recognitioncited by 20
- 2021Global-Local Attention for Emotion Recognitioncited by 20
- 2022Dynamic MLP for Fine-Grained Image Classification by Leveraging Geographical and Temporal Informationcited by 15
- 2021Graph-based Person Signature for Person Re-Identificationscited by 14
- 2021Light-weight Deformable Registration using Adversarial Learning with Distilling Knowledgecited by 12
- 2016Weakly Supervised Localization using Deep Feature Mapscited by 7
50 most cited of 55 All 55 (JSON)
Built on by
Citing papers per year: 2022: 1; 2023: 3; 2024: 2; 2025: 1; 2026: 1.
8 papers.
- 2022Uncertainty-aware Label Distribution Learning for Facial Expression Recognitioncited by 30
- 2024Language-driven Grasp Detectioncited by 26
- 2023Fine-grained Visual Classification with High-temperature Refinement and Background Suppressioncited by 22
- 2023Salient Mask-Guided Vision Transformer for Fine-Grained Classificationcited by 3
- 2024ViTree: Single-path Neural Tree for Step-wise Interpretable Fine-grained Visual Categorizationcited by 1
- 2025Cross-Hierarchical Bidirectional Consistency Learning for Fine-Grained Visual Classificationcited by 1
- 2023Semantic Feature Integration network for Fine-grained Visual Classificationcited by 0
- 2026AffordMatcher: Affordance Learning in 3D Scenes from Visual Signifierscited by 0
- 2026AffordMatcher: Affordance Learning in 3D Scenes from Visual Signifiers30 Mar 2026
- 2025Cross-Hierarchical Bidirectional Consistency Learning for Fine-Grained Visual Classification18 Apr 2025
- 2024Language-driven Grasp Detection13 Jun 2024
- 2024ViTree: Single-path Neural Tree for Step-wise Interpretable Fine-grained Visual Categorization30 Jan 2024
- 2023Salient Mask-Guided Vision Transformer for Fine-Grained Classification11 May 2023
- 2023Fine-grained Visual Classification with High-temperature Refinement and Background Suppression11 Mar 2023
- 2023Semantic Feature Integration network for Fine-grained Visual Classification13 Feb 2023
- 2022Uncertainty-aware Label Distribution Learning for Facial Expression Recognition21 Sep 2022