Grafit: Learning fine-grained image representations with coarse labels
Not on the map. Why?
Abstract (arXiv)
This paper tackles the problem of learning a finer representation than the one provided by training labels. This enables fine-grained category retrieval of images in a collection annotated with coarse labels only. Our network is learned with a nearest-neighbor classifier objective, and an instance loss inspired by self-supervised learning. By jointly leveraging the coarse labels and the underlying fine-grained latent space, it significantly improves the accuracy of category-level retrieval methods. Our strategy outperforms all competing methods for retrieving or classifying images at a finer granularity than that available at train time. It also improves the accuracy for transfer learning tasks to fine-grained datasets, thereby establishing the new state of the art on five public benchmarks, like iNaturalist-2018.
Key facts. Cited by 43 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 Nov 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 13; 2022: 10; 2023: 12; 2024: 6; 2025: 1; 2026: 1.
43 papers.
Sort:
By area:
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2021Transformer in Transformercited by 632
- 2022DeiT III: Revenge of the ViTcited by 417
- 2021ResNet strikes back: An improved training procedure in timmcited by 365
- 2021ResMLP: Feedforward networks for image classification with data-efficient trainingcited by 338
- 2021Incorporating Convolution Designs into Visual Transformerscited by 248
- 2021ViTAE: Vision Transformer Advanced by Exploring Intrinsic Inductive Biascited by 216
- 2021AutoFormer: Searching Transformers for Visual Recognitioncited by 186
- 2021Instance-Conditioned GANcited by 119
- 2022ViTAEv2: Vision Transformer Advanced by Exploring Inductive Bias for Image Recognition and Beyondcited by 117
- 2022Retrieval Augmented Classification for Long-Tail Visual Recognitioncited by 106
- 2022MiniViT: Compressing Vision Transformers with Weight Multiplexingcited by 88
31 more
- 2023GeneCIS: A Benchmark for General Conditional Image Similaritycited by 46
- 2023Towards In-context Scene Understandingcited by 45
- 2022Beyond ImageNet Attack: Towards Crafting Adversarial Examples for Black-box Domainscited by 42
- 2023Vocabulary-free Image Classificationcited by 35
- 2021Augmenting Convolutional networks with attention-based aggregationcited by 29
- 2022MetaFormer: A Unified Meta Framework for Fine-Grained Recognitioncited by 28
- 2021Efficient Algorithms for Learning from Coarse Labelscited by 21
- 2023MaskCon: Masked Contrastive Learning for Coarse-Labelled Datasetcited by 21
- 2024CLIBD: Bridging Vision and Genomics for Biodiversity Monitoring at Scalecited by 18
- 2022Dynamic MLP for Fine-Grained Image Classification by Leveraging Geographical and Temporal Informationcited by 15
- 2022On Label Granularity and Object Localizationcited by 12
- 2024DenseNets Reloaded: Paradigm Shift Beyond ResNets and ViTscited by 12
- 2021Semi-Supervised Learning with Taxonomic Labelscited by 11
- 2023Quantifying the Variability Collapse of Neural Networkscited by 9
- 2023Hyperbolic Space with Hierarchical Margin Boosts Fine-Grained Learning from Coarse Labelscited by 8
- 2024Vocabulary-free Image Classification and Semantic Segmentationcited by 8
- 2021Constrained Mean Shift Using Distant Yet Related Neighbors for Representation Learningcited by 7
- 2022It's All in the Head: Representation Knowledge Distillation through Classifier Sharingcited by 7
- 2021Rethinking Nearest Neighbors for Visual Classificationcited by 6
- 2023Weakly Supervised Temporal Convolutional Networks for Fine-grained Surgical Activity Recognitioncited by 5
- 2023Weakly Supervised Lesion Detection and Diagnosis for Breast Cancers with Partially Annotated Ultrasound Imagescited by 5
- 2023Learn More for Food Recognition via Progressive Self-Distillationcited by 4
- 2023Compressing Image-to-Image Translation GANs Using Local Density Structures on Their Learned Manifoldcited by 3
- 2024Fine-grained Classes and How to Find Themcited by 2
- 2023EViT: An Eagle Vision Transformer with Bi-Fovea Self-Attentioncited by 1
- 2024Progressive Multi-task Anti-Noise Learning and Distilling Frameworks for Fine-grained Vehicle Recognitioncited by 1
- 2025Twofold Debiasing Enhances Fine-Grained Learning with Coarse Labelscited by 1
- 2022FedMT: Federated Learning with Mixed-type Labelscited by 0
- 2023ELFIS: Expert Learning for Fine-grained Image Recognition Using Subsetscited by 0
- 2024Fine-grained Classification of Port Wine Stains Using Optical Coherence Tomography Angiographycited by 0
- 2026Spatial-Temporal Expert Learning for Video-based Person Re-identificationcited by 0
- 2026Spatial-Temporal Expert Learning for Video-based Person Re-identification1 Jul 2026
- 2025Twofold Debiasing Enhances Fine-Grained Learning with Coarse Labels27 Feb 2025
- 2024Fine-grained Classification of Port Wine Stains Using Optical Coherence Tomography Angiography29 Aug 2024
- 2024Fine-grained Classes and How to Find Them16 Jun 2024
- 2024CLIBD: Bridging Vision and Genomics for Biodiversity Monitoring at Scale27 May 2024
- 2024Vocabulary-free Image Classification and Semantic Segmentation16 Apr 2024
- 2024DenseNets Reloaded: Paradigm Shift Beyond ResNets and ViTs28 Mar 2024
- 2024Progressive Multi-task Anti-Noise Learning and Distilling Frameworks for Fine-grained Vehicle Recognition25 Jan 2024
- 2023Compressing Image-to-Image Translation GANs Using Local Density Structures on Their Learned Manifold22 Dec 2023
- 2023Hyperbolic Space with Hierarchical Margin Boosts Fine-Grained Learning from Coarse Labels18 Nov 2023
- 2023EViT: An Eagle Vision Transformer with Bi-Fovea Self-Attention10 Oct 2023
- 2023GeneCIS: A Benchmark for General Conditional Image Similarity13 Jun 2023
31 more
- 2023Weakly Supervised Lesion Detection and Diagnosis for Breast Cancers with Partially Annotated Ultrasound Images12 Jun 2023
- 2023Quantifying the Variability Collapse of Neural Networks6 Jun 2023
- 2023Towards In-context Scene Understanding2 Jun 2023
- 2023Vocabulary-free Image Classification1 Jun 2023
- 2023MaskCon: Masked Contrastive Learning for Coarse-Labelled Dataset22 Mar 2023
- 2023ELFIS: Expert Learning for Fine-grained Image Recognition Using Subsets16 Mar 2023
- 2023Learn More for Food Recognition via Progressive Self-Distillation9 Mar 2023
- 2023Weakly Supervised Temporal Convolutional Networks for Fine-grained Surgical Activity Recognition21 Feb 2023
- 2022FedMT: Federated Learning with Mixed-type Labels5 Oct 2022
- 2022On Label Granularity and Object Localization20 Jul 2022
- 2022MiniViT: Compressing Vision Transformers with Weight Multiplexing14 Apr 2022
- 2022DeiT III: Revenge of the ViT14 Apr 2022
- 2022Dynamic MLP for Fine-Grained Image Classification by Leveraging Geographical and Temporal Information7 Mar 2022
- 2022MetaFormer: A Unified Meta Framework for Fine-Grained Recognition5 Mar 2022
- 2022Retrieval Augmented Classification for Long-Tail Visual Recognition22 Feb 2022
- 2022ViTAEv2: Vision Transformer Advanced by Exploring Inductive Bias for Image Recognition and Beyond21 Feb 2022
- 2022Beyond ImageNet Attack: Towards Crafting Adversarial Examples for Black-box Domains27 Jan 2022
- 2022It's All in the Head: Representation Knowledge Distillation through Classifier Sharing18 Jan 2022
- 2021Augmenting Convolutional networks with attention-based aggregation27 Dec 2021
- 2021Rethinking Nearest Neighbors for Visual Classification15 Dec 2021
- 2021Constrained Mean Shift Using Distant Yet Related Neighbors for Representation Learning8 Dec 2021
- 2021Semi-Supervised Learning with Taxonomic Labels23 Nov 2021
- 2021Masked Autoencoders Are Scalable Vision Learners11 Nov 2021
- 2021ResNet strikes back: An improved training procedure in timm1 Oct 2021
- 2021Instance-Conditioned GAN10 Sep 2021
- 2021Efficient Algorithms for Learning from Coarse Labels22 Aug 2021
- 2021AutoFormer: Searching Transformers for Visual Recognition1 Jul 2021
- 2021ViTAE: Vision Transformer Advanced by Exploring Intrinsic Inductive Bias7 Jun 2021
- 2021ResMLP: Feedforward networks for image classification with data-efficient training7 May 2021
- 2021Incorporating Convolution Designs into Visual Transformers22 Mar 2021
- 2021Transformer in Transformer27 Feb 2021
- 2023Vocabulary-free Image Classificationcited by 35
- 2024Vocabulary-free Image Classification and Semantic Segmentationcited by 8
- 2024Vocabulary-free Image Classification and Semantic Segmentation16 Apr 2024
- 2023Vocabulary-free Image Classification1 Jun 2023
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2021Transformer in Transformercited by 632
- 2022DeiT III: Revenge of the ViTcited by 417
- 2021ResNet strikes back: An improved training procedure in timmcited by 365
- 2021ResMLP: Feedforward networks for image classification with data-efficient trainingcited by 338
- 2021Incorporating Convolution Designs into Visual Transformerscited by 248
- 2021ViTAE: Vision Transformer Advanced by Exploring Intrinsic Inductive Biascited by 216
- 2021AutoFormer: Searching Transformers for Visual Recognitioncited by 186
- 2021Instance-Conditioned GANcited by 119
- 2022ViTAEv2: Vision Transformer Advanced by Exploring Inductive Bias for Image Recognition and Beyondcited by 117
- 2022MiniViT: Compressing Vision Transformers with Weight Multiplexingcited by 88
- 2023GeneCIS: A Benchmark for General Conditional Image Similaritycited by 46
12 most cited of 40 All 40 (JSON)
- 2026Spatial-Temporal Expert Learning for Video-based Person Re-identification1 Jul 2026
- 2025Twofold Debiasing Enhances Fine-Grained Learning with Coarse Labels27 Feb 2025
- 2024Fine-grained Classification of Port Wine Stains Using Optical Coherence Tomography Angiography29 Aug 2024
- 2024Fine-grained Classes and How to Find Them16 Jun 2024
- 2024CLIBD: Bridging Vision and Genomics for Biodiversity Monitoring at Scale27 May 2024
- 2024DenseNets Reloaded: Paradigm Shift Beyond ResNets and ViTs28 Mar 2024
- 2024Progressive Multi-task Anti-Noise Learning and Distilling Frameworks for Fine-grained Vehicle Recognition25 Jan 2024
- 2023Compressing Image-to-Image Translation GANs Using Local Density Structures on Their Learned Manifold22 Dec 2023
- 2023Hyperbolic Space with Hierarchical Margin Boosts Fine-Grained Learning from Coarse Labels18 Nov 2023
- 2023EViT: An Eagle Vision Transformer with Bi-Fovea Self-Attention10 Oct 2023
- 2023GeneCIS: A Benchmark for General Conditional Image Similarity13 Jun 2023
- 2023Weakly Supervised Lesion Detection and Diagnosis for Breast Cancers with Partially Annotated Ultrasound Images12 Jun 2023
12 newest of 40 All 40 (JSON)