Generating Classification Weights with GNN Denoising Autoencoders for Few-Shot Learning
Not on the map. Why?
Abstract (arXiv)
Given an initial recognition model already trained on a set of base classes, the goal of this work is to develop a meta-model for few-shot learning. The meta-model, given as input some novel classes with few training examples per class, must properly adapt the existing recognition model into a new model that can correctly classify in a unified way both the novel and the base classes. To accomplish this goal it must learn to output the appropriate classification weight vectors for those two types of classes. To build our meta-model we make use of two main innovations: we propose the use of a Denoising Autoencoder network (DAE) that (during training) takes as input a set of classification weights corrupted with Gaussian noise and learns to reconstruct the target-discriminative classification weights. In this case, the injected noise on the classification weights serves the role of regularizing the weight generating meta-model. Furthermore, in order to capture the co-dependencies between different classes in a given task instance of our meta-model, we propose to implement the DAE model as a Graph Neural Network (GNN). In order to verify the efficacy of our approach, we extensively evaluate it on ImageNet based few-shot benchmarks and we report strong results that surpass prior approaches. The code and models of our paper will be published on: https://github.com/gidariss/wDAE_GNN_FewShot
Key facts. Cited by 69 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 26; 2022: 25; 2023: 9; 2024: 4; 2025: 4; 2026: 1.
69 papers.
Sort:
By area:
- 2022A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunitiescited by 162
- 2021SLAPS: Self-Supervision Improves Structure Learning for Graph Neural Networkscited by 108
- 2021Self-Promoted Prototype Refinement for Few-Shot Class-Incremental Learningcited by 95
- 2021Relational Embedding for Few-Shot Classificationcited by 74
- 2021A Survey on Graph Structure Learning: Progress and Opportunitiescited by 70
- 2021Learning Dynamic Alignment via Meta-filter for Few-shot Learningcited by 41
- 2021Accelerating Large Scale Real-Time GNN Inference using Channel Pruningcited by 41
- 2021Generalized and Incremental Few-Shot Learning by Explicit Learning and Calibration without Forgettingcited by 33
- 2022Few-Shot Classification with Contrastive Learningcited by 31
- 2023Transductive Few-shot Learning with Prototype-based Label Propagation by Iterative Graph Refinementcited by 30
- 2023MMG-Ego4D: Multi-Modal Generalization in Egocentric Action Recognitioncited by 26
- 2022Matching Feature Sets for Few-Shot Image Classificationcited by 25
38 more
- 2023Meta-learning approaches for few-shot learning: A survey of recent advancescited by 25
- 2022FS-DETR: Few-Shot DEtection TRansformer with prompting and without re-trainingcited by 20
- 2021Reinforced Attention for Few-Shot Learning and Beyondcited by 18
- 2022Few-Shot Learning Meets Transformer: Unified Query-Support Transformers for Few-Shot Classificationcited by 16
- 2021Contrastive Prototype Learning with Augmented Embeddings for Few-Shot Learningcited by 15
- 2021SEGA: Semantic Guided Attention on Visual Prototype for Few-Shot Learningcited by 15
- 2021Adaptive Poincar'e Point to Set Distance for Few-Shot Classificationcited by 15
- 2023Image-free Classifier Injection for Zero-Shot Classificationcited by 15
- 2024Few-Shot Recognition via Stage-Wise Retrieval-Augmented Finetuningcited by 15
- 2023DETA: Denoised Task Adaptation for Few-Shot Learningcited by 13
- 2021Disentangled Feature Representation for Few-shot Image Classificationcited by 12
- 2022Multi-level Second-order Few-shot Learningcited by 12
- 2022Towards Open-Set Text Recognition via Label-to-Prototype Learningcited by 12
- 2021ECKPN: Explicit Class Knowledge Propagation Network for Transductive Few-shot Learningcited by 11
- 2021Boosting Few-Shot Classification with View-Learnable Contrastive Learningcited by 11
- 2024Few-shot Learner Parameterization by Diffusion Time-stepscited by 11
- 2022Adaptive Dimension Reduction and Variational Inference for Transductive Few-Shot Classificationcited by 10
- 2021DMN4: Few-shot Learning via Discriminative Mutual Nearest Neighbor Neural Networkcited by 9
- 2022FS-BAN: Born-Again Networks for Domain Generalization Few-Shot Classificationcited by 9
- 2023MOCA: Self-supervised Representation Learning by Predicting Masked Online Codebook Assignmentscited by 9
- 2022Powering Finetuning in Few-Shot Learning: Domain-Agnostic Bias Reduction with Selected Samplingcited by 8
- 2023GenCo: An Auxiliary Generator from Contrastive Learning for Enhanced Few-Shot Learning in Remote Sensingcited by 8
- 2021Few-Shot Video Object Detectioncited by 7
- 2021Unsupervised Embedding Adaptation via Early-Stage Feature Reconstruction for Few-Shot Classificationcited by 7
- 2022RankDNN: Learning to Rank for Few-shot Learningcited by 7
- 2021MetaCloth: Learning Unseen Tasks of Dense Fashion Landmark Detection from a Few Samplescited by 6
- 2022tSF: Transformer-based Semantic Filter for Few-Shot Learningcited by 6
- 2021Diffusion Mechanism in Residual Neural Network: Theory and Applicationscited by 5
- 2021Few Shot Activity Recognition Using Variational Inferencecited by 5
- 2025Analytical Survey of Learning with Low-Resource Data: From Analysis to Investigationcited by 5
- 2022Beyond Simple Meta-Learning: Multi-Purpose Models for Multi-Domain, Active and Continual Few-Shot Learningcited by 4
- 2022Worst Case Matters for Few-Shot Recognitioncited by 4
- 2022Few-shot Fine-grained Image Classification via Multi-Frequency Neighborhood and Double-cross Modulationcited by 4
- 2022Kernel Relative-prototype Spectral Filtering for Few-shot Learningcited by 4
- 2022PatchMix Augmentation to Identify Causal Features in Few-shot Learningcited by 4
- 2022Graph Neural Networks in Computer Vision -- Architectures, Datasets and Common Approachescited by 4
- 2023SpatialFormer: Semantic and Target Aware Attentions for Few-Shot Learningcited by 4
- 2023Clustered-patch Element Connection for Few-shot Learningcited by 4
50 most cited of 69 All 69 (JSON)
- 2026Graph Topology Information Enhanced Heterogeneous Graph Representation Learning7 Apr 2026
- 2025Analytical Survey of Learning with Low-Resource Data: From Analysis to Investigation10 Oct 2025
- 2025Hyperbolic Coarse-to-Fine Few-Shot Class-Incremental Learning23 Sep 2025
- 2025DIP: Unsupervised Dense In-Context Post-training of Visual Representations23 Jun 2025
- 2025Semantic-Anchored, Class Variance-Optimized Clustering for Robust Semi-Supervised Few-Shot Learning24 Jan 2025
- 2024Federated Graph Learning with Graphless Clients13 Nov 2024
- 2024Few-Shot Recognition via Stage-Wise Retrieval-Augmented Finetuning17 Jun 2024
- 2024Few-shot Learner Parameterization by Diffusion Time-steps5 Mar 2024
- 2024Dual-View Data Hallucination with Semantic Relation Guidance for Few-Shot Image Recognition13 Jan 2024
- 2023Image-free Classifier Injection for Zero-Shot Classification21 Aug 2023
- 2023GenCo: An Auxiliary Generator from Contrastive Learning for Enhanced Few-Shot Learning in Remote Sensing27 Jul 2023
- 2023MOCA: Self-supervised Representation Learning by Predicting Masked Online Codebook Assignments18 Jul 2023
38 more
- 2023MMG-Ego4D: Multi-Modal Generalization in Egocentric Action Recognition12 May 2023
- 2023Transductive Few-shot Learning with Prototype-based Label Propagation by Iterative Graph Refinement23 Apr 2023
- 2023Clustered-patch Element Connection for Few-shot Learning20 Apr 2023
- 2023SpatialFormer: Semantic and Target Aware Attentions for Few-Shot Learning15 Mar 2023
- 2023Meta-learning approaches for few-shot learning: A survey of recent advances13 Mar 2023
- 2023DETA: Denoised Task Adaptation for Few-Shot Learning11 Mar 2023
- 2022Graph Neural Networks in Computer Vision -- Architectures, Datasets and Common Approaches20 Dec 2022
- 2022Better Generalized Few-Shot Learning Even Without Base Data29 Nov 2022
- 2022PatchMix Augmentation to Identify Causal Features in Few-shot Learning29 Nov 2022
- 2022RankDNN: Learning to Rank for Few-shot Learning28 Nov 2022
- 2022Rethinking the Metric in Few-shot Learning: From an Adaptive Multi-Distance Perspective2 Nov 2022
- 2022tSF: Transformer-based Semantic Filter for Few-Shot Learning2 Nov 2022
- 2022A Unified Framework with Meta-dropout for Few-shot Learning12 Oct 2022
- 2022FS-DETR: Few-Shot DEtection TRansformer with prompting and without re-training10 Oct 2022
- 2022Adaptive Dimension Reduction and Variational Inference for Transductive Few-Shot Classification18 Sep 2022
- 2022Few-Shot Classification with Contrastive Learning17 Sep 2022
- 2022Not All Instances Contribute Equally: Instance-adaptive Class Representation Learning for Few-Shot Visual Recognition7 Sep 2022
- 2022Few-Shot Learning Meets Transformer: Unified Query-Support Transformers for Few-Shot Classification26 Aug 2022
- 2022FS-BAN: Born-Again Networks for Domain Generalization Few-Shot Classification23 Aug 2022
- 2022Kernel Relative-prototype Spectral Filtering for Few-shot Learning24 Jul 2022
- 2022Few-shot Fine-grained Image Classification via Multi-Frequency Neighborhood and Double-cross Modulation18 Jul 2022
- 2022Improvements to Self-Supervised Representation Learning for Masked Image Modeling21 May 2022
- 2022A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunities13 May 2022
- 2022Powering Finetuning in Few-Shot Learning: Domain-Agnostic Bias Reduction with Selected Sampling7 Apr 2022
- 2022Matching Feature Sets for Few-Shot Image Classification2 Apr 2022
- 2022A Framework of Meta Functional Learning for Regularising Knowledge Transfer28 Mar 2022
- 2022Worst Case Matters for Few-Shot Recognition13 Mar 2022
- 2022Towards Open-Set Text Recognition via Label-to-Prototype Learning10 Mar 2022
- 2022Multi-level Second-order Few-shot Learning15 Jan 2022
- 2022Beyond Simple Meta-Learning: Multi-Purpose Models for Multi-Domain, Active and Continual Few-Shot Learning13 Jan 2022
- 2022MetaDance: Few-shot Dancing Video Retargeting via Temporal-aware Meta-learning13 Jan 2022
- 2021MetaCloth: Learning Unseen Tasks of Dense Fashion Landmark Detection from a Few Samples6 Dec 2021
- 2021Adaptive Poincar'e Point to Set Distance for Few-Shot Classification3 Dec 2021
- 2021ShufaNet: Classification method for calligraphers who have reached the professional level22 Nov 2021
- 2021SEGA: Semantic Guided Attention on Visual Prototype for Few-Shot Learning8 Nov 2021
- 2021Self-Denoising Neural Networks for Few Shot Learning26 Oct 2021
- 2021Disentangled Feature Representation for Few-shot Image Classification26 Sep 2021
- 2021Relational Embedding for Few-Shot Classification22 Aug 2021
50 newest of 69 All 69 (JSON)
- 2022A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunitiescited by 162
- 2021SLAPS: Self-Supervision Improves Structure Learning for Graph Neural Networkscited by 108
- 2021Self-Promoted Prototype Refinement for Few-Shot Class-Incremental Learningcited by 95
- 2021Relational Embedding for Few-Shot Classificationcited by 74
- 2021A Survey on Graph Structure Learning: Progress and Opportunitiescited by 70
- 2021Learning Dynamic Alignment via Meta-filter for Few-shot Learningcited by 41
- 2021Accelerating Large Scale Real-Time GNN Inference using Channel Pruningcited by 41
- 2021Generalized and Incremental Few-Shot Learning by Explicit Learning and Calibration without Forgettingcited by 33
- 2022Few-Shot Classification with Contrastive Learningcited by 31
- 2023Transductive Few-shot Learning with Prototype-based Label Propagation by Iterative Graph Refinementcited by 30
- 2023MMG-Ego4D: Multi-Modal Generalization in Egocentric Action Recognitioncited by 26
- 2022Matching Feature Sets for Few-Shot Image Classificationcited by 25
12 most cited of 68 All 68 (JSON)
- 2026Graph Topology Information Enhanced Heterogeneous Graph Representation Learning7 Apr 2026
- 2025Analytical Survey of Learning with Low-Resource Data: From Analysis to Investigation10 Oct 2025
- 2025Hyperbolic Coarse-to-Fine Few-Shot Class-Incremental Learning23 Sep 2025
- 2025DIP: Unsupervised Dense In-Context Post-training of Visual Representations23 Jun 2025
- 2025Semantic-Anchored, Class Variance-Optimized Clustering for Robust Semi-Supervised Few-Shot Learning24 Jan 2025
- 2024Federated Graph Learning with Graphless Clients13 Nov 2024
- 2024Few-shot Learner Parameterization by Diffusion Time-steps5 Mar 2024
- 2024Dual-View Data Hallucination with Semantic Relation Guidance for Few-Shot Image Recognition13 Jan 2024
- 2023Image-free Classifier Injection for Zero-Shot Classification21 Aug 2023
- 2023GenCo: An Auxiliary Generator from Contrastive Learning for Enhanced Few-Shot Learning in Remote Sensing27 Jul 2023
- 2023MOCA: Self-supervised Representation Learning by Predicting Masked Online Codebook Assignments18 Jul 2023
- 2023MMG-Ego4D: Multi-Modal Generalization in Egocentric Action Recognition12 May 2023
12 newest of 68 All 68 (JSON)