Few-Shot Image Recognition by Predicting Parameters from Activations
Not on the map. Why?
Abstract (arXiv)
In this paper, we are interested in the few-shot learning problem. In particular, we focus on a challenging scenario where the number of categories is large and the number of examples per novel category is very limited, e.g. 1, 2, or 3. Motivated by the close relationship between the parameters and the activations in a neural network associated with the same category, we propose a novel method that can adapt a pre-trained neural network to novel categories by directly predicting the parameters from the activations. Zero training is required in adaptation to novel categories, and fast inference is realized by a single forward pass. We evaluate our method by doing few-shot image recognition on the ImageNet dataset, which achieves the state-of-the-art classification accuracy on novel categories by a significant margin while keeping comparable performance on the large-scale categories. We also test our method on the MiniImageNet dataset and it strongly outperforms the previous state-of-the-art methods.
Key facts. Cited by 122 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Jun 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 55; 2022: 33; 2023: 15; 2024: 14; 2025: 5.
122 papers.
Sort:
By area:
- 2021Investigating Bi-Level Optimization for Learning and Vision from a Unified Perspective: A Survey and Beyondcited by 151
- 2021DeFRCN: Decoupled Faster R-CNN for Few-Shot Object Detectioncited by 106
- 2021On the Role of Neural Collapse in Transfer Learningcited by 100
- 2021Generalized Few-Shot Object Detection without Forgettingcited by 88
- 2021Generalizable Person Re-identification with Relevance-aware Mixture of Expertscited by 77
- 2021Relational Embedding for Few-Shot Classificationcited by 74
- 2021Partial Is Better Than All: Revisiting Fine-tuning Strategy for Few-shot Learningcited by 72
- 2022HyperTransformer: Model Generation for Supervised and Semi-Supervised Few-Shot Learningcited by 55
- 2021Pareto Self-Supervised Training for Few-Shot Learningcited by 52
- 2021Shallow Bayesian Meta Learning for Real-World Few-Shot Recognitioncited by 48
- 2021Learning Dynamic Alignment via Meta-filter for Few-shot Learningcited by 41
- 2021Background-Aware Pooling and Noise-Aware Loss for Weakly-Supervised Semantic Segmentationcited by 41
38 more
- 2023MoLo: Motion-augmented Long-short Contrastive Learning for Few-shot Action Recognitioncited by 36
- 2022Compound Prototype Matching for Few-shot Action Recognitioncited by 35
- 2021A General Descent Aggregation Framework for Gradient-based Bi-level Optimizationcited by 28
- 2022Attribute Surrogates Learning and Spectral Tokens Pooling in Transformers for Few-shot Learningcited by 27
- 2021Binocular Mutual Learning for Improving Few-shot Classificationcited by 26
- 2024MVP-Shot: Multi-Velocity Progressive-Alignment Framework for Few-Shot Action Recognitioncited by 25
- 2022HyperShot: Few-Shot Learning by Kernel HyperNetworkscited by 24
- 2022Sylph: A Hypernetwork Framework for Incremental Few-shot Object Detectioncited by 23
- 2021How to Train Your MAML to Excel in Few-Shot Classificationcited by 22
- 2021Revisit Multimodal Meta-Learning through the Lens of Multi-Task Learningcited by 22
- 2022Inductive and Transductive Few-Shot Video Classification via Appearance and Temporal Alignmentscited by 22
- 2024HyperFast: Instant Classification for Tabular Datacited by 22
- 2022Open Long-Tailed Recognition in a Dynamic Worldcited by 21
- 2021Mimic Embedding via Adaptive Aggregation: Learning Generalizable Person Re-identificationcited by 19
- 2022MetaPrompting: Learning to Learn Better Promptscited by 19
- 2021An Optimization-Based Meta-Learning Model for MRI Reconstruction with Diverse Datasetcited by 18
- 2021Few-Shot Learning with a Strong Teachercited by 16
- 2022HyperMAML: Few-Shot Adaptation of Deep Models with Hypernetworkscited by 16
- 2022Few-Shot Learning Meets Transformer: Unified Query-Support Transformers for Few-Shot Classificationcited by 16
- 2024SOPHON: Non-Fine-Tunable Learning to Restrain Task Transferability For Pre-trained Modelscited by 16
- 2021Contrastive Prototype Learning with Augmented Embeddings for Few-Shot Learningcited by 15
- 2021On sensitivity of meta-learning to support datacited by 15
- 2021SEGA: Semantic Guided Attention on Visual Prototype for Few-Shot Learningcited by 15
- 2022POODLE: Improving Few-shot Learning via Penalizing Out-of-Distribution Samplescited by 15
- 2023Self-supervised Meta-Prompt Learning with Meta-Gradient Regularization for Few-shot Generalizationcited by 15
- 2022Tree Structure-Aware Few-Shot Image Classification via Hierarchical Aggregationcited by 14
- 2021Few-Shot and Continual Learning with Attentive Independent Mechanismscited by 13
- 2023Identity-Seeking Self-Supervised Representation Learning for Generalizable Person Re-identificationcited by 13
- 2021The Role of Global Labels in Few-Shot Classification and How to Infer Themcited by 12
- 2022Towards Open-Set Text Recognition via Label-to-Prototype Learningcited by 12
- 2023When Meta-Learning Meets Online and Continual Learning: A Surveycited by 12
- 2021Boosting Few-Shot Classification with View-Learnable Contrastive Learningcited by 11
- 2021Adaptive Convolutions with Per-pixel Dynamic Filter Atomcited by 11
- 2022A Novel Mix-normalization Method for Generalizable Multi-source Person Re-identificationcited by 11
- 2023Towards Task Sampler Learning for Meta-Learningcited by 11
- 2024A Comprehensive Review of Few-shot Action Recognitioncited by 11
- 2021DMN4: Few-shot Learning via Discriminative Mutual Nearest Neighbor Neural Networkcited by 9
- 2023Few-shot Action Recognition with Captioning Foundation Modelscited by 9
50 most cited of 122 All 122 (JSON)
- 2025TransMatch: A Transfer-Learning Framework for Defect Detection in Laser Powder Bed Fusion Additive Manufacturing1 Sep 2025
- 2025Doodle Your Keypoints: Sketch-Based Few-Shot Keypoint Detection10 Jul 2025
- 2025DIP: Unsupervised Dense In-Context Post-training of Visual Representations23 Jun 2025
- 2025Joint Image-Instance Spatial-Temporal Attention for Few-shot Action Recognition11 Mar 2025
- 2025In-context Learning of Evolving Data Streams with Tabular Foundational Models24 Feb 2025
- 2024A Unified Deep Semantic Expansion Framework for Domain-Generalized Person Re-identification11 Oct 2024
- 2024FAST: A Dual-tier Few-Shot Learning Paradigm for Whole Slide Image Classification29 Sep 2024
- 2024Learning to Obstruct Few-Shot Image Classification over Restricted Classes28 Sep 2024
- 2024Learn To Learn More Precisely8 Aug 2024
- 2024A Comprehensive Review of Few-shot Action Recognition20 Jul 2024
- 2024Meta-Learning Neural Procedural Biases12 Jun 2024
- 2024Tiny models from tiny data: Textual and null-text inversion for few-shot distillation5 Jun 2024
38 more
- 2024MVP-Shot: Multi-Velocity Progressive-Alignment Framework for Few-Shot Action Recognition3 May 2024
- 2024SOPHON: Non-Fine-Tunable Learning to Restrain Task Transferability For Pre-trained Models19 Apr 2024
- 2024Meta-Auxiliary Learning for Micro-Expression Recognition18 Apr 2024
- 2024Convection-Diffusion Equation: A Theoretically Certified Framework for Neural Networks23 Mar 2024
- 2024An Open-World, Diverse, Cross-Spatial-Temporal Benchmark for Dynamic Wild Person Re-Identification22 Mar 2024
- 2024HyperFast: Instant Classification for Tabular Data22 Feb 2024
- 2024Dual-View Data Hallucination with Semantic Relation Guidance for Few-Shot Image Recognition13 Jan 2024
- 2023GeNIe: Generative Hard Negative Images Through Diffusion5 Dec 2023
- 2023When the Few Outweigh the Many: Illicit Content Recognition with Few-Shot Learning28 Nov 2023
- 2023When Meta-Learning Meets Online and Continual Learning: A Survey9 Nov 2023
- 2023Towards Anytime Fine-tuning: Continually Pre-trained Language Models with Hypernetwork Prompt19 Oct 2023
- 2023Few-shot Action Recognition with Captioning Foundation Models16 Oct 2023
- 2023Identity-Seeking Self-Supervised Representation Learning for Generalizable Person Re-identification17 Aug 2023
- 2023Is Meta-Learning the Right Approach for the Cold-Start Problem in Recommender Systems?16 Aug 2023
- 2023Cos R-CNN for Online Few-shot Object Detection25 Jul 2023
- 2023Towards Task Sampler Learning for Meta-Learning18 Jul 2023
- 2023MoLo: Motion-augmented Long-short Contrastive Learning for Few-shot Action Recognition3 Apr 2023
- 2023Meta-Learning Parameterized First-Order Optimizers using Differentiable Convex Optimization29 Mar 2023
- 2023Self-supervised Meta-Prompt Learning with Meta-Gradient Regularization for Few-shot Generalization22 Mar 2023
- 2023HalluAudio: Hallucinating Frequency as Concepts for Few-Shot Audio Classification27 Feb 2023
- 2023Bayes meets Bernstein at the Meta Level: an Analysis of Fast Rates in Meta-Learning with PAC-Bayes23 Feb 2023
- 2023Robust Knowledge Adaptation for Federated Unsupervised Person ReID18 Jan 2023
- 2022Generalization Bounds for Few-Shot Transfer Learning with Pretrained Classifiers23 Dec 2022
- 2022Task-Adaptive Meta-Learning Framework for Advancing Spatial Generalizability10 Dec 2022
- 2022PatchMix Augmentation to Identify Causal Features in Few-shot Learning29 Nov 2022
- 2022RankDNN: Learning to Rank for Few-shot Learning28 Nov 2022
- 2022Enhancing Few-shot Image Classification with Cosine Transformer13 Nov 2022
- 2022Few-shot Classification with Hypersphere Modeling of Prototypes10 Nov 2022
- 2022Generalizable Re-Identification from Videos with Cycle Association7 Nov 2022
- 2022Domain generalization Person Re-identification on Attention-aware multi-operation strategery19 Oct 2022
- 2022Hypernetwork approach to Bayesian MAML6 Oct 2022
- 2022MetaPrompting: Learning to Learn Better Prompts23 Sep 2022
- 2022Few-Shot Learning Meets Transformer: Unified Query-Support Transformers for Few-Shot Classification26 Aug 2022
- 2022Open Long-Tailed Recognition in a Dynamic World17 Aug 2022
- 2022Inductive and Transductive Few-Shot Video Classification via Appearance and Temporal Alignments21 Jul 2022
- 2022Few-shot Fine-grained Image Classification via Multi-Frequency Neighborhood and Double-cross Modulation18 Jul 2022
- 2022Cross-Domain Cross-Set Few-Shot Learning via Learning Compact and Aligned Representations16 Jul 2022
- 2022Tree Structure-Aware Few-Shot Image Classification via Hierarchical Aggregation14 Jul 2022
50 newest of 122 All 122 (JSON)
- 2021Investigating Bi-Level Optimization for Learning and Vision from a Unified Perspective: A Survey and Beyondcited by 151
- 2021DeFRCN: Decoupled Faster R-CNN for Few-Shot Object Detectioncited by 106
- 2021On the Role of Neural Collapse in Transfer Learningcited by 100
- 2021Generalized Few-Shot Object Detection without Forgettingcited by 88
- 2021Relational Embedding for Few-Shot Classificationcited by 74
- 2021Partial Is Better Than All: Revisiting Fine-tuning Strategy for Few-shot Learningcited by 72
- 2022HyperTransformer: Model Generation for Supervised and Semi-Supervised Few-Shot Learningcited by 55
- 2021Pareto Self-Supervised Training for Few-Shot Learningcited by 52
- 2021Shallow Bayesian Meta Learning for Real-World Few-Shot Recognitioncited by 48
- 2021Learning Dynamic Alignment via Meta-filter for Few-shot Learningcited by 41
- 2021Background-Aware Pooling and Noise-Aware Loss for Weakly-Supervised Semantic Segmentationcited by 41
- 2023MoLo: Motion-augmented Long-short Contrastive Learning for Few-shot Action Recognitioncited by 36
12 most cited of 118 All 118 (JSON)
- 2025TransMatch: A Transfer-Learning Framework for Defect Detection in Laser Powder Bed Fusion Additive Manufacturing1 Sep 2025
- 2025Doodle Your Keypoints: Sketch-Based Few-Shot Keypoint Detection10 Jul 2025
- 2025DIP: Unsupervised Dense In-Context Post-training of Visual Representations23 Jun 2025
- 2025Joint Image-Instance Spatial-Temporal Attention for Few-shot Action Recognition11 Mar 2025
- 2025In-context Learning of Evolving Data Streams with Tabular Foundational Models24 Feb 2025
- 2024A Unified Deep Semantic Expansion Framework for Domain-Generalized Person Re-identification11 Oct 2024
- 2024FAST: A Dual-tier Few-Shot Learning Paradigm for Whole Slide Image Classification29 Sep 2024
- 2024Learning to Obstruct Few-Shot Image Classification over Restricted Classes28 Sep 2024
- 2024Learn To Learn More Precisely8 Aug 2024
- 2024A Comprehensive Review of Few-shot Action Recognition20 Jul 2024
- 2024Meta-Learning Neural Procedural Biases12 Jun 2024
- 2024MVP-Shot: Multi-Velocity Progressive-Alignment Framework for Few-Shot Action Recognition3 May 2024
12 newest of 118 All 118 (JSON)