Infinite Mixture Prototypes for Few-Shot Learning
Not on the map. Why?
Abstract (arXiv)
We propose infinite mixture prototypes to adaptively represent both simple and complex data distributions for few-shot learning. Our infinite mixture prototypes represent each class by a set of clusters, unlike existing prototypical methods that represent each class by a single cluster. By inferring the number of clusters, infinite mixture prototypes interpolate between nearest neighbor and prototypical representations, which improves accuracy and robustness in the few-shot regime. We show the importance of adaptive capacity for capturing complex data distributions such as alphabets, with 25% absolute accuracy improvements over prototypical networks, while still maintaining or improving accuracy on the standard Omniglot and mini-ImageNet benchmarks. In clustering labeled and unlabeled data by the same clustering rule, infinite mixture prototypes achieves state-of-the-art semi-supervised accuracy. As a further capability, we show that infinite mixture prototypes can perform purely unsupervised clustering, unlike existing prototypical methods.
Key facts. Cited by 99 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Feb 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 35; 2022: 22; 2023: 16; 2024: 11; 2025: 13; 2026: 2.
99 papers.
Sort:
By area:
- 2021Hypercorrelation Squeeze for Few-Shot Segmentationcited by 193
- 2022Self-Support Few-Shot Semantic Segmentationcited by 96
- 2021Relational Embedding for Few-Shot Classificationcited by 74
- 2023Advances and Challenges in Meta-Learning: A Technical Reviewcited by 65
- 2021Exploring Complementary Strengths of Invariant and Equivariant Representations for Few-Shot Learningcited by 56
- 2022HyperTransformer: Model Generation for Supervised and Semi-Supervised Few-Shot Learningcited by 55
- 2021von Mises-Fisher Loss: An Exploration of Embedding Geometries for Supervised Learningcited by 42
- 2023A General-Purpose Self-Supervised Model for Computational Pathologycited by 42
- 2022Novel Class Discovery without Forgettingcited by 39
- 2021Exemplar-Based Open-Set Panoptic Segmentation Networkcited by 37
- 2023On the Robustness of Open-World Test-Time Training: Self-Training with Dynamic Prototype Expansioncited by 34
- 2021A Metalearning Approach for Physics-Informed Neural Networks (PINNs): Application to Parameterized PDEscited by 31
38 more
- 2022Integrative Few-Shot Learning for Classification and Segmentationcited by 25
- 2022Matching Feature Sets for Few-Shot Image Classificationcited by 25
- 2021Deep Metric Learning for Few-Shot Image Classification: A Review of Recent Developmentscited by 23
- 2021Prototype Guided Federated Learning of Visual Feature Representationscited by 22
- 2024Prototypical Reward Network for Data-Efficient RLHFcited by 22
- 2023Understanding the (Extra-)Ordinary: Validating Deep Model Decisions with Prototypical Concept-based Explanationscited by 21
- 2023Context-Aware Meta-Learningcited by 20
- 2025Model Predictive Task Sampling for Efficient and Robust Adaptationcited by 20
- 2021Learning Prototype-oriented Set Representations for Meta-Learningcited by 19
- 2023MaskDiff: Modeling Mask Distribution with Diffusion Probabilistic Model for Few-Shot Instance Segmentationcited by 18
- 2021Dense Gaussian Processes for Few-Shot Segmentationcited by 17
- 2021Temporal Action Segmentation with High-level Complex Activity Labelscited by 16
- 2021Distance-wise Prototypical Graph Neural Network in Node Imbalance Classificationcited by 16
- 2021Long-tail Recognition via Compositional Knowledge Transfercited by 16
- 2021Contrastive Prototype Learning with Augmented Embeddings for Few-Shot Learningcited by 15
- 2021A Closer Look at Prototype Classifier for Few-shot Image Classificationcited by 15
- 2021Hybrid Graph Neural Networks for Few-Shot Learningcited by 15
- 2023ProtoDiff: Learning to Learn Prototypical Networks by Task-Guided Diffusioncited by 15
- 2021Hierarchical Variational Memory for Few-shot Learning Across Domainscited by 14
- 2022Weakly Supervised 3D Point Cloud Segmentation via Multi-Prototype Learningcited by 13
- 2024Robust Fast Adaptation from Adversarially Explicit Task Distribution Generationcited by 12
- 2021Multi-Label Few-Shot Learning for Aspect Category Detectioncited by 11
- 2023Hubs and Hyperspheres: Reducing Hubness and Improving Transductive Few-shot Learning with Hyperspherical Embeddingscited by 11
- 2022Prototypical Fine-tuning: Towards Robust Performance Under Varying Data Sizescited by 10
- 2023EEGMatch: Learning with Incomplete Labels for Semi-Supervised EEG-based Cross-Subject Emotion Recognitioncited by 10
- 2022Few-Shot Document-Level Event Argument Extractioncited by 9
- 2023A Simple Yet Effective Strategy to Robustify the Meta Learning Paradigmcited by 9
- 2021Bayesian Embeddings for Few-Shot Open World Recognitioncited by 8
- 2022Federated Semi-Supervised Learning with Prototypical Networkscited by 8
- 2023Episodic Multi-Task Learning with Heterogeneous Neural Processescited by 8
- 2021On the Importance of Firth Bias Reduction in Few-Shot Classificationcited by 7
- 2022Label-enhanced Prototypical Network with Contrastive Learning for Multi-label Few-shot Aspect Category Detectioncited by 7
- 2023In-Context Learning for Few-Shot Molecular Property Predictioncited by 7
- 2025Uncertainty Meets Diversity: A Comprehensive Active Learning Framework for Indoor 3D Object Detectioncited by 7
- 2022Meta Learning of Interface Conditions for Multi-Domain Physics-Informed Neural Networkscited by 6
- 2024Localization and Expansion: A Decoupled Framework for Point Cloud Few-shot Semantic Segmentationcited by 6
- 2021Omni-Training: Bridging Pre-Training and Meta-Training for Few-Shot Learningcited by 5
- 2021Meta-Learning with Adjoint Methodscited by 5
50 most cited of 99 All 99 (JSON)
- 2026Training-Free Spectral Transductive Refinement for Cross-Domain Few-Shot Classification20 Sep 2026
- 2026Which Rules Matter Now? Policy-Centroid Routing Before an Intelligent System Acts31 Aug 2026
- 2025DUPLE: An Intelligent Cross-Deployment Recognition Framework for Fiber-Optic Perimeter Security under Scarce Target Labels22 Nov 2025
- 2025Using predefined vector systems as latent space configuration for neural network supervised training on data with arbitrarily large number of classes5 Oct 2025
- 2025ProtoTS: Learning Hierarchical Prototypes for Explainable Time Series Forecasting27 Sep 2025
- 2025Reshaping the Forward-Forward Algorithm with a Similarity-Based Objective29 Aug 2025
- 2025Efficient Masked Attention Transformer for Few-Shot Classification and Segmentation31 Jul 2025
- 2025Beyond Class Tokens: LLM-guided Dominant Property Mining for Few-shot Classification28 Jul 2025
- 2025Doodle Your Keypoints: Sketch-Based Few-Shot Keypoint Detection10 Jul 2025
- 2025Multiple Stochastic Prompt Tuning for Few-shot Adaptation under Extreme Domain Shift4 Jun 2025
- 2025Optimization-Inspired Few-Shot Adaptation for Large Language Models25 May 2025
- 2025Memory-Modular Classification: Learning to Generalize with Memory Replacement8 Apr 2025
38 more
- 2025Unbiased Max-Min Embedding Classification for Transductive Few-Shot Learning: Clustering and Classification Are All You Need28 Mar 2025
- 2025Uncertainty Meets Diversity: A Comprehensive Active Learning Framework for Indoor 3D Object Detection20 Mar 2025
- 2025Model Predictive Task Sampling for Efficient and Robust Adaptation19 Jan 2025
- 2024Theoretical Investigations and Practical Enhancements on Tail Task Risk Minimization in Meta Learning30 Oct 2024
- 2024Proto-OOD: Enhancing OOD Object Detection with Prototype Feature Similarity9 Sep 2024
- 2024A New First-Order Meta-Learning Algorithm with Convergence Guarantees5 Sep 2024
- 2024Localization and Expansion: A Decoupled Framework for Point Cloud Few-shot Semantic Segmentation25 Aug 2024
- 2024Label-Guided Prompt for Multi-label Few-shot Aspect Category Detection30 Jul 2024
- 2024Robust Fast Adaptation from Adversarially Explicit Task Distribution Generation28 Jul 2024
- 2024Prototypical Reward Network for Data-Efficient RLHF6 Jun 2024
- 2024Continual Learning for Autonomous Robots: A Prototype-based Approach30 Mar 2024
- 2024Task Attribute Distance for Few-Shot Learning: Theoretical Analysis and Applications6 Mar 2024
- 2024Graph Contrastive Learning with Low-Rank Regularization and Low-Rank Attention for Noisy Node Classification14 Feb 2024
- 2024Episodic-free Task Selection for Few-shot Learning31 Jan 2024
- 2023Understanding the (Extra-)Ordinary: Validating Deep Model Decisions with Prototypical Concept-based Explanations28 Nov 2023
- 2023Episodic Multi-Task Learning with Heterogeneous Neural Processes28 Oct 2023
- 2023Context-Aware Meta-Learning17 Oct 2023
- 2023In-Context Learning for Few-Shot Molecular Property Prediction13 Oct 2023
- 2023A Simple Yet Effective Strategy to Robustify the Meta Learning Paradigm1 Oct 2023
- 2023A General-Purpose Self-Supervised Model for Computational Pathology29 Aug 2023
- 2023Dual Compensation Residual Networks for Class Imbalanced Learning25 Aug 2023
- 2023On the Robustness of Open-World Test-Time Training: Self-Training with Dynamic Prototype Expansion19 Aug 2023
- 2023Advances and Challenges in Meta-Learning: A Technical Review10 Jul 2023
- 2023ProtoDiff: Learning to Learn Prototypical Networks by Task-Guided Diffusion26 Jun 2023
- 2023SENet: A Spectral Filtering Approach to Represent Exemplars for Few-shot Learning30 May 2023
- 2023EEGMatch: Learning with Incomplete Labels for Semi-Supervised EEG-based Cross-Subject Emotion Recognition27 Mar 2023
- 2023Hubs and Hyperspheres: Reducing Hubness and Improving Transductive Few-shot Learning with Hyperspherical Embeddings16 Mar 2023
- 2023MaskDiff: Modeling Mask Distribution with Diffusion Probabilistic Model for Few-Shot Instance Segmentation9 Mar 2023
- 2023Learning from Mistakes: Self-Regularizing Hierarchical Representations in Point Cloud Semantic Segmentation26 Jan 2023
- 2023Task Weighting in Meta-learning with Trajectory Optimisation4 Jan 2023
- 2022Activating the Discriminability of Novel Classes for Few-shot Segmentation2 Dec 2022
- 2022Prototypical Fine-tuning: Towards Robust Performance Under Varying Data Sizes24 Nov 2022
- 2022Adaptive Prototypical Networks22 Nov 2022
- 2022Self-Supervised 3D Traversability Estimation with Proxy Bank Guidance21 Nov 2022
- 2022Efficient Meta Reinforcement Learning for Preference-based Fast Adaptation20 Nov 2022
- 2022Instance-based Learning for Knowledge Base Completion13 Nov 2022
- 2022Few-shot Classification with Hypersphere Modeling of Prototypes10 Nov 2022
- 2022Meta Learning of Interface Conditions for Multi-Domain Physics-Informed Neural Networks23 Oct 2022
50 newest of 99 All 99 (JSON)
- 2024Prototypical Reward Network for Data-Efficient RLHFcited by 22
- 2024Prototypical Reward Network for Data-Efficient RLHF6 Jun 2024
- 2021Hypercorrelation Squeeze for Few-Shot Segmentationcited by 193
- 2022Self-Support Few-Shot Semantic Segmentationcited by 96
- 2021Relational Embedding for Few-Shot Classificationcited by 74
- 2023Advances and Challenges in Meta-Learning: A Technical Reviewcited by 65
- 2021Exploring Complementary Strengths of Invariant and Equivariant Representations for Few-Shot Learningcited by 56
- 2022HyperTransformer: Model Generation for Supervised and Semi-Supervised Few-Shot Learningcited by 55
- 2021von Mises-Fisher Loss: An Exploration of Embedding Geometries for Supervised Learningcited by 42
- 2023A General-Purpose Self-Supervised Model for Computational Pathologycited by 42
- 2022Novel Class Discovery without Forgettingcited by 39
- 2021Exemplar-Based Open-Set Panoptic Segmentation Networkcited by 37
- 2023On the Robustness of Open-World Test-Time Training: Self-Training with Dynamic Prototype Expansioncited by 34
- 2021A Metalearning Approach for Physics-Informed Neural Networks (PINNs): Application to Parameterized PDEscited by 31
12 most cited of 95 All 95 (JSON)
- 2026Training-Free Spectral Transductive Refinement for Cross-Domain Few-Shot Classification20 Sep 2026
- 2026Which Rules Matter Now? Policy-Centroid Routing Before an Intelligent System Acts31 Aug 2026
- 2025DUPLE: An Intelligent Cross-Deployment Recognition Framework for Fiber-Optic Perimeter Security under Scarce Target Labels22 Nov 2025
- 2025Using predefined vector systems as latent space configuration for neural network supervised training on data with arbitrarily large number of classes5 Oct 2025
- 2025ProtoTS: Learning Hierarchical Prototypes for Explainable Time Series Forecasting27 Sep 2025
- 2025Reshaping the Forward-Forward Algorithm with a Similarity-Based Objective29 Aug 2025
- 2025Efficient Masked Attention Transformer for Few-Shot Classification and Segmentation31 Jul 2025
- 2025Beyond Class Tokens: LLM-guided Dominant Property Mining for Few-shot Classification28 Jul 2025
- 2025Doodle Your Keypoints: Sketch-Based Few-Shot Keypoint Detection10 Jul 2025
- 2025Optimization-Inspired Few-Shot Adaptation for Large Language Models25 May 2025
- 2025Memory-Modular Classification: Learning to Generalize with Memory Replacement8 Apr 2025
- 2025Unbiased Max-Min Embedding Classification for Transductive Few-Shot Learning: Clustering and Classification Are All You Need28 Mar 2025
12 newest of 95 All 95 (JSON)