Hierarchically Structured Meta-learning
Not on the map. Why?
Abstract (arXiv)
In order to learn quickly with few samples, meta-learning utilizes prior knowledge learned from previous tasks. However, a critical challenge in meta-learning is task uncertainty and heterogeneity, which can not be handled via globally sharing knowledge among tasks. In this paper, based on gradient-based meta-learning, we propose a hierarchically structured meta-learning (HSML) algorithm that explicitly tailors the transferable knowledge to different clusters of tasks. Inspired by the way human beings organize knowledge, we resort to a hierarchical task clustering structure to cluster tasks. As a result, the proposed approach not only addresses the challenge via the knowledge customization to different clusters of tasks, but also preserves knowledge generalization among a cluster of similar tasks. To tackle the changing of task relationship, in addition, we extend the hierarchical structure to a continual learning environment. The experimental results show that our approach can achieve state-of-the-art performance in both toy-regression and few-shot image classification problems.
Key facts. Cited by 68 papers in the map (data through 14 Oct 2026). First posted on arXiv 13 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 24; 2022: 16; 2023: 14; 2024: 7; 2025: 4; 2026: 3.
68 papers.
Sort:
By area:
- 2022Learning from Few Examples: A Summary of Approaches to Few-Shot Learningcited by 86
- 2023Advances and Challenges in Meta-Learning: A Technical Reviewcited by 65
- 2021Meta-Learning with Task-Adaptive Loss Function for Few-Shot Learningcited by 49
- 2021Meta-Learning Dynamics Forecasting Using Task Inferencecited by 38
- 2021Meta Discovery: Learning to Discover Novel Classes given Very Limited Datacited by 31
- 2022Gradient-based Bi-level Optimization for Deep Learning: A Surveycited by 26
- 2021How to Train Your MAML to Excel in Few-Shot Classificationcited by 22
- 2021Multimodal Emergent Fake News Detection via Meta Neural Process Networkscited by 21
- 2021An Optimization-Based Meta-Learning Model for MRI Reconstruction with Diverse Datasetcited by 18
- 2024Predicting Configuration Performance in Multiple Environments with Sequential Meta-learningcited by 17
- 2021Meta-Inductive Node Classification across Graphscited by 16
- 2021Few-Shot Learning with a Strong Teachercited by 16
38 more
- 2021Meta-Learning with Neural Tangent Kernelscited by 15
- 2022Tree Structure-Aware Few-Shot Image Classification via Hierarchical Aggregationcited by 14
- 2023Contextual Stochastic Bilevel Optimizationcited by 14
- 2021Conditional Meta-Learning of Linear Representationscited by 12
- 2021Knowledge-Aware Meta-learning for Low-Resource Text Classificationcited by 10
- 2023Glocal Energy-based Learning for Few-Shot Open-Set Recognitioncited by 10
- 2022Multidimensional Belief Quantification for Label-Efficient Meta-Learningcited by 9
- 2022Hierarchically Structured Task-Agnostic Continual Learningcited by 9
- 2022Doing More with Less: Overcoming Data Scarcity for POI Recommendation via Cross-Region Transfercited by 8
- 2022Personalized Federated Learning via Heterogeneous Modular Networkscited by 8
- 2023Towards Anytime Fine-tuning: Continually Pre-trained Language Models with Hypernetwork Promptcited by 8
- 2023Episodic Multi-Task Learning with Heterogeneous Neural Processescited by 8
- 2024Deep Configuration Performance Learning: A Systematic Survey and Taxonomycited by 8
- 2024FREE: Faster and Better Data-Free Meta-Learningcited by 8
- 2021Prototype Completion for Few-Shot Learningcited by 7
- 2022Transfering Hierarchical Structure with Dual Meta Imitation Learningcited by 7
- 2022Neural Collaborative Filtering Bandits via Meta Learningcited by 7
- 2024Meta Clustering of Neural Banditscited by 7
- 2021Few-shot Learning for Topic Modelingcited by 5
- 2021Contextualizing Meta-Learning via Learning to Decomposecited by 5
- 2021Omni-Training: Bridging Pre-Training and Meta-Training for Few-Shot Learningcited by 5
- 2021ST-MAML: A Stochastic-Task based Method for Task-Heterogeneous Meta-Learningcited by 4
- 2023Meta-Reinforcement Learning via Exploratory Task Clusteringcited by 4
- 2023M-L2O: Towards Generalizable Learning-to-Optimize by Test-Time Fast Self-Adaptationcited by 4
- 2022StratDef: Strategic Defense Against Adversarial Attacks in ML-based Malware Detectioncited by 3
- 2023Provable Pathways: Learning Multiple Tasks over Multiple Pathscited by 3
- 2024XB-MAML: Learning Expandable Basis Parameters for Effective Meta-Learning with Wide Task Coveragecited by 3
- 2025CICADA: Cross-Domain Interpretable Coding for Anomaly Detection and Adaptation in Multivariate Time Seriescited by 3
- 2021Meta-Learning with MAML on Treescited by 2
- 2022PAVI: Plate-Amortized Variational Inferencecited by 2
- 2022Robust Meta-Representation Learning via Global Label Inference and Classificationcited by 2
- 2023EMO: Episodic Memory Optimization for Few-Shot Meta-Learningcited by 2
- 2024Atomas: Hierarchical Alignment on Molecule-Text for Unified Molecule Understanding and Generationcited by 2
- 2025Tailored Forecasting from Short Time Series via Meta-learningcited by 2
- 2021Generalising via Meta-Examples for Continual Learning in the Wildcited by 1
- 2021Meta-learning for Matrix Factorization without Shared Rows or Columnscited by 1
- 2021A Meta-learning Approach to Reservoir Computing: Time Series Prediction with Limited Datacited by 1
- 2022EEML: Ensemble Embedded Meta-learningcited by 1
50 most cited of 68 All 68 (JSON)
- 2026Effect of Spherical Parameter Space on Number of Non-Forgetting Tasks and Capacity of Continual Learning12 Oct 2026
- 2026RecBundle: A Next-Generation Geometric Paradigm for Explainable Recommender Systems17 Mar 2026
- 2026Bayesian Meta-Learning with Expert Feedback for Task-Shift Adaptation through Causal Embeddings23 Feb 2026
- 2025Task-Level Contrastiveness for Cross-Domain Few-Shot Learning3 Oct 2025
- 2025Improving Learning of New Diseases through Knowledge-Enhanced Initialization for Federated Adapter Tuning14 Aug 2025
- 2025CICADA: Cross-Domain Interpretable Coding for Anomaly Detection and Adaptation in Multivariate Time Series1 May 2025
- 2025Tailored Forecasting from Short Time Series via Meta-learning27 Jan 2025
- 2024Meta Clustering of Neural Bandits10 Aug 2024
- 2024Communication-Efficient and Privacy-Preserving Decentralized Meta-Learning19 Jun 2024
- 2024FREE: Faster and Better Data-Free Meta-Learning2 May 2024
- 2024Atomas: Hierarchical Alignment on Molecule-Text for Unified Molecule Understanding and Generation23 Apr 2024
- 2024XB-MAML: Learning Expandable Basis Parameters for Effective Meta-Learning with Wide Task Coverage11 Mar 2024
38 more
- 2024Deep Configuration Performance Learning: A Systematic Survey and Taxonomy5 Mar 2024
- 2024Predicting Configuration Performance in Multiple Environments with Sequential Meta-learning5 Feb 2024
- 2023Exploring intra-task relations to improve meta-learning algorithms27 Dec 2023
- 2023Episodic Multi-Task Learning with Heterogeneous Neural Processes28 Oct 2023
- 2023Contextual Stochastic Bilevel Optimization27 Oct 2023
- 2023Towards Anytime Fine-tuning: Continually Pre-trained Language Models with Hypernetwork Prompt19 Oct 2023
- 2023Dual Adversarial Alignment for Realistic Support-Query Shift Few-shot Learning5 Sep 2023
- 2023PAVI: Plate-Amortized Variational Inference30 Aug 2023
- 2023Advances and Challenges in Meta-Learning: A Technical Review10 Jul 2023
- 2023EMO: Episodic Memory Optimization for Few-Shot Meta-Learning8 Jun 2023
- 2023Glocal Energy-based Learning for Few-Shot Open-Set Recognition24 Apr 2023
- 2023Provable Pathways: Learning Multiple Tasks over Multiple Paths8 Mar 2023
- 2023M-L2O: Towards Generalizable Learning-to-Optimize by Test-Time Fast Self-Adaptation28 Feb 2023
- 2023Meta-Reinforcement Learning via Exploratory Task Clustering15 Feb 2023
- 2023Effectiveness of Moving Target Defenses for Adversarial Attacks in ML-based Malware Detection1 Feb 2023
- 2023Concept Discovery for Fast Adapatation19 Jan 2023
- 2022Robust Meta-Representation Learning via Global Label Inference and Classification22 Dec 2022
- 2022Hierarchically Structured Task-Agnostic Continual Learning14 Nov 2022
- 2022Personalized Federated Learning via Heterogeneous Modular Networks26 Oct 2022
- 2022MAC: A Meta-Learning Approach for Feature Learning and Recombination20 Sep 2022
- 2022Contrastive Knowledge-Augmented Meta-Learning for Few-Shot Classification25 Jul 2022
- 2022Gradient-based Bi-level Optimization for Deep Learning: A Survey24 Jul 2022
- 2022Tree Structure-Aware Few-Shot Image Classification via Hierarchical Aggregation14 Jul 2022
- 2022EEML: Ensemble Embedded Meta-learning18 Jun 2022
- 2022PAVI: Plate-Amortized Variational Inference10 Jun 2022
- 2022Learning to generate imaginary tasks for improving generalization in meta-learning9 Jun 2022
- 2022Multidimensional Belief Quantification for Label-Efficient Meta-Learning23 Mar 2022
- 2022Learning from Few Examples: A Summary of Approaches to Few-Shot Learning7 Mar 2022
- 2022StratDef: Strategic Defense Against Adversarial Attacks in ML-based Malware Detection15 Feb 2022
- 2022Neural Collaborative Filtering Bandits via Meta Learning31 Jan 2022
- 2022Transfering Hierarchical Structure with Dual Meta Imitation Learning28 Jan 2022
- 2022Doing More with Less: Overcoming Data Scarcity for POI Recommendation via Cross-Region Transfer16 Jan 2022
- 2021Omni-Training: Bridging Pre-Training and Meta-Training for Few-Shot Learning14 Oct 2021
- 2021Meta-Learning with Task-Adaptive Loss Function for Few-Shot Learning8 Oct 2021
- 2021A Meta-learning Approach to Reservoir Computing: Time Series Prediction with Limited Data7 Oct 2021
- 2021An Optimization-Based Meta-Learning Model for MRI Reconstruction with Diverse Dataset2 Oct 2021
- 2021ST-MAML: A Stochastic-Task based Method for Task-Heterogeneous Meta-Learning27 Sep 2021
- 2021Knowledge-Aware Meta-learning for Low-Resource Text Classification10 Sep 2021
50 newest of 68 All 68 (JSON)
- 2022Learning from Few Examples: A Summary of Approaches to Few-Shot Learningcited by 86
- 2023Advances and Challenges in Meta-Learning: A Technical Reviewcited by 65
- 2021Meta-Learning with Task-Adaptive Loss Function for Few-Shot Learningcited by 49
- 2021Meta-Learning Dynamics Forecasting Using Task Inferencecited by 38
- 2021Meta Discovery: Learning to Discover Novel Classes given Very Limited Datacited by 31
- 2022Gradient-based Bi-level Optimization for Deep Learning: A Surveycited by 26
- 2021How to Train Your MAML to Excel in Few-Shot Classificationcited by 22
- 2021Multimodal Emergent Fake News Detection via Meta Neural Process Networkscited by 21
- 2021An Optimization-Based Meta-Learning Model for MRI Reconstruction with Diverse Datasetcited by 18
- 2024Predicting Configuration Performance in Multiple Environments with Sequential Meta-learningcited by 17
- 2021Meta-Inductive Node Classification across Graphscited by 16
- 2021Few-Shot Learning with a Strong Teachercited by 16
12 most cited of 67 All 67 (JSON)
- 2026Effect of Spherical Parameter Space on Number of Non-Forgetting Tasks and Capacity of Continual Learning12 Oct 2026
- 2026RecBundle: A Next-Generation Geometric Paradigm for Explainable Recommender Systems17 Mar 2026
- 2026Bayesian Meta-Learning with Expert Feedback for Task-Shift Adaptation through Causal Embeddings23 Feb 2026
- 2025Task-Level Contrastiveness for Cross-Domain Few-Shot Learning3 Oct 2025
- 2025Improving Learning of New Diseases through Knowledge-Enhanced Initialization for Federated Adapter Tuning14 Aug 2025
- 2025CICADA: Cross-Domain Interpretable Coding for Anomaly Detection and Adaptation in Multivariate Time Series1 May 2025
- 2025Tailored Forecasting from Short Time Series via Meta-learning27 Jan 2025
- 2024Meta Clustering of Neural Bandits10 Aug 2024
- 2024Communication-Efficient and Privacy-Preserving Decentralized Meta-Learning19 Jun 2024
- 2024FREE: Faster and Better Data-Free Meta-Learning2 May 2024
- 2024Atomas: Hierarchical Alignment on Molecule-Text for Unified Molecule Understanding and Generation23 Apr 2024
- 2024XB-MAML: Learning Expandable Basis Parameters for Effective Meta-Learning with Wide Task Coverage11 Mar 2024
12 newest of 67 All 67 (JSON)