MoEMeta: Mixture-of-Experts Meta Learning for Few-Shot Relational Learning
On the map: Mixture-of-experts → Mixture of LoRA experts
Abstract (arXiv)
Few-shot knowledge graph relational learning seeks to perform reasoning over relations given only a limited number of training examples. While existing approaches largely adopt a meta-learning framework for enabling fast adaptation to new relations, they suffer from two key pitfalls. First, they learn relation meta-knowledge in isolation, failing to capture common relational patterns shared across tasks. Second, they struggle to effectively incorporate local, task-specific contexts crucial for rapid adaptation. To address these limitations, we propose MoEMeta, a novel meta-learning framework that disentangles globally shared knowledge from task-specific contexts to enable both effective model generalization and rapid adaptation. MoEMeta introduces two key innovations: (i) a mixture-of-experts (MoE) model that learns globally shared relational prototypes to enhance generalization, and (ii) a task-tailored adaptation mechanism that captures local contexts for fast task-specific adaptation. By balancing global generalization with local adaptability, MoEMeta significantly advances few-shot relational learning. Extensive experiments and analyses on three KG benchmarks show that MoEMeta consistently outperforms existing baselines, achieving state-of-the-art performance.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Mixture of LoRA experts, one of 12 directions in Mixture-of-experts. Builds on 26 of its 50 references that are in the map. First posted on arXiv 27 Oct 2025.
Builds on
26 of 50 references.
References · 26
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
- 2017Prototypical Networks for Few-shot Learningcited by 3,001
- 2016Matching Networks for One Shot Learningcited by 2,246
- 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 929
- 2016Complex Embeddings for Simple Link Predictioncited by 897
- 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 893
- 2022Mixture-of-Experts with Expert Choice Routingcited by 611
- 2018Meta-Learning for Semi-Supervised Few-Shot Classificationcited by 456
- 2018Probabilistic Model-Agnostic Meta-Learningcited by 254
- 2023From Sparse to Soft Mixtures of Expertscited by 245
- 2018Canonical Tensor Decomposition for Knowledge Base Completioncited by 150
14 more
- 2019Multimodal Model-Agnostic Meta-Learning via Task-Aware Modulationcited by 103
- 2019Finding Task-Relevant Features for Few-Shot Learning by Category Traversalcited by 101
- 2019Unifying Knowledge Graph Learning and Recommendation: Towards a Better Understanding of User Preferencescited by 87
- 2018One-Shot Relational Learning for Knowledge Graphscited by 78
- 2019Meta Relational Learning for Few-Shot Link Prediction in Knowledge Graphscited by 73
- 2019Few-Shot Knowledge Graph Completioncited by 63
- 2015Ask Me Anything: Free-form Visual Question Answering Based on Knowledge from External Sourcescited by 42
- 2020Adaptive Attentional Network for Few-Shot Knowledge Graph Completioncited by 42
- 2021Learning where to learn: Gradient sparsity in meta and continual learningcited by 33
- 2021Relational Learning with Gated and Attentive Neighbor Aggregator for Few-Shot Knowledge Graph Completioncited by 32
- 2021Revisit Multimodal Meta-Learning through the Lens of Multi-Task Learningcited by 22
- 2022Few-shot Relational Reasoning via Connection Subgraph Pretrainingcited by 18
- 2023Graph Contrastive Learning Meets Graph Meta Learning: A Unified Method for Few-shot Node Taskscited by 3
- 2024Context-Aware Adapter Tuning for Few-Shot Relation Learning in Knowledge Graphscited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Adaptive Shared Experts with LoRA-Based Mixture of Experts for Multi-Task Learning
- 2022Learning Meta Representations of One-shot Relations for Temporal Knowledge Graph Link Prediction
- 2023Chain of Thought with Explicit Evidence Reasoning for Few-shot Relation Extraction
- 2022Learning to Sample and Aggregate: Few-shot Reasoning over Temporal Knowledge Graphs
- 2026Harnessing Domain Specialists in Multimodal Mixture-of-Experts for Efficient Adaptation
- 2025Unveiling Hidden Collaboration within Mixture-of-Experts in Large Language Models
- 2024Leveraging Open Knowledge for Advancing Task Expertise in Large Language Models
- 2025Each Rank Could be an Expert: Single-Ranked Mixture of Experts LoRA for Multi-Task Learning