mlsanityData to 7 Oct 2026

MoEMeta: Mixture-of-Experts Meta Learning for Few-Shot Relational Learning

arXiv 2510.23013 ↗First posted 27 Oct 2025cs.LG cs.AIcited by 1

On the map: Mixture-of-experts → Mixture of LoRA experts

Abstract (arXiv)

Few-shot knowledge graph relational learning seeks to perform reasoning over relations given only a limited number of training examples. While existing approaches largely adopt a meta-learning framework for enabling fast adaptation to new relations, they suffer from two key pitfalls. First, they learn relation meta-knowledge in isolation, failing to capture common relational patterns shared across tasks. Second, they struggle to effectively incorporate local, task-specific contexts crucial for rapid adaptation. To address these limitations, we propose MoEMeta, a novel meta-learning framework that disentangles globally shared knowledge from task-specific contexts to enable both effective model generalization and rapid adaptation. MoEMeta introduces two key innovations: (i) a mixture-of-experts (MoE) model that learns globally shared relational prototypes to enhance generalization, and (ii) a task-tailored adaptation mechanism that captures local contexts for fast task-specific adaptation. By balancing global generalization with local adaptability, MoEMeta significantly advances few-shot relational learning. Extensive experiments and analyses on three KG benchmarks show that MoEMeta consistently outperforms existing baselines, achieving state-of-the-art performance.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Mixture of LoRA experts, one of 12 directions in Mixture-of-experts. Builds on 26 of its 50 references that are in the map. First posted on arXiv 27 Oct 2025.

Builds on

26 of 50 references.

References · 26

  1. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
  2. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
  3. 2017Prototypical Networks for Few-shot Learningcited by 3,001
  4. 2016Matching Networks for One Shot Learningcited by 2,246
  5. 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 929
  6. 2016Complex Embeddings for Simple Link Predictioncited by 897
  7. 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 893
  8. 2022Mixture-of-Experts with Expert Choice Routingcited by 611
  9. 2018Meta-Learning for Semi-Supervised Few-Shot Classificationcited by 456
  10. 2018Probabilistic Model-Agnostic Meta-Learningcited by 254
  11. 2023From Sparse to Soft Mixtures of Expertscited by 245
  12. 2018Canonical Tensor Decomposition for Knowledge Base Completioncited by 150
14 more
  1. 2019Multimodal Model-Agnostic Meta-Learning via Task-Aware Modulationcited by 103
  2. 2019Finding Task-Relevant Features for Few-Shot Learning by Category Traversalcited by 101
  3. 2019Unifying Knowledge Graph Learning and Recommendation: Towards a Better Understanding of User Preferencescited by 87
  4. 2018One-Shot Relational Learning for Knowledge Graphscited by 78
  5. 2019Meta Relational Learning for Few-Shot Link Prediction in Knowledge Graphscited by 73
  6. 2019Few-Shot Knowledge Graph Completioncited by 63
  7. 2015Ask Me Anything: Free-form Visual Question Answering Based on Knowledge from External Sourcescited by 42
  8. 2020Adaptive Attentional Network for Few-Shot Knowledge Graph Completioncited by 42
  9. 2021Learning where to learn: Gradient sparsity in meta and continual learningcited by 33
  10. 2021Relational Learning with Gated and Attentive Neighbor Aggregator for Few-Shot Knowledge Graph Completioncited by 32
  11. 2021Revisit Multimodal Meta-Learning through the Lens of Multi-Task Learningcited by 22
  12. 2022Few-shot Relational Reasoning via Connection Subgraph Pretrainingcited by 18
  13. 2023Graph Contrastive Learning Meets Graph Meta Learning: A Unified Method for Few-shot Node Taskscited by 3
  14. 2024Context-Aware Adapter Tuning for Few-Shot Relation Learning in Knowledge Graphscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Adaptive Shared Experts with LoRA-Based Mixture of Experts for Multi-Task Learning
  2. 2022Learning Meta Representations of One-shot Relations for Temporal Knowledge Graph Link Prediction
  3. 2023Chain of Thought with Explicit Evidence Reasoning for Few-shot Relation Extraction
  4. 2022Learning to Sample and Aggregate: Few-shot Reasoning over Temporal Knowledge Graphs
  5. 2026Harnessing Domain Specialists in Multimodal Mixture-of-Experts for Efficient Adaptation
  6. 2025Unveiling Hidden Collaboration within Mixture-of-Experts in Large Language Models
  7. 2024Leveraging Open Knowledge for Advancing Task Expertise in Large Language Models
  8. 2025Each Rank Could be an Expert: Single-Ranked Mixture of Experts LoRA for Multi-Task Learning