Mixture of Length and Pruning Experts for Knowledge Graphs Reasoning
Not on the map. Why?
Abstract (arXiv)
Knowledge Graph (KG) reasoning, which aims to infer new facts from structured knowledge repositories, plays a vital role in Natural Language Processing (NLP) systems. Its effectiveness critically depends on constructing informative and contextually relevant reasoning paths. However, existing graph neural networks (GNNs) often adopt rigid, query-agnostic path-exploration strategies, limiting their ability to adapt to diverse linguistic contexts and semantic nuances. To address these limitations, we propose MoKGR, a mixture-of-experts framework that personalizes path exploration through two complementary components: (1) a mixture of length experts that adaptively selects and weights candidate path lengths according to query complexity, providing query-specific reasoning depth; and (2) a mixture of pruning experts that evaluates candidate paths from a complementary perspective, retaining the most informative paths for each query. Through comprehensive experiments on diverse benchmark, MoKGR demonstrates superior performance in both transductive and inductive settings, validating the effectiveness of personalized path exploration in KGs reasoning.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 40 of its 60 references that are in the map. First posted on arXiv 28 Jul 2025.
Builds on
40 of 60 references.
References · 40
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,739
- 2020GShard: Scaling Giant Models with Conditional Computation and Automatic Shardingcited by 1,631
- 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 898
- 2021Scaling Vision with Sparse Mixture of Expertscited by 747
- 2017Convolutional 2D Knowledge Graph Embeddingscited by 730
- 2020A Survey on Knowledge Graphs: Representation, Acquisition and Applicationscited by 643
- 2019Composition-based Multi-Relational Graph Convolutional Networkscited by 396
- 2021Neural Bellman-Ford Networks: A General Graph Neural Network Framework for Link Predictioncited by 275
- 2017DeepPath: A Reinforcement Learning Method for Knowledge Graph Reasoningcited by 266
- 2015A Review of Relational Machine Learning for Knowledge Graphscited by 265
- 2019Inductive Relation Prediction by Subgraph Reasoningcited by 239
28 more
- 2022Multimodal Contrastive Learning with LIMoE: the Language-Image Mixture of Expertscited by 203
- 2019Quaternion Knowledge Graph Embeddingscited by 175
- 2019DRUM: End-To-End Differentiable Rule Mining On Knowledge Graphscited by 175
- 2017Go for a Walk and Arrive at the Answer: Reasoning Over Paths in Knowledge Bases using Reinforcement Learningcited by 161
- 2020RNNLogic: Learning Logic Rules for Reasoning on Knowledge Graphscited by 118
- 2022A Survey of Knowledge Graph Reasoning on Graph Types: Static, Dynamic, and Multimodalcited by 106
- 2023Graph Mixture of Experts: Learning on Large-Scale Graphs with Explicit Diversity Modelingcited by 64
- 2022Uni-Perceiver-MoE: Learning Sparse Generalist Models with Conditional MoEscited by 58
- 2020Communicative Message Passing for Inductive Relation Reasoningcited by 54
- 2022A*Net: A Scalable Path-based Reasoning Approach for Knowledge Graphscited by 49
- 2018NSCaching: Simple and Efficient Negative Sampling for Knowledge Graph Embeddingcited by 42
- 2019AutoSF: Searching Scoring Functions for Knowledge Graph Embeddingcited by 34
- 2024RAG-Instruct: Boosting LLMs with Diverse Retrieval-Augmented Instructionscited by 25
- 2020Reinforced Anytime Bottom Up Rule Learning for Knowledge Graph Completioncited by 24
- 2023Emerging Drug Interaction Prediction Enabled by Flow-based Graph Neural Network with Biomedical Networkcited by 24
- 2025Diffusion vs. Autoregressive Language Models: A Text Embedding Perspectivecited by 23
- 2025Towards Understanding Fine-Tuning Mechanisms of LLMs via Circuit Analysiscited by 20
- 2022Diversifying Content Generation for Commonsense Reasoning with Mixture of Knowledge Graph Expertscited by 19
- 2024Dual Reasoning: A GNN-LLM Collaborative Framework for Knowledge Graph Question Answeringcited by 19
- 2025GraphMaster: Automated Graph Synthesis via LLM Agents in Data-Limited Environmentscited by 19
- 2024Graph Sparsification via Mixture of Graphscited by 17
- 2025QFFT, Question-Free Fine-Tuning for Adaptive Reasoningcited by 15
- 2021Bilinear Scoring Function Search for Knowledge Graph Learningcited by 11
- 2024SynTQA: Synergistic Table-based Question Answering via Mixture of Text-to-SQL and E2E TQAcited by 9
- 2021Efficient Relation-aware Scoring Function Search for Knowledge Graph Embeddingcited by 8
- 2023Understanding Expressivity of GNN in Rule Learningcited by 7
- 2025MLDebugging: Towards Benchmarking Code Debugging Across Multi-Library Scenarioscited by 3
- 2023Relation-aware Ensemble Learning for Knowledge Graph Embeddingcited by 2
Built on by
Citing papers per year: 2025: 2; 2026: 3.
5 papers.
- 2025Octopus: Agentic Multimodal Reasoning with Six-Capability Orchestrationcited by 9
- 2025VideoSeg-R1:Reasoning Video Object Segmentation via Reinforcement Learningcited by 6
- 2026EviRank: Structured Relevance Evidence for Multimodal Image Re-rankingcited by 2
- 2026SnapBench: Benchmarking Snap-and-Ask Multimodal Retrieval for Mobile Interactionscited by 2
- 2026CARA: Concept-Aware Risk Attention for Interpretable Collision Anticipationcited by 0
- 2026SnapBench: Benchmarking Snap-and-Ask Multimodal Retrieval for Mobile Interactions30 Aug 2026
- 2026EviRank: Structured Relevance Evidence for Multimodal Image Re-ranking21 Aug 2026
- 2026CARA: Concept-Aware Risk Attention for Interpretable Collision Anticipation24 Jul 2026
- 2025VideoSeg-R1:Reasoning Video Object Segmentation via Reinforcement Learning20 Nov 2025
- 2025Octopus: Agentic Multimodal Reasoning with Six-Capability Orchestration19 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2024Paths-over-Graph: Knowledge Graph Empowered Large Language Model Reasoning
- 2025PathMind: A Retrieve-Prioritize-Reason Framework for Knowledge Graph Reasoning with Large Language Models
- 2026MoG: Mixture of Experts for Graph-based Retrieval-Augmented Generation
- 2025Search-on-Graph: Iterative Informed Navigation for Large Language Model Reasoning on Knowledge Graphs
- 2025Reliable Reasoning Path: Distilling Effective Guidance for LLM Reasoning with Knowledge Graphs
- 2023KG-GPT: A General Framework for Reasoning on Knowledge Graphs Using Large Language Models
- 2024KARPA: A Training-free Method of Adapting Knowledge Graph as References for Large Language Model's Reasoning Path Aggregation
- 2026Explore-on-Graph: Incentivizing Autonomous Exploration of Large Language Models on Knowledge Graphs with Path-refined Reward Modeling