mlsanityData to 7 Oct 2026

Normalizing Flow-based Neural Process for Few-Shot Knowledge Graph Completion

arXiv 2304.08183 ↗First posted 17 Apr 2023cs.IR cs.AIcited by 19

Not on the map. Why?

Abstract (arXiv)

Knowledge graphs (KGs), as a structured form of knowledge representation, have been widely applied in the real world. Recently, few-shot knowledge graph completion (FKGC), which aims to predict missing facts for unseen relations with few-shot associated facts, has attracted increasing attention from practitioners and researchers. However, existing FKGC methods are based on metric learning or meta-learning, which often suffer from the out-of-distribution and overfitting problems. Meanwhile, they are incompetent at estimating uncertainties in predictions, which is critically important as model predictions could be very unreliable in few-shot settings. Furthermore, most of them cannot handle complex relations and ignore path information in KGs, which largely limits their performance. In this paper, we propose a normalizing flow-based neural process for few-shot knowledge graph completion (NP-FKGC). Specifically, we unify normalizing flows and neural processes to model a complex distribution of KG completion functions. This offers a novel way to predict facts for few-shot relations while estimating the uncertainty. Then, we propose a stochastic ManifoldE decoder to incorporate the neural process and handle complex relations in few-shot settings. To further improve performance, we introduce an attentive relation path-based graph neural network to capture path information in KGs. Extensive experiments on three public datasets demonstrate that our method significantly outperforms the existing FKGC methods and achieves state-of-the-art performance. Code is available at https://github.com/RManLuo/NP-FKGC.git.

Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). Builds on 45 of its 67 references that are in the map. First posted on arXiv 17 Apr 2023.

Builds on

45 of 67 references.

References · 45

  1. 2015Variational Inference with Normalizing Flowscited by 2,161
  2. 2016Density estimation using Real NVPcited by 2,029
  3. 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,539
  4. 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,315
  5. 2016Complex Embeddings for Simple Link Predictioncited by 897
  6. 2017Masked Autoregressive Flow for Density Estimationcited by 680
  7. 2020A Survey on Knowledge Graphs: Representation, Acquisition and Applicationscited by 643
  8. 2016Improving Variational Inference with Inverse Autoregressive Flowcited by 636
  9. 2018Conditional Neural Processescited by 421
  10. 2018Neural Processescited by 307
  11. 2018How to train your MAMLcited by 306
  12. 2019Attentive Neural Processescited by 280
33 more
  1. 2021Neural Bellman-Ford Networks: A General Graph Neural Network Framework for Link Predictioncited by 273
  2. 2021Identity-aware Graph Neural Networkscited by 197
  3. 2017Variational Reasoning for Question Answering with Knowledge Graphcited by 170
  4. 2022Federated Learning on Non-IID Graphs via Structural Knowledge Sharingcited by 88
  5. 2019Preventing Posterior Collapse with delta-VAEscited by 86
  6. 2018One-Shot Relational Learning for Knowledge Graphscited by 78
  7. 2019Meta Relational Learning for Few-Shot Link Prediction in Knowledge Graphscited by 73
  8. 2022Multivariate Time Series Forecasting with Dynamic Graph Neural ODEscited by 72
  9. 2019Multi-Task Feature Learning for Knowledge Graph Enhanced Recommendationcited by 70
  10. 2022Rethinking and Scaling Up Graph Contrastive Learning: An Extremely Efficient Approach with Group Discriminationcited by 67
  11. 2019Few-Shot Knowledge Graph Completioncited by 63
  12. 2013A Semantic Matching Energy Function for Learning with Multi-relational Datacited by 61
  13. 2020Relational Message Passing for Knowledge Graph Completioncited by 61
  14. 2021Neural ODE Processescited by 57
  15. 2022Beyond Smoothing: Unsupervised Graph Representation Learning with Edge Heterophily Discriminatingcited by 57
  16. 2019Sequential Neural Processescited by 55
  17. 2022GOOD-D: On Unsupervised Graph Out-Of-Distribution Detectioncited by 47
  18. 2020Adaptive Attentional Network for Few-Shot Knowledge Graph Completioncited by 42
  19. 2020MAMO: Memory-Augmented Meta-Optimization for Cold-start Recommendationcited by 38
  20. 2021Task-adaptive Neural Process for User Cold-Start Recommendationcited by 32
  21. 2021Relational Learning with Gated and Attentive Neighbor Aggregator for Few-Shot Knowledge Graph Completioncited by 32
  22. 2020Equivariant Learning of Stochastic Fields: Gaussian Processes and Steerable Conditional Neural Processescited by 29
  23. 2022Ultrahyperbolic Knowledge Graph Embeddingscited by 20
  24. 2015From One Point to A Manifold: Knowledge Graph Embedding For Precise Link Predictioncited by 19
  25. 2022Few-shot Relational Reasoning via Connection Subgraph Pretrainingcited by 18
  26. 2022Neural Processes with Stochastic Attention: Paying more attention to the context datasetcited by 16
  27. 2021Detecting Communities from Heterogeneous Graphs: A Context Path-based Graph Neural Network Modelcited by 15
  28. 2022Graph Sequential Neural ODE Process for Link Prediction on Dynamic and Sparse Graphscited by 13
  29. 2020Uncertainty-Aware Few-Shot Image Classificationcited by 9
  30. 2020Message Passing Neural Processescited by 8
  31. 2020Variational Neural Machine Translation with Normalizing Flowscited by 7
  32. 2021How Neural Processes Improve Graph Link Predictioncited by 6
  33. 2020Uncertainty in Neural Processescited by 4

Built on by

Cited by year

Citing papers per year: 2023: 12; 2024: 4; 2025: 3.

19 papers.

Sort:

By area:

  1. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
  2. 2023Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoningcited by 326
  3. 2023Learning Strong Graph Neural Networks with Weak Informationcited by 25
  4. 2023Finding the Missing-half: Graph Complementary Learning for Homophily-prone and Heterophily-prone Graphscited by 25
  5. 2023Boosting Few-shot 3D Point Cloud Segmentation via Query-Guided Enhancementcited by 19
  6. 2023GNNEvaluator: Evaluating GNN Performance On Unseen Graphs Without Labelscited by 17
  7. 2023AutoKG: Efficient Automated Knowledge Graph Generation for Language Modelscited by 17
  8. 2024Graph Learning under Distribution Shifts: A Comprehensive Survey on Domain Adaptation, Out-of-distribution, and Continual Learningcited by 17
  9. 2023A Survey of Imbalanced Learning on Graphs: Problems, Techniques, and Future Directionscited by 15
  10. 2023A Survey on Temporal Knowledge Graph Completion: Taxonomy, Progress, and Prospectscited by 14
  11. 2024Online GNN Evaluation Under Test-time Graph Distribution Shiftscited by 12
  12. 2023Towards Expressive Spectral-Temporal Graph Neural Networks for Time Series Forecastingcited by 8
7 more
  1. 2023Structure Guided Multi-modal Pre-trained Transformer for Knowledge Graph Reasoningcited by 8
  2. 2024A Survey of Few-Shot Learning on Graphs: from Meta-Learning to Pre-Training and Prompt Learningcited by 5
  3. 2023Towards Few-shot Inductive Link Prediction on Knowledge Graphs: A Relational Anonymous Walk-guided Neural Process Approachcited by 4
  4. 2024R'enyi Neural Processescited by 1
  5. 2025ReCDAP: Relation-Based Conditional Diffusion with Attention Pooling for Few-Shot Knowledge Graph Completioncited by 0
  6. 2025Conjugate Relation Modeling for Few-Shot Knowledge Graph Completioncited by 0
  7. 2025TA-KAND: Two-stage Attention Triple Enhancement and U-KAN based Diffusion For Few-shot Knowledge Graph Completioncited by 0