Normalizing Flow-based Neural Process for Few-Shot Knowledge Graph Completion
Not on the map. Why?
Abstract (arXiv)
Knowledge graphs (KGs), as a structured form of knowledge representation, have been widely applied in the real world. Recently, few-shot knowledge graph completion (FKGC), which aims to predict missing facts for unseen relations with few-shot associated facts, has attracted increasing attention from practitioners and researchers. However, existing FKGC methods are based on metric learning or meta-learning, which often suffer from the out-of-distribution and overfitting problems. Meanwhile, they are incompetent at estimating uncertainties in predictions, which is critically important as model predictions could be very unreliable in few-shot settings. Furthermore, most of them cannot handle complex relations and ignore path information in KGs, which largely limits their performance. In this paper, we propose a normalizing flow-based neural process for few-shot knowledge graph completion (NP-FKGC). Specifically, we unify normalizing flows and neural processes to model a complex distribution of KG completion functions. This offers a novel way to predict facts for few-shot relations while estimating the uncertainty. Then, we propose a stochastic ManifoldE decoder to incorporate the neural process and handle complex relations in few-shot settings. To further improve performance, we introduce an attentive relation path-based graph neural network to capture path information in KGs. Extensive experiments on three public datasets demonstrate that our method significantly outperforms the existing FKGC methods and achieves state-of-the-art performance. Code is available at https://github.com/RManLuo/NP-FKGC.git.
Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). Builds on 45 of its 67 references that are in the map. First posted on arXiv 17 Apr 2023.
Builds on
45 of 67 references.
References · 45
- 2015Variational Inference with Normalizing Flowscited by 2,161
- 2016Density estimation using Real NVPcited by 2,029
- 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,539
- 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,315
- 2016Complex Embeddings for Simple Link Predictioncited by 897
- 2017Masked Autoregressive Flow for Density Estimationcited by 680
- 2020A Survey on Knowledge Graphs: Representation, Acquisition and Applicationscited by 643
- 2016Improving Variational Inference with Inverse Autoregressive Flowcited by 636
- 2018Conditional Neural Processescited by 421
- 2018Neural Processescited by 307
- 2018How to train your MAMLcited by 306
- 2019Attentive Neural Processescited by 280
33 more
- 2021Neural Bellman-Ford Networks: A General Graph Neural Network Framework for Link Predictioncited by 273
- 2021Identity-aware Graph Neural Networkscited by 197
- 2017Variational Reasoning for Question Answering with Knowledge Graphcited by 170
- 2022Federated Learning on Non-IID Graphs via Structural Knowledge Sharingcited by 88
- 2019Preventing Posterior Collapse with delta-VAEscited by 86
- 2018One-Shot Relational Learning for Knowledge Graphscited by 78
- 2019Meta Relational Learning for Few-Shot Link Prediction in Knowledge Graphscited by 73
- 2022Multivariate Time Series Forecasting with Dynamic Graph Neural ODEscited by 72
- 2019Multi-Task Feature Learning for Knowledge Graph Enhanced Recommendationcited by 70
- 2022Rethinking and Scaling Up Graph Contrastive Learning: An Extremely Efficient Approach with Group Discriminationcited by 67
- 2019Few-Shot Knowledge Graph Completioncited by 63
- 2013A Semantic Matching Energy Function for Learning with Multi-relational Datacited by 61
- 2020Relational Message Passing for Knowledge Graph Completioncited by 61
- 2021Neural ODE Processescited by 57
- 2022Beyond Smoothing: Unsupervised Graph Representation Learning with Edge Heterophily Discriminatingcited by 57
- 2019Sequential Neural Processescited by 55
- 2022GOOD-D: On Unsupervised Graph Out-Of-Distribution Detectioncited by 47
- 2020Adaptive Attentional Network for Few-Shot Knowledge Graph Completioncited by 42
- 2020MAMO: Memory-Augmented Meta-Optimization for Cold-start Recommendationcited by 38
- 2021Task-adaptive Neural Process for User Cold-Start Recommendationcited by 32
- 2021Relational Learning with Gated and Attentive Neighbor Aggregator for Few-Shot Knowledge Graph Completioncited by 32
- 2020Equivariant Learning of Stochastic Fields: Gaussian Processes and Steerable Conditional Neural Processescited by 29
- 2022Ultrahyperbolic Knowledge Graph Embeddingscited by 20
- 2015From One Point to A Manifold: Knowledge Graph Embedding For Precise Link Predictioncited by 19
- 2022Few-shot Relational Reasoning via Connection Subgraph Pretrainingcited by 18
- 2022Neural Processes with Stochastic Attention: Paying more attention to the context datasetcited by 16
- 2021Detecting Communities from Heterogeneous Graphs: A Context Path-based Graph Neural Network Modelcited by 15
- 2022Graph Sequential Neural ODE Process for Link Prediction on Dynamic and Sparse Graphscited by 13
- 2020Uncertainty-Aware Few-Shot Image Classificationcited by 9
- 2020Message Passing Neural Processescited by 8
- 2020Variational Neural Machine Translation with Normalizing Flowscited by 7
- 2021How Neural Processes Improve Graph Link Predictioncited by 6
- 2020Uncertainty in Neural Processescited by 4
Built on by
Citing papers per year: 2023: 12; 2024: 4; 2025: 3.
19 papers.
Sort:
By area:
- 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
- 2023Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoningcited by 326
- 2023Learning Strong Graph Neural Networks with Weak Informationcited by 25
- 2023Finding the Missing-half: Graph Complementary Learning for Homophily-prone and Heterophily-prone Graphscited by 25
- 2023Boosting Few-shot 3D Point Cloud Segmentation via Query-Guided Enhancementcited by 19
- 2023GNNEvaluator: Evaluating GNN Performance On Unseen Graphs Without Labelscited by 17
- 2023AutoKG: Efficient Automated Knowledge Graph Generation for Language Modelscited by 17
- 2024Graph Learning under Distribution Shifts: A Comprehensive Survey on Domain Adaptation, Out-of-distribution, and Continual Learningcited by 17
- 2023A Survey of Imbalanced Learning on Graphs: Problems, Techniques, and Future Directionscited by 15
- 2023A Survey on Temporal Knowledge Graph Completion: Taxonomy, Progress, and Prospectscited by 14
- 2024Online GNN Evaluation Under Test-time Graph Distribution Shiftscited by 12
- 2023Towards Expressive Spectral-Temporal Graph Neural Networks for Time Series Forecastingcited by 8
7 more
- 2023Structure Guided Multi-modal Pre-trained Transformer for Knowledge Graph Reasoningcited by 8
- 2024A Survey of Few-Shot Learning on Graphs: from Meta-Learning to Pre-Training and Prompt Learningcited by 5
- 2023Towards Few-shot Inductive Link Prediction on Knowledge Graphs: A Relational Anonymous Walk-guided Neural Process Approachcited by 4
- 2024R'enyi Neural Processescited by 1
- 2025ReCDAP: Relation-Based Conditional Diffusion with Attention Pooling for Few-Shot Knowledge Graph Completioncited by 0
- 2025Conjugate Relation Modeling for Few-Shot Knowledge Graph Completioncited by 0
- 2025TA-KAND: Two-stage Attention Triple Enhancement and U-KAN based Diffusion For Few-shot Knowledge Graph Completioncited by 0
- 2025TA-KAND: Two-stage Attention Triple Enhancement and U-KAN based Diffusion For Few-shot Knowledge Graph Completion13 Dec 2025
- 2025Conjugate Relation Modeling for Few-Shot Knowledge Graph Completion26 Oct 2025
- 2025ReCDAP: Relation-Based Conditional Diffusion with Attention Pooling for Few-Shot Knowledge Graph Completion12 May 2025
- 2024R'enyi Neural Processes25 May 2024
- 2024Online GNN Evaluation Under Test-time Graph Distribution Shifts15 Mar 2024
- 2024Graph Learning under Distribution Shifts: A Comprehensive Survey on Domain Adaptation, Out-of-distribution, and Continual Learning26 Feb 2024
- 2024A Survey of Few-Shot Learning on Graphs: from Meta-Learning to Pre-Training and Prompt Learning2 Feb 2024
- 2023AutoKG: Efficient Automated Knowledge Graph Generation for Language Models22 Nov 2023
- 2023GNNEvaluator: Evaluating GNN Performance On Unseen Graphs Without Labels23 Oct 2023
- 2023Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoning2 Oct 2023
- 2023A Survey of Imbalanced Learning on Graphs: Problems, Techniques, and Future Directions26 Aug 2023
- 2023Boosting Few-shot 3D Point Cloud Segmentation via Query-Guided Enhancement6 Aug 2023
7 more
- 2023A Survey on Temporal Knowledge Graph Completion: Taxonomy, Progress, and Prospects4 Aug 2023
- 2023Structure Guided Multi-modal Pre-trained Transformer for Knowledge Graph Reasoning6 Jul 2023
- 2023Towards Few-shot Inductive Link Prediction on Knowledge Graphs: A Relational Anonymous Walk-guided Neural Process Approach26 Jun 2023
- 2023Unifying Large Language Models and Knowledge Graphs: A Roadmap14 Jun 2023
- 2023Finding the Missing-half: Graph Complementary Learning for Homophily-prone and Heterophily-prone Graphs13 Jun 2023
- 2023Learning Strong Graph Neural Networks with Weak Information29 May 2023
- 2023Towards Expressive Spectral-Temporal Graph Neural Networks for Time Series Forecasting11 May 2023
- 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
- 2023Learning Strong Graph Neural Networks with Weak Informationcited by 25
- 2023Finding the Missing-half: Graph Complementary Learning for Homophily-prone and Heterophily-prone Graphscited by 25
- 2023Boosting Few-shot 3D Point Cloud Segmentation via Query-Guided Enhancementcited by 19
- 2023GNNEvaluator: Evaluating GNN Performance On Unseen Graphs Without Labelscited by 17
- 2023AutoKG: Efficient Automated Knowledge Graph Generation for Language Modelscited by 17
- 2024Graph Learning under Distribution Shifts: A Comprehensive Survey on Domain Adaptation, Out-of-distribution, and Continual Learningcited by 17
- 2023A Survey of Imbalanced Learning on Graphs: Problems, Techniques, and Future Directionscited by 15
- 2023A Survey on Temporal Knowledge Graph Completion: Taxonomy, Progress, and Prospectscited by 14
- 2024Online GNN Evaluation Under Test-time Graph Distribution Shiftscited by 12
- 2023Towards Expressive Spectral-Temporal Graph Neural Networks for Time Series Forecastingcited by 8
- 2023Structure Guided Multi-modal Pre-trained Transformer for Knowledge Graph Reasoningcited by 8
12 most cited of 18 All 18 (JSON)
- 2025TA-KAND: Two-stage Attention Triple Enhancement and U-KAN based Diffusion For Few-shot Knowledge Graph Completion13 Dec 2025
- 2025Conjugate Relation Modeling for Few-Shot Knowledge Graph Completion26 Oct 2025
- 2025ReCDAP: Relation-Based Conditional Diffusion with Attention Pooling for Few-Shot Knowledge Graph Completion12 May 2025
- 2024R'enyi Neural Processes25 May 2024
- 2024Online GNN Evaluation Under Test-time Graph Distribution Shifts15 Mar 2024
- 2024Graph Learning under Distribution Shifts: A Comprehensive Survey on Domain Adaptation, Out-of-distribution, and Continual Learning26 Feb 2024
- 2024A Survey of Few-Shot Learning on Graphs: from Meta-Learning to Pre-Training and Prompt Learning2 Feb 2024
- 2023AutoKG: Efficient Automated Knowledge Graph Generation for Language Models22 Nov 2023
- 2023GNNEvaluator: Evaluating GNN Performance On Unseen Graphs Without Labels23 Oct 2023
- 2023A Survey of Imbalanced Learning on Graphs: Problems, Techniques, and Future Directions26 Aug 2023
- 2023Boosting Few-shot 3D Point Cloud Segmentation via Query-Guided Enhancement6 Aug 2023
- 2023A Survey on Temporal Knowledge Graph Completion: Taxonomy, Progress, and Prospects4 Aug 2023
12 newest of 18 All 18 (JSON)