Wasserstein-Fisher-Rao Embedding: Logical Query Embeddings with Local Comparison and Global Transport
Not on the map. Why?
Abstract (arXiv)
Answering complex queries on knowledge graphs is important but particularly challenging because of the data incompleteness. Query embedding methods address this issue by learning-based models and simulating logical reasoning with set operators. Previous works focus on specific forms of embeddings, but scoring functions between embeddings are underexplored. In contrast to existing scoring functions motivated by local comparison or global transport, this work investigates the local and global trade-off with unbalanced optimal transport theory. Specifically, we embed sets as bounded measures in real endowed with a scoring function motivated by the Wasserstein-Fisher-Rao metric. Such a design also facilitates closed-form set operators in the embedding space. Moreover, we introduce a convolution-based algorithm for linear time computation and a block-diagonal kernel to enforce the trade-off. Results show that WFRE can outperform existing query embedding methods on standard datasets, evaluation sets with combinatorially complex queries, and hierarchical knowledge graphs. Ablation study shows that finding a better local and global trade-off is essential for performance improvement.
Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 39 of its 73 references that are in the map. First posted on arXiv 6 May 2023.
Builds on
39 of 73 references.
References · 39
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,684
- 2019KGAT: Knowledge Graph Attention Network for Recommendationcited by 342
- 2017DeepPath: A Reinforcement Learning Method for Knowledge Graph Reasoningcited by 265
- 2019Generalized Sliced Wasserstein Distancescited by 205
- 2020Query2box: Reasoning over Knowledge Graphs in Vector Space using Box Embeddingscited by 169
- 2020Beta Embeddings for Multi-Hop Logical Reasoning in Knowledge Graphscited by 128
- 2018Embedding Logical Queries on Knowledge Graphscited by 120
- 2018Gromov-Wasserstein Alignment of Word Embedding Spacescited by 119
- 2020Complex Query Answering with Neural Link Predictorscited by 98
- 2021ConE: Cone Embeddings for Multi-Hop Reasoning over Knowledge Graphscited by 78
- 2017Sliced Wasserstein Kernel for Persistence Diagramscited by 77
27 more
- 2022Neural-Symbolic Models for Logical Queries on Knowledge Graphscited by 60
- 2020Vocabulary Learning via Optimal Transport for Neural Machine Translationcited by 58
- 2022Mask and Reason: Pre-Training Knowledge Graph Transformers for Complex Logical Queriescited by 39
- 2020Self-Supervised Hyperboloid Representations from Logical Queries over Knowledge Graphscited by 35
- 2023Neural Graph Reasoning: Complex Logical Query Answering Meets Graph Databasescited by 35
- 2017Wasserstein Dictionary Learning: Optimal Transport-based unsupervised non-linear dictionary learningcited by 34
- 2020Answering Complex Queries in Knowledge Graphs with Bidirectional Sequence Encoderscited by 28
- 2021Probabilistic Entity Representation Model for Reasoning over Knowledge Graphscited by 28
- 2023Logical Message Passing Networks with One-hop Inference on Atomic Formulascited by 28
- 2022Query2Particles: Knowledge Graph Reasoning with Particle Embeddingscited by 24
- 2021Query Embedding on Hyper-relational Knowledge Graphscited by 23
- 2021Benchmarking the Combinatorial Generalizability of Complex Query Answering on Knowledge Graphscited by 21
- 2022GammaE: Gamma Embeddings for Logical Queries on Knowledge Graphscited by 21
- 2018Generalizing Point Embeddings using the Wasserstein Space of Elliptical Distributionscited by 20
- 2022Neural-Symbolic Entangled Framework for Complex Query Answeringcited by 18
- 2021Logic Embeddings for Complex Query Answeringcited by 17
- 2021SMORE: Knowledge Graph Completion and Multi-hop Reasoning in Massive Knowledge Graphscited by 17
- 2022Neural Methods for Logical Reasoning Over Knowledge Graphscited by 17
- 2019Learning Embeddings into Entropic Wasserstein Spacescited by 15
- 2023Sequential Query Encoding For Complex Query Answering on Knowledge Graphscited by 13
- 2020A Relaxed Matching Procedure for Unsupervised BLIcited by 8
- 2022OTExtSum: Extractive Text Summarisation with Optimal Transportcited by 8
- 2020Semi-Supervised Bilingual Lexicon Induction with Two-way Interactioncited by 6
- 2022Fast Sinkhorn I: An O(N) algorithm for the Wasserstein-1 metriccited by 6
- 2023SEAL: Simultaneous Label Hierarchy Exploration And Learningcited by 6
- 2022Unsupervised Sentence Textual Similarity with Compositional Phrase Semanticscited by 4
- 2022Fast Sinkhorn II: Collinear Triangular Matrix and Linear Time Accurate Computation of Optimal Transportcited by 3
Built on by
Citing papers per year: 2023: 6; 2024: 6; 2025: 3; 2026: 1.
16 papers.
Sort:
By area:
- 2023Extending Context Window of Large Language Models via Semantic Compressioncited by 45
- 2023Hierarchical Multi-Marginal Optimal Transport for Network Alignmentcited by 24
- 2025Top Ten Challenges Towards Agentic Neural Graph Databasescited by 13
- 2023EFOk-CQA: Towards Knowledge Graph Complex Query Answering beyond Set Operationcited by 12
- 2023Knowledge Graph Reasoning over Entities and Numerical Valuescited by 11
- 2025Efficient Prompt Compression with Evaluator Heads for Long-Context Transformer Inferencecited by 10
- 2024Retrieval Meets Reasoning: Dynamic In-Context Editing for Long-Text Understandingcited by 9
- 2023Privacy-Preserved Neural Graph Databasescited by 5
- 2024Conditional Logical Message Passing Transformer for Complex Query Answeringcited by 5
- 2023Query2Triple: Unified Query Encoding for Answering Diverse Complex Queries over Knowledge Graphscited by 4
- 2024Improving Multi-hop Logical Reasoning in Knowledge Graphs with Context-Aware Query Representation Learningcited by 3
- 2024On the Role of Entity and Event Level Conceptualization in Generalizable Reasoning: A Survey of Tasks, Methods, Applications, and Future Directionscited by 3
4 more
- 2024Extending Complex Logical Queries on Uncertain Knowledge Graphscited by 2
- 2024Meta Operator for Complex Query Answering on Knowledge Graphscited by 2
- 2025Efficient and Scalable Neural Symbolic Search for Knowledge Graph Complex Query Answeringcited by 1
- 2026Neural Scalable Symbolic Search Framework for Complex Logical Queries with Multiple Free Variablescited by 0
- 2026Neural Scalable Symbolic Search Framework for Complex Logical Queries with Multiple Free Variables25 May 2026
- 2025Efficient and Scalable Neural Symbolic Search for Knowledge Graph Complex Query Answering13 May 2025
- 2025Top Ten Challenges Towards Agentic Neural Graph Databases24 Jan 2025
- 2025Efficient Prompt Compression with Evaluator Heads for Long-Context Transformer Inference22 Jan 2025
- 2024Retrieval Meets Reasoning: Dynamic In-Context Editing for Long-Text Understanding18 Jun 2024
- 2024On the Role of Entity and Event Level Conceptualization in Generalizable Reasoning: A Survey of Tasks, Methods, Applications, and Future Directions16 Jun 2024
- 2024Improving Multi-hop Logical Reasoning in Knowledge Graphs with Context-Aware Query Representation Learning11 Jun 2024
- 2024Meta Operator for Complex Query Answering on Knowledge Graphs15 Mar 2024
- 2024Extending Complex Logical Queries on Uncertain Knowledge Graphs3 Mar 2024
- 2024Conditional Logical Message Passing Transformer for Complex Query Answering20 Feb 2024
- 2023Privacy-Preserved Neural Graph Databases25 Dec 2023
- 2023Extending Context Window of Large Language Models via Semantic Compression15 Dec 2023
4 more
- 2023Query2Triple: Unified Query Encoding for Answering Diverse Complex Queries over Knowledge Graphs17 Oct 2023
- 2023Hierarchical Multi-Marginal Optimal Transport for Network Alignment6 Oct 2023
- 2023EFOk-CQA: Towards Knowledge Graph Complex Query Answering beyond Set Operation15 Jul 2023
- 2023Knowledge Graph Reasoning over Entities and Numerical Values2 Jun 2023
- 2023EFOk-CQA: Towards Knowledge Graph Complex Query Answering beyond Set Operationcited by 12
- 2024Retrieval Meets Reasoning: Dynamic In-Context Editing for Long-Text Understandingcited by 9
- 2024Improving Multi-hop Logical Reasoning in Knowledge Graphs with Context-Aware Query Representation Learningcited by 3
- 2024Retrieval Meets Reasoning: Dynamic In-Context Editing for Long-Text Understanding18 Jun 2024
- 2024Improving Multi-hop Logical Reasoning in Knowledge Graphs with Context-Aware Query Representation Learning11 Jun 2024
- 2023EFOk-CQA: Towards Knowledge Graph Complex Query Answering beyond Set Operation15 Jul 2023
- 2025Top Ten Challenges Towards Agentic Neural Graph Databasescited by 13
- 2025Top Ten Challenges Towards Agentic Neural Graph Databases24 Jan 2025
- 2023Extending Context Window of Large Language Models via Semantic Compressioncited by 45
- 2023Hierarchical Multi-Marginal Optimal Transport for Network Alignmentcited by 24
- 2023Knowledge Graph Reasoning over Entities and Numerical Valuescited by 11
- 2023Privacy-Preserved Neural Graph Databasescited by 5
- 2024Conditional Logical Message Passing Transformer for Complex Query Answeringcited by 5
- 2023Query2Triple: Unified Query Encoding for Answering Diverse Complex Queries over Knowledge Graphscited by 4
- 2024On the Role of Entity and Event Level Conceptualization in Generalizable Reasoning: A Survey of Tasks, Methods, Applications, and Future Directionscited by 3
- 2024Extending Complex Logical Queries on Uncertain Knowledge Graphscited by 2
- 2024Meta Operator for Complex Query Answering on Knowledge Graphscited by 2
- 2025Efficient and Scalable Neural Symbolic Search for Knowledge Graph Complex Query Answeringcited by 1
- 2026Neural Scalable Symbolic Search Framework for Complex Logical Queries with Multiple Free Variablescited by 0
- 2026Neural Scalable Symbolic Search Framework for Complex Logical Queries with Multiple Free Variables25 May 2026
- 2025Efficient and Scalable Neural Symbolic Search for Knowledge Graph Complex Query Answering13 May 2025
- 2024On the Role of Entity and Event Level Conceptualization in Generalizable Reasoning: A Survey of Tasks, Methods, Applications, and Future Directions16 Jun 2024
- 2024Meta Operator for Complex Query Answering on Knowledge Graphs15 Mar 2024
- 2024Extending Complex Logical Queries on Uncertain Knowledge Graphs3 Mar 2024
- 2024Conditional Logical Message Passing Transformer for Complex Query Answering20 Feb 2024
- 2023Privacy-Preserved Neural Graph Databases25 Dec 2023
- 2023Extending Context Window of Large Language Models via Semantic Compression15 Dec 2023
- 2023Query2Triple: Unified Query Encoding for Answering Diverse Complex Queries over Knowledge Graphs17 Oct 2023
- 2023Hierarchical Multi-Marginal Optimal Transport for Network Alignment6 Oct 2023
- 2023Knowledge Graph Reasoning over Entities and Numerical Values2 Jun 2023
Similar, not cited
Close in wording, no citation either way
- 2022NQE: N-ary Query Embedding for Complex Query Answering over Hyper-Relational Knowledge Graphs
- 2025Fully Geometric Multi-Hop Reasoning on Knowledge Graphs with Transitive Relations
- 2026Efficient Dense Vector Search within Knowledge Graph Content Embeddings ↗
- 2022Inductive Logical Query Answering in Knowledge Graphs
- 2025A Large Language Model Based Method for Complex Logical Reasoning over Knowledge Graphs
- 2026Multi-hop Reasoning and Retrieval in Embedding Space: Leveraging Large Language Models with Knowledge
- 2026ROG: Retrieval-Augmented LLM Reasoning for Complex First-Order Queries over Knowledge Graphs
- 2023Query2GMM: Learning Representation with Gaussian Mixture Model for Reasoning over Knowledge Graphs