mlsanityData to 7 Oct 2026

Wasserstein-Fisher-Rao Embedding: Logical Query Embeddings with Local Comparison and Global Transport

arXiv 2305.04034 ↗First posted 6 May 2023cs.AI cs.DB cs.LGcited by 16

Not on the map. Why?

Abstract (arXiv)

Answering complex queries on knowledge graphs is important but particularly challenging because of the data incompleteness. Query embedding methods address this issue by learning-based models and simulating logical reasoning with set operators. Previous works focus on specific forms of embeddings, but scoring functions between embeddings are underexplored. In contrast to existing scoring functions motivated by local comparison or global transport, this work investigates the local and global trade-off with unbalanced optimal transport theory. Specifically, we embed sets as bounded measures in real endowed with a scoring function motivated by the Wasserstein-Fisher-Rao metric. Such a design also facilitates closed-form set operators in the embedding space. Moreover, we introduce a convolution-based algorithm for linear time computation and a block-diagonal kernel to enforce the trade-off. Results show that WFRE can outperform existing query embedding methods on standard datasets, evaluation sets with combinatorially complex queries, and hierarchical knowledge graphs. Ablation study shows that finding a better local and global trade-off is essential for performance improvement.

Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 39 of its 73 references that are in the map. First posted on arXiv 6 May 2023.

Builds on

39 of 73 references.

References · 39

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  2. 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,684
  3. 2019KGAT: Knowledge Graph Attention Network for Recommendationcited by 342
  4. 2017DeepPath: A Reinforcement Learning Method for Knowledge Graph Reasoningcited by 265
  5. 2019Generalized Sliced Wasserstein Distancescited by 205
  6. 2020Query2box: Reasoning over Knowledge Graphs in Vector Space using Box Embeddingscited by 169
  7. 2020Beta Embeddings for Multi-Hop Logical Reasoning in Knowledge Graphscited by 128
  8. 2018Embedding Logical Queries on Knowledge Graphscited by 120
  9. 2018Gromov-Wasserstein Alignment of Word Embedding Spacescited by 119
  10. 2020Complex Query Answering with Neural Link Predictorscited by 98
  11. 2021ConE: Cone Embeddings for Multi-Hop Reasoning over Knowledge Graphscited by 78
  12. 2017Sliced Wasserstein Kernel for Persistence Diagramscited by 77
27 more
  1. 2022Neural-Symbolic Models for Logical Queries on Knowledge Graphscited by 60
  2. 2020Vocabulary Learning via Optimal Transport for Neural Machine Translationcited by 58
  3. 2022Mask and Reason: Pre-Training Knowledge Graph Transformers for Complex Logical Queriescited by 39
  4. 2020Self-Supervised Hyperboloid Representations from Logical Queries over Knowledge Graphscited by 35
  5. 2023Neural Graph Reasoning: Complex Logical Query Answering Meets Graph Databasescited by 35
  6. 2017Wasserstein Dictionary Learning: Optimal Transport-based unsupervised non-linear dictionary learningcited by 34
  7. 2020Answering Complex Queries in Knowledge Graphs with Bidirectional Sequence Encoderscited by 28
  8. 2021Probabilistic Entity Representation Model for Reasoning over Knowledge Graphscited by 28
  9. 2023Logical Message Passing Networks with One-hop Inference on Atomic Formulascited by 28
  10. 2022Query2Particles: Knowledge Graph Reasoning with Particle Embeddingscited by 24
  11. 2021Query Embedding on Hyper-relational Knowledge Graphscited by 23
  12. 2021Benchmarking the Combinatorial Generalizability of Complex Query Answering on Knowledge Graphscited by 21
  13. 2022GammaE: Gamma Embeddings for Logical Queries on Knowledge Graphscited by 21
  14. 2018Generalizing Point Embeddings using the Wasserstein Space of Elliptical Distributionscited by 20
  15. 2022Neural-Symbolic Entangled Framework for Complex Query Answeringcited by 18
  16. 2021Logic Embeddings for Complex Query Answeringcited by 17
  17. 2021SMORE: Knowledge Graph Completion and Multi-hop Reasoning in Massive Knowledge Graphscited by 17
  18. 2022Neural Methods for Logical Reasoning Over Knowledge Graphscited by 17
  19. 2019Learning Embeddings into Entropic Wasserstein Spacescited by 15
  20. 2023Sequential Query Encoding For Complex Query Answering on Knowledge Graphscited by 13
  21. 2020A Relaxed Matching Procedure for Unsupervised BLIcited by 8
  22. 2022OTExtSum: Extractive Text Summarisation with Optimal Transportcited by 8
  23. 2020Semi-Supervised Bilingual Lexicon Induction with Two-way Interactioncited by 6
  24. 2022Fast Sinkhorn I: An O(N) algorithm for the Wasserstein-1 metriccited by 6
  25. 2023SEAL: Simultaneous Label Hierarchy Exploration And Learningcited by 6
  26. 2022Unsupervised Sentence Textual Similarity with Compositional Phrase Semanticscited by 4
  27. 2022Fast Sinkhorn II: Collinear Triangular Matrix and Linear Time Accurate Computation of Optimal Transportcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 6; 2024: 6; 2025: 3; 2026: 1.

16 papers.

Sort:

By area:

  1. 2023Extending Context Window of Large Language Models via Semantic Compressioncited by 45
  2. 2023Hierarchical Multi-Marginal Optimal Transport for Network Alignmentcited by 24
  3. 2025Top Ten Challenges Towards Agentic Neural Graph Databasescited by 13
  4. 2023EFOk-CQA: Towards Knowledge Graph Complex Query Answering beyond Set Operationcited by 12
  5. 2023Knowledge Graph Reasoning over Entities and Numerical Valuescited by 11
  6. 2025Efficient Prompt Compression with Evaluator Heads for Long-Context Transformer Inferencecited by 10
  7. 2024Retrieval Meets Reasoning: Dynamic In-Context Editing for Long-Text Understandingcited by 9
  8. 2023Privacy-Preserved Neural Graph Databasescited by 5
  9. 2024Conditional Logical Message Passing Transformer for Complex Query Answeringcited by 5
  10. 2023Query2Triple: Unified Query Encoding for Answering Diverse Complex Queries over Knowledge Graphscited by 4
  11. 2024Improving Multi-hop Logical Reasoning in Knowledge Graphs with Context-Aware Query Representation Learningcited by 3
  12. 2024On the Role of Entity and Event Level Conceptualization in Generalizable Reasoning: A Survey of Tasks, Methods, Applications, and Future Directionscited by 3
4 more
  1. 2024Extending Complex Logical Queries on Uncertain Knowledge Graphscited by 2
  2. 2024Meta Operator for Complex Query Answering on Knowledge Graphscited by 2
  3. 2025Efficient and Scalable Neural Symbolic Search for Knowledge Graph Complex Query Answeringcited by 1
  4. 2026Neural Scalable Symbolic Search Framework for Complex Logical Queries with Multiple Free Variablescited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2022NQE: N-ary Query Embedding for Complex Query Answering over Hyper-Relational Knowledge Graphs
  2. 2025Fully Geometric Multi-Hop Reasoning on Knowledge Graphs with Transitive Relations
  3. 2026Efficient Dense Vector Search within Knowledge Graph Content Embeddings ↗
  4. 2022Inductive Logical Query Answering in Knowledge Graphs
  5. 2025A Large Language Model Based Method for Complex Logical Reasoning over Knowledge Graphs
  6. 2026Multi-hop Reasoning and Retrieval in Embedding Space: Leveraging Large Language Models with Knowledge
  7. 2026ROG: Retrieval-Augmented LLM Reasoning for Complex First-Order Queries over Knowledge Graphs
  8. 2023Query2GMM: Learning Representation with Gaussian Mixture Model for Reasoning over Knowledge Graphs