mlsanityData to 14 Oct 2026

Polar Ducks and Where to Find Them: Enhancing Entity Linking with Duck Typing and Polar Box Embeddings

arXiv 2305.12027 ↗First posted 19 May 2023cs.CL cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

Entity linking methods based on dense retrieval are an efficient and widely used solution in large-scale applications, but they fall short of the performance of generative models, as they are sensitive to the structure of the embedding space. In order to address this issue, this paper introduces DUCK, an approach to infusing structural information in the space of entity representations, using prior knowledge of entity types. Inspired by duck typing in programming languages, we propose to define the type of an entity based on the relations that it has with other entities in a knowledge graph. Then, porting the concept of box embeddings to spherical polar coordinates, we propose to represent relations as boxes on the hypersphere. We optimize the model to cluster entities of similar type by placing them inside the boxes corresponding to their relations. Our experiments show that our method sets new state-of-the-art results on standard entity-disambiguation benchmarks, it improves the performance of the model by up to 7.9 F1 points, outperforms other type-aware approaches, and matches the results of generative models with 18 times more parameters.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 35 of its 68 references that are in the map. First posted on arXiv 19 May 2023.

Builds on

35 of 68 references.

References · 35

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  3. 2017Billion-scale similarity search with GPUscited by 2,497
  4. 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 898
  5. 2018Gender Bias in Coreference Resolution: Evaluation and Debiasing Methodscited by 659
  6. 2020KILT: a Benchmark for Knowledge Intensive Language Taskscited by 573
  7. 2019COMET: Commonsense Transformers for Automatic Knowledge Graph Constructioncited by 450
  8. 2018Gender Bias in Coreference Resolutioncited by 442
  9. 2021QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answeringcited by 388
  10. 2020Autoregressive Entity Retrievalcited by 334
  11. 2022CM3: A Causal Masked Multimodal Model of the Internetcited by 142
  12. 2015Order-Embeddings of Images and Languagecited by 113
23 more
  1. 2020BoxE: A Box Embedding Model for Knowledge Base Completioncited by 105
  2. 2018End-to-End Neural Entity Linkingcited by 85
  3. 2017Deep Joint Entity Disambiguation with Local Neural Attentioncited by 79
  4. 2022ReFinED: An Efficient Zero-shot-capable Approach to End-to-End Entity Linkingcited by 74
  5. 2018Probabilistic Embedding of Knowledge Graphs with Box Lattice Measurescited by 64
  6. 2020Entity Linking in 100 Languagescited by 52
  7. 2016Joint Learning of the Embedding of Words and Entities for Named Entity Disambiguationcited by 48
  8. 2018DeepType: Multilingual Entity Linking by Neural Type System Evolutioncited by 41
  9. 2022Transformer Grammars: Augmenting Transformer Language Models with Syntactic Inductive Biases at Scalecited by 41
  10. 2020Text-based RL Agents with Commonsense Knowledge: New Challenges, Environments and Baselinescited by 37
  11. 2019Fine-Grained Entity Typing for Domain Independent Entity Linkingcited by 36
  12. 2020Improving Local Identifiability in Probabilistic Box Embeddingscited by 35
  13. 2021Men Are Elected, Women Are Married: Events Gender Bias on Wikipediacited by 30
  14. 2019Joint Entity Linking with Deep Reinforcement Learningcited by 27
  15. 2020Bootleg: Chasing the Tail with Self-Supervised Named Entity Disambiguationcited by 24
  16. 2020Evaluating the Impact of Knowledge Graph Context on Entity Disambiguation Modelscited by 23
  17. 2019Learning Dynamic Context Augmentation for Global Entity Linkingcited by 19
  18. 2020Improving Entity Linking by Modeling Latent Entity Type Informationcited by 18
  19. 2018Collective Entity Disambiguation with Structured Gradient Tree Boostingcited by 16
  20. 2019Boosting Entity Linking Performance by Leveraging Unlabeled Documentscited by 12
  21. 2019Entity-aware ELMo: Learning Contextual Entity Representation for Entity Disambiguationcited by 10
  22. 2021SQALER: Scaling Question Answering by Decoupling Multi-Hop and Logical Reasoningcited by 10
  23. 2018Learning to Generate Wikipedia Summaries for Underserved Languages from Wikidatacited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.