mlsanityData to 14 Oct 2026

SpEL: Structured Prediction for Entity Linking

arXiv 2310.14684 ↗First posted 23 Oct 2023cs.CLcited by 11

Not on the map. Why?

Abstract (arXiv)

Entity linking is a prominent thread of research focused on structured data creation by linking spans of text to an ontology or knowledge source. We revisit the use of structured prediction for entity linking which classifies each individual input token as an entity, and aggregates the token predictions. Our system, called SpEL (Structured prediction for Entity Linking) is a state-of-the-art entity linking system that uses some new ideas to apply structured prediction to the task of entity linking including: two refined fine-tuning steps; a context sensitive prediction aggregation strategy; reduction of the size of the model's output vocabulary, and; we address a common problem in entity-linking systems where there is a training vs. inference tokenization mismatch. Our experiments show that we can outperform the state-of-the-art on the commonly used AIDA benchmark dataset for entity linking to Wikipedia. Our method is also very compute efficient in terms of number of parameters and speed of inference.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 28 of its 66 references that are in the map. First posted on arXiv 23 Oct 2023.

Builds on

28 of 66 references.

References · 28

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  5. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  6. 2020LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attentioncited by 326
  7. 2019Knowledge Enhanced Contextual Word Representationscited by 296
  8. 2018Scaling Neural Machine Translationcited by 204
  9. 2019Learning Dense Representations for Entity Retrievalcited by 122
  10. 2020Language Models as Knowledge Bases: On Entity Representations, Storage Capacity, and Paraphrased Queriescited by 107
  11. 2019E-BERT: Efficient-Yet-Effective Entity Embeddings for BERTcited by 96
  12. 2018End-to-End Neural Entity Linkingcited by 85
16 more
  1. 2019MedMentions: A Large Biomedical Corpus Annotated with UMLS Conceptscited by 80
  2. 2017Deep Joint Entity Disambiguation with Local Neural Attentioncited by 79
  3. 2020REL: An Entity Linker Standing on the Shoulders of Giantscited by 61
  4. 2020Investigating Entity Knowledge in BERT with Simple Neural End-To-End Entity Linkingcited by 49
  5. 2015Transition-Based Dependency Parsing with Stack Long Short-Term Memorycited by 45
  6. 2021EntQA: Entity Linking as Question Answeringcited by 34
  7. 2019Joint Learning of Named Entity Recognition and Entity Linkingcited by 26
  8. 2021Highly Parallel Autoregressive Entity Linking with Discriminative Correctioncited by 21
  9. 2014Analysis of Named Entity Recognition and Linking for Tweetscited by 20
  10. 2020Empirical Evaluation of Pretraining Strategies for Supervised Entity Linkingcited by 17
  11. 2021CHOLAN: A Modular Approach for Neural Entity Linking on Wikipedia and Wikidatacited by 14
  12. 2019A Simple and Effective Model for Answering Multi-span Questionscited by 13
  13. 2022Detection, Disambiguation, Re-ranking: Autoregressive Entity Linking as a Multi-Task Problemcited by 11
  14. 2019Global Entity Disambiguation with BERTcited by 10
  15. 2022Do CoNLL-2003 Named Entity Taggers Still Work Well in 2023?cited by 9
  16. 2021Better Neural Machine Translation by Extracting Linguistic Information from BERTcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 7; 2025: 3; 2026: 1.

11 papers.