SpEL: Structured Prediction for Entity Linking
Not on the map. Why?
Abstract (arXiv)
Entity linking is a prominent thread of research focused on structured data creation by linking spans of text to an ontology or knowledge source. We revisit the use of structured prediction for entity linking which classifies each individual input token as an entity, and aggregates the token predictions. Our system, called SpEL (Structured prediction for Entity Linking) is a state-of-the-art entity linking system that uses some new ideas to apply structured prediction to the task of entity linking including: two refined fine-tuning steps; a context sensitive prediction aggregation strategy; reduction of the size of the model's output vocabulary, and; we address a common problem in entity-linking systems where there is a training vs. inference tokenization mismatch. Our experiments show that we can outperform the state-of-the-art on the commonly used AIDA benchmark dataset for entity linking to Wikipedia. Our method is also very compute efficient in terms of number of parameters and speed of inference.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 28 of its 66 references that are in the map. First posted on arXiv 23 Oct 2023.
Builds on
28 of 66 references.
References · 28
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2020LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attentioncited by 326
- 2019Knowledge Enhanced Contextual Word Representationscited by 296
- 2018Scaling Neural Machine Translationcited by 204
- 2019Learning Dense Representations for Entity Retrievalcited by 122
- 2020Language Models as Knowledge Bases: On Entity Representations, Storage Capacity, and Paraphrased Queriescited by 107
- 2019E-BERT: Efficient-Yet-Effective Entity Embeddings for BERTcited by 96
- 2018End-to-End Neural Entity Linkingcited by 85
16 more
- 2019MedMentions: A Large Biomedical Corpus Annotated with UMLS Conceptscited by 80
- 2017Deep Joint Entity Disambiguation with Local Neural Attentioncited by 79
- 2020REL: An Entity Linker Standing on the Shoulders of Giantscited by 61
- 2020Investigating Entity Knowledge in BERT with Simple Neural End-To-End Entity Linkingcited by 49
- 2015Transition-Based Dependency Parsing with Stack Long Short-Term Memorycited by 45
- 2021EntQA: Entity Linking as Question Answeringcited by 34
- 2019Joint Learning of Named Entity Recognition and Entity Linkingcited by 26
- 2021Highly Parallel Autoregressive Entity Linking with Discriminative Correctioncited by 21
- 2014Analysis of Named Entity Recognition and Linking for Tweetscited by 20
- 2020Empirical Evaluation of Pretraining Strategies for Supervised Entity Linkingcited by 17
- 2021CHOLAN: A Modular Approach for Neural Entity Linking on Wikipedia and Wikidatacited by 14
- 2019A Simple and Effective Model for Answering Multi-span Questionscited by 13
- 2022Detection, Disambiguation, Re-ranking: Autoregressive Entity Linking as a Multi-Task Problemcited by 11
- 2019Global Entity Disambiguation with BERTcited by 10
- 2022Do CoNLL-2003 Named Entity Taggers Still Work Well in 2023?cited by 9
- 2021Better Neural Machine Translation by Extracting Linguistic Information from BERTcited by 5
Built on by
Citing papers per year: 2024: 7; 2025: 3; 2026: 1.
11 papers.
- 2024Entity Retrieval for Answering Entity-Centric Questionscited by 10
- 2025Evaluating Design Decisions for Dual Encoder-based Entity Disambiguationcited by 5
- 2024Entity Disambiguation via Fusion Entity Decodingcited by 4
- 2024DynamicER: Resolving Emerging Mentions to Dynamic Entities for RAGcited by 4
- 2024Unified Examination of Entity Linking in Absence of Candidate Setscited by 3
- 2024TIGER: Temporally Improved Graph Entity Linkercited by 1
- 2025Explainable ICD Coding via Entity Linkingcited by 1
- 2024Embedded Topic Models Enhanced by Wikificationcited by 0
- 2024CYCLE: Cross-Year Contrastive Learning in Entity-Linkingcited by 0
- 2025DISCIE -- Discriminative Closed Information Extractioncited by 0
- 2026Consistent Relexicalization of Clinical Documents using Graph-Based Approachcited by 0
- 2026Consistent Relexicalization of Clinical Documents using Graph-Based Approach18 Sep 2026
- 2025DISCIE -- Discriminative Closed Information Extraction19 Jun 2025
- 2025Evaluating Design Decisions for Dual Encoder-based Entity Disambiguation16 May 2025
- 2025Explainable ICD Coding via Entity Linking26 Mar 2025
- 2024DynamicER: Resolving Emerging Mentions to Dynamic Entities for RAG15 Oct 2024
- 2024TIGER: Temporally Improved Graph Entity Linker11 Oct 2024
- 2024CYCLE: Cross-Year Contrastive Learning in Entity-Linking11 Oct 2024
- 2024Embedded Topic Models Enhanced by Wikification3 Oct 2024
- 2024Entity Retrieval for Answering Entity-Centric Questions5 Aug 2024
- 2024Unified Examination of Entity Linking in Absence of Candidate Sets17 Apr 2024
- 2024Entity Disambiguation via Fusion Entity Decoding2 Apr 2024