Learning Dense Representations for Entity Retrieval
Not on the map. Why?
Abstract (arXiv)
We show that it is feasible to perform entity linking by training a dual encoder (two-tower) model that encodes mentions and entities in the same dense vector space, where candidate entities are retrieved by approximate nearest neighbor search. Unlike prior work, this setup does not rely on an alias table followed by a re-ranker, and is thus the first fully learned entity retrieval model. We show that our dual encoder, trained using only anchor-text links in Wikipedia, outperforms discrete alias table and BM25 baselines, and is competitive with the best comparable results on the standard TACKBP-2010 dataset. In addition, it can retrieve candidates extremely fast, and generalizes well to a new dataset derived from Wikinews. On the modeling side, we demonstrate the dramatic value of an unsupervised negative mining algorithm for this task.
Key facts. Cited by 122 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Sep 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 33; 2022: 26; 2023: 27; 2024: 19; 2025: 11; 2026: 6.
122 papers.
Sort:
By area:
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
- 2021Large Dual Encoders Are Generalizable Retrieverscited by 454
- 2021RocketQAv2: A Joint Training Method for Dense Passage Retrieval and Passage Re-rankingcited by 175
- 2021Retrieval Augmented Code Generation and Summarizationcited by 148
- 2023Decision-Focused Learning: Foundations, State of the Art, Benchmark and Future Opportunitiescited by 129
- 2022State-of-the-art generalisation research in NLP: A taxonomy and reviewcited by 97
- 2021Open Domain Question Answering over Tables via Dense Retrievalcited by 74
- 2024User-LLM: Efficient LLM Contextualization with User Embeddingscited by 74
- 2021PAIR: Leveraging Passage-Centric Similarity Relation for Improving Dense Passage Retrievalcited by 50
- 2022Questions Are All You Need to Train a Dense Passage Retrievercited by 47
- 2021One Question Answering Model for Many Languages with Cross-lingual Dense Passage Retrievalcited by 46
- 2021Improving Query Representations for Dense Retrieval with Pseudo Relevance Feedbackcited by 45
38 more
- 2021LightningDOT: Pre-training Visual-Semantic Embeddings for Real-Time Image-Text Retrievalcited by 44
- 2025GFM-RAG: Graph Foundation Model for Retrieval Augmented Generationcited by 40
- 2021Understanding Hard Negatives in Noise Contrastive Estimationcited by 39
- 2024BMRetriever: Tuning Large Language Models as Better Biomedical Text Retrieverscited by 38
- 2024jina-clip-v2: Multilingual Multimodal Embeddings for Text and Imagescited by 36
- 2021Few-shot Intent Classification and Slot Filling with Retrieved Examplescited by 35
- 2021EntQA: Entity Linking as Question Answeringcited by 34
- 2021Knowledge-Rich Self-Supervision for Biomedical Entity Linkingcited by 31
- 2023ReGen: Zero-Shot Text Classification via Training Data Generation with Progressive Dense Retrievalcited by 26
- 2022LaPraDoR: Unsupervised Pretrained Dense Retriever for Zero-Shot Text Retrievalcited by 24
- 2022Optimizing Bi-Encoder for Named Entity Recognition via Contrastive Learningcited by 24
- 2023The Life Cycle of Knowledge in Big Language Models: A Surveycited by 23
- 2021Entity Linking and Discovery via Arborescence-based Supervised Clusteringcited by 22
- 2021Entity Linking Meets Deep Learning: Techniques and Solutionscited by 21
- 2024Corpus Poisoning via Approximate Greedy Gradient Descentcited by 21
- 2022Uni-Retriever: Towards Learning The Unified Embedding Based Retriever in Bing Sponsored Searchcited by 17
- 2022Distill-VQ: Learning Retrieval Oriented Vector Quantization By Distilling Knowledge from Dense Embeddingscited by 17
- 2022Mixed-modality Representation Learning and Pre-training for Joint Table-and-Text Retrieval in OpenQAcited by 17
- 2021Fast and Effective Biomedical Entity Linking Using a Dual Encodercited by 16
- 2021Focus on what matters: Applying Discourse Coherence Theory to Cross Document Coreferencecited by 16
- 2021Distilling Relation Embeddings from Pre-trained Language Modelscited by 15
- 2021Read, Retrospect, Select: An MRC Framework to Short Text Entity Linkingcited by 14
- 2021BERT might be Overkill: A Tiny but Effective Biomedical Entity Linker based on Residual Convolutional Neural Networkscited by 14
- 2024Does Negative Sampling Matter? A Review with Insights into its Theory and Applicationscited by 14
- 2021DOCENT: Learning Self-Supervised Entity Representations from Large Document Collectionscited by 13
- 2021QUEACO: Borrowing Treasures from Weakly-labeled Behavior Data for Query Attribute Value Extractioncited by 13
- 2022RedHOT: A Corpus of Annotated Medical Questions, Experiences, and Claims on Social Mediacited by 13
- 2021Contrastive Fine-tuning Improves Robustness for Neural Rankerscited by 12
- 2021LNN-EL: A Neuro-Symbolic Approach to Short-text Entity Linkingcited by 11
- 2023Synergistic Interplay between Search and Large Language Models for Information Retrievalcited by 11
- 2023SpEL: Structured Prediction for Entity Linkingcited by 11
- 2021MOLEMAN: Mention-Only Linking of Entities with a Mention Annotation Networkcited by 10
- 2022Improving Candidate Retrieval with Entity Profile Generation for Wikidata Entity Linkingcited by 10
- 2023Synthetic Query Generation for Privacy-Preserving Deep Retrieval Systems using Differentially Private Language Modelscited by 10
- 2024Opt-Out: Investigating Entity-Level Unlearning for Large Language Models via Optimal Transportcited by 10
- 2021Deep Indexed Active Learning for Matching Heterogeneous Entity Representationscited by 9
- 2021MuVER: Improving First-Stage Entity Retrieval with Multi-View Entity Representationscited by 9
- 2022Modelling Commonsense Properties using Pre-Trained Bi-Encoderscited by 9
50 most cited of 122 All 122 (JSON)
- 2026Overview of BioASQ 2026: The fourteenth BioASQ Challenge on Large-Scale Biomedical Semantic Indexing and Question Answering30 Sep 2026
- 2026Bridging Lexical Divergence: LLM-Assisted, Cost-Efficient, Zero-shot Scientific Entity Linking31 Aug 2026
- 2026Select, Don't Train: The Benefits of Modular Entity Disambiguation with LLM-Based Selection17 Aug 2026
- 2026Real-Time Hard Negative Sampling via LLM-based Clustering for Large-Scale Two-Tower Retrieval1 Jul 2026
- 2026ATLAS: Article Tracking, Linking, and Analysis of Swedish Encyclopedias4 May 2026
- 2026ReNCE: Learning to Reason by Noise Contrastive Estimation30 Jan 2026
- 2025AIRwaves at CheckThat! 2025: Retrieving Scientific Sources for Implicit Claims on Social Media with Dual Encoders and Neural Re-Ranking23 Sep 2025
- 2025Efficient and Versatile Model for Multilingual Information Retrieval of Islamic Text: Development and Deployment in Real-World Scenarios18 Sep 2025
- 2025An Entity Linking Agent for Question Answering5 Aug 2025
- 2025Optimizing Legal Document Retrieval in Vietnamese with Semi-Hard Negative Mining19 Jul 2025
- 2025Semantic Certainty Assessment in Vector Retrieval Systems: A Novel Framework for Embedding Quality Evaluation8 Jul 2025
- 2025Entity-Augmented Neuroscience Knowledge Retrieval Using Ontology and Semantic Understanding Capability of LLM3 Jun 2025
38 more
- 2025Locality-Sensitive Hashing for Efficient Hard Negative Sampling in Contrastive Learning23 May 2025
- 2025Evaluating Design Decisions for Dual Encoder-based Entity Disambiguation16 May 2025
- 2025Generative AI Enhanced Financial Risk Management Information Retrieval4 Apr 2025
- 2025GFM-RAG: Graph Foundation Model for Retrieval Augmented Generation3 Feb 2025
- 2025Multi-stage Training of Bilingual Islamic LLM for Neural Passage Retrieval17 Jan 2025
- 2024Word Sense Linking: Disambiguating Outside the Sandbox12 Dec 2024
- 2024jina-clip-v2: Multilingual Multimodal Embeddings for Text and Images11 Dec 2024
- 2024Truth or Mirage? Towards End-to-End Factuality Evaluation with LLM-Oasis29 Nov 2024
- 2024Building an Efficient Multilingual Non-Profit IR System for the Islamic Domain Leveraging Multiprocessing Design in Rust9 Nov 2024
- 2024SAG: Style-Aligned Article Generation via Model Collaboration4 Oct 2024
- 2024A Fresh Take on Stale Embeddings: Improving Dense Retriever Training with Corrector Networks3 Sep 2024
- 2024Cross-lingual paraphrase identification21 Jun 2024
- 2024Opt-Out: Investigating Entity-Level Unlearning for Large Language Models via Optimal Transport18 Jun 2024
- 2024Corpus Poisoning via Approximate Greedy Gradient Descent7 Jun 2024
- 2024Comparing Neighbors Together Makes it Easy: Jointly Comparing Multiple Candidates for Efficient and Effective Retrieval21 May 2024
- 2024Identifying and Aligning Medical Claims Made on Social Media with Medical Evidence18 May 2024
- 2024BMRetriever: Tuning Large Language Models as Better Biomedical Text Retrievers29 Apr 2024
- 2024Improving Content Recommendation: Knowledge Graph-Based Semantic Contrastive Learning for Diversity and Cold-Start Users27 Mar 2024
- 2024Cross-lingual Contextualized Phrase Retrieval25 Mar 2024
- 2024Does Negative Sampling Matter? A Review with Insights into its Theory and Applications27 Feb 2024
- 2024User-LLM: Efficient LLM Contextualization with User Embeddings21 Feb 2024
- 2024Noise Contrastive Estimation-based Matching Framework for Low-Resource Security Attack Pattern Recognition18 Jan 2024
- 2024BELHD: Improving Biomedical Entity Linking with Homonoym Disambiguation10 Jan 2024
- 2024High-precision Voice Search Query Correction via Retrievable Speech-text Embedings8 Jan 2024
- 2023BED: Bi-Encoder-Decoder Model for Canonical Relation Extraction12 Dec 2023
- 2023Perturbation-based Active Learning for Question Answering4 Nov 2023
- 2023Dense Retrieval as Indirect Supervision for Large-space Decision Making28 Oct 2023
- 2023SpEL: Structured Prediction for Entity Linking23 Oct 2023
- 2023A Novel Information-Theoretic Objective to Disentangle Representations for Fair Classification21 Oct 2023
- 2023A Read-and-Select Framework for Zero-shot Entity Linking19 Oct 2023
- 2023SimCKP: Simple Contrastive Learning of Keyphrase Representations12 Oct 2023
- 2023DRIN: Dynamic Relation Interactive Network for Multimodal Entity Linking9 Oct 2023
- 2023Enhancing Open-Domain Table Question Answering via Syntax- and Structure-aware Dense Retrieval19 Sep 2023
- 2023Self-Supervised Contrastive BERT Fine-tuning for Fusion-based Reviewed-Item Retrieval1 Aug 2023
- 2023Decision-Focused Learning: Foundations, State of the Art, Benchmark and Future Opportunities25 Jul 2023
- 2023Improving Multitask Retrieval by Promoting Task Specialization1 Jul 2023
- 2023Neighborhood-based Hard Negative Mining for Sequential Recommendation12 Jun 2023
- 2023Event-Centric Query Expansion in Web Search30 May 2023
50 newest of 122 All 122 (JSON)
- 2021Retrieval Augmented Code Generation and Summarizationcited by 148
- 2025GFM-RAG: Graph Foundation Model for Retrieval Augmented Generationcited by 40
- 2024Corpus Poisoning via Approximate Greedy Gradient Descentcited by 21
- 2025An Entity Linking Agent for Question Answeringcited by 2
- 2025An Entity Linking Agent for Question Answering5 Aug 2025
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
- 2021Large Dual Encoders Are Generalizable Retrieverscited by 454
- 2021RocketQAv2: A Joint Training Method for Dense Passage Retrieval and Passage Re-rankingcited by 175
- 2023Decision-Focused Learning: Foundations, State of the Art, Benchmark and Future Opportunitiescited by 129
- 2022State-of-the-art generalisation research in NLP: A taxonomy and reviewcited by 97
- 2021Open Domain Question Answering over Tables via Dense Retrievalcited by 74
- 2024User-LLM: Efficient LLM Contextualization with User Embeddingscited by 74
- 2021PAIR: Leveraging Passage-Centric Similarity Relation for Improving Dense Passage Retrievalcited by 50
- 2022Questions Are All You Need to Train a Dense Passage Retrievercited by 47
- 2021One Question Answering Model for Many Languages with Cross-lingual Dense Passage Retrievalcited by 46
- 2021Improving Query Representations for Dense Retrieval with Pseudo Relevance Feedbackcited by 45
- 2021LightningDOT: Pre-training Visual-Semantic Embeddings for Real-Time Image-Text Retrievalcited by 44
12 most cited of 114 All 114 (JSON)
- 2026Overview of BioASQ 2026: The fourteenth BioASQ Challenge on Large-Scale Biomedical Semantic Indexing and Question Answering30 Sep 2026
- 2026Bridging Lexical Divergence: LLM-Assisted, Cost-Efficient, Zero-shot Scientific Entity Linking31 Aug 2026
- 2026Select, Don't Train: The Benefits of Modular Entity Disambiguation with LLM-Based Selection17 Aug 2026
- 2026Real-Time Hard Negative Sampling via LLM-based Clustering for Large-Scale Two-Tower Retrieval1 Jul 2026
- 2026ATLAS: Article Tracking, Linking, and Analysis of Swedish Encyclopedias4 May 2026
- 2025AIRwaves at CheckThat! 2025: Retrieving Scientific Sources for Implicit Claims on Social Media with Dual Encoders and Neural Re-Ranking23 Sep 2025
- 2025Efficient and Versatile Model for Multilingual Information Retrieval of Islamic Text: Development and Deployment in Real-World Scenarios18 Sep 2025
- 2025Optimizing Legal Document Retrieval in Vietnamese with Semi-Hard Negative Mining19 Jul 2025
- 2025Semantic Certainty Assessment in Vector Retrieval Systems: A Novel Framework for Embedding Quality Evaluation8 Jul 2025
- 2025Entity-Augmented Neuroscience Knowledge Retrieval Using Ontology and Semantic Understanding Capability of LLM3 Jun 2025
- 2025Locality-Sensitive Hashing for Efficient Hard Negative Sampling in Contrastive Learning23 May 2025
- 2025Evaluating Design Decisions for Dual Encoder-based Entity Disambiguation16 May 2025
12 newest of 114 All 114 (JSON)