mlsanityData to 7 Oct 2026

DREQ: Document Re-Ranking Using Entity-based Query Understanding

arXiv 2401.05939 ↗First posted 11 Jan 2024cs.IR cs.AIcited by 5

Not on the map. Why?

Abstract (arXiv)

While entity-oriented neural IR models have advanced significantly, they often overlook a key nuance: the varying degrees of influence individual entities within a document have on its overall relevance. Addressing this gap, we present DREQ, an entity-oriented dense document re-ranking model. Uniquely, we emphasize the query-relevant entities within a document's representation while simultaneously attenuating the less relevant ones, thus obtaining a query-specific entity-centric document representation. We then combine this entity-centric document representation with the text-centric representation of the document to obtain a "hybrid" representation of the document. We learn a relevance score for the document using this hybrid representation. Using four large-scale benchmarks, we show that DREQ outperforms state-of-the-art neural and non-neural re-ranking methods, highlighting the effectiveness of our entity-oriented representation approach.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 35 of its 74 references that are in the map. First posted on arXiv 11 Jan 2024.

Builds on

35 of 74 references.

References · 35

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  5. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  6. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,157
  7. 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,591
  8. 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,160
  9. 2020Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrievalcited by 846
  10. 2019Passage Re-ranking with BERTcited by 629
  11. 2019ERNIE: Enhanced Language Representation with Informative Entitiescited by 525
  12. 2020Autoregressive Entity Retrievalcited by 333
23 more
  1. 2019Document Expansion by Query Predictioncited by 225
  2. 2019Multi-Stage Document Ranking with BERTcited by 200
  3. 2017A Deep Relevance Matching Model for Ad-hoc Retrievalcited by 126
  4. 2022RankT5: Fine-Tuning T5 for Text Ranking with Ranking Lossescited by 114
  5. 2019Deeper Text Understanding for IR with Contextual Neural Language Modelingcited by 111
  6. 2020ConvBERT: Improving BERT with Span-based Dynamic Convolutioncited by 88
  7. 2017End-to-End Neural Ad-hoc Ranking with Kernel Poolingcited by 85
  8. 2019CEDR: Contextualized Embeddings for Document Rankingcited by 77
  9. 2021Improving Query Representations for Dense Retrieval with Pseudo Relevance Feedbackcited by 45
  10. 2020PARADE: Passage Representation Aggregation for Document Rerankingcited by 44
  11. 2020BERT-QE: Contextualized Query Expansion for Document Re-rankingcited by 40
  12. 2018Entity-Duet Neural Ranking: Understanding the Role of Knowledge Graph Semantics in Neural Information Retrievalcited by 33
  13. 2017PACRR: A Position-Aware Neural IR Model for Relevance Matchingcited by 22
  14. 2017Word-Entity Duet Representations for Document Rankingcited by 16
  15. 2018NPRF: A Neural Pseudo Relevance Feedback Framework for Ad-hoc Information Retrievalcited by 16
  16. 2019An Updated Duet Model for Passage Re-rankingcited by 12
  17. 2020Graph-Embedding Empowered Entity Retrievalcited by 10
  18. 2022Entity-aware Transformers for Entity Searchcited by 10
  19. 2014Wikipedia-based Semantic Interpretation for Natural Language Processingcited by 9
  20. 2018Towards Better Text Understanding and Retrieval through Kernel Entity Salience Modelingcited by 9
  21. 2022CODEC: Complex Document and Entity Collectioncited by 7
  22. 2018Representation Learning of Entities and Documents from Knowledge Base Descriptionscited by 5
  23. 2017On Type-Aware Entity Retrievalcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 4; 2026: 1.

5 papers.