mlsanityData to 7 Oct 2026

Empowering Language Model with Guided Knowledge Fusion for Biomedical Document Re-ranking

arXiv 2305.04344 ↗First posted 7 May 2023cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Pre-trained language models (PLMs) have proven to be effective for document re-ranking task. However, they lack the ability to fully interpret the semantics of biomedical and health-care queries and often rely on simplistic patterns for retrieving documents. To address this challenge, we propose an approach that integrates knowledge and the PLMs to guide the model toward effectively capturing information from external sources and retrieving the correct documents. We performed comprehensive experiments on two biomedical and open-domain datasets that show that our approach significantly improves vanilla PLMs and other existing approaches for document re-ranking task.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 31 of its 50 references that are in the map. First posted on arXiv 7 May 2023.

Builds on

31 of 50 references.

References · 31

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  5. 2017Graph Attention Networkscited by 8,854
  6. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  7. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
  8. 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,225
  9. 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,160
  10. 2016ConceptNet 5.5: An Open Multilingual Graph of General Knowledgecited by 1,065
  11. 2019Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inferencecited by 864
  12. 2020Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrievalcited by 846
19 more
  1. 2021QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answeringcited by 386
  2. 2020Document Ranking with a Pretrained Sequence-to-Sequence Modelcited by 373
  3. 2021Efficiently Teaching an Effective Dense Retriever with Balanced Topic Aware Samplingcited by 238
  4. 2020Self-Alignment Pretraining for Biomedical Entity Representationscited by 233
  5. 2019KagNet: Knowledge-Aware Graph Networks for Commonsense Reasoningcited by 216
  6. 2022GreaseLM: Graph REASoning Enhanced Language Models for Question Answeringcited by 170
  7. 2022Improving Passage Retrieval with Zero-Shot Question Generationcited by 164
  8. 2017A Knowledge-Grounded Neural Conversation Modelcited by 136
  9. 2020Scalable Multi-Hop Relational Reasoning for Knowledge-Aware Question Answeringcited by 122
  10. 2020Knowledge Graph-Augmented Abstractive Summarization with Semantic-Driven Cloze Rewardcited by 66
  11. 2020SPARTA: Efficient Open-Domain Question Answering via Sparse Transformer Matching Retrievalcited by 50
  12. 2018Pytrec_eval: An Extremely Fast Python Interface to trec_evalcited by 46
  13. 2020Learning-to-Rank with BERT in TF-Rankingcited by 36
  14. 2022Improving Biomedical Information Retrieval with Neural Retrieverscited by 20
  15. 2021Text-to-Text Multi-view Learning for Passage Re-rankingcited by 14
  16. 2021Overview of BioASQ 2020: The eighth BioASQ challenge on Large-Scale Biomedical Semantic Indexing and Question Answeringcited by 13
  17. 2022ED2LM: Encoder-Decoder to Language Model for Faster Document Re-ranking Inferencecited by 9
  18. 2021Co-BERT: A Context-Aware BERT Retrieval Model Incorporating Local and Query-specific Contextcited by 6
  19. 2018AUEB at BioASQ 6: Document and Snippet Retrievalcited by 5

Built on by

Not cited yet.