# IR-BERT: Leveraging BERT for Semantic Search in Background Linking for News Articles

arXiv: https://arxiv.org/abs/2007.12603 · HTML: https://mlsanity.com/paper/2007.12603/

## Key facts

- Cited by 7 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 24 Jul 2020.

## Built on by (most cited first, 7 of 7)

- [How Can Graph Neural Networks Help Document Retrieval: A Case Study on CORD19 with Concept Map Generation](https://mlsanity.com/paper/2201.04672/) (2022)
- [GlyphCRM: Bidirectional Encoder Representation for Chinese Character with its Glyph](https://mlsanity.com/paper/2107.00395/) (2021)
- [Unsupervised Identification of Relevant Prior Cases](https://mlsanity.com/paper/2107.08973/) (2021)
- [Improving Content Recommendation: Knowledge Graph-Based Semantic Contrastive Learning for Diversity and Cold-Start Users](https://mlsanity.com/paper/2403.18667/) (2024)
- [Dynamic Social Media Monitoring for Fast-Evolving Online Discussions](https://mlsanity.com/paper/2102.12596/) (2021)
- [Combining Objective and Subjective Perspectives for Political News Understanding](https://mlsanity.com/paper/2408.11174/) (2024)
- [Improving Clustering on Occupational Text Data through Dimensionality Reduction](https://mlsanity.com/paper/2507.07582/) (2025)

## Abstract (arXiv)

This work describes our two approaches for the background linking task of TREC 2020 News Track. The main objective of this task is to recommend a list of relevant articles that the reader should refer to in order to understand the context and gain background information of the query article. Our first approach focuses on building an effective search query by combining weighted keywords extracted from the query document and uses BM25 for retrieval. The second approach leverages the capability of SBERT (Nils Reimers et al.) to learn contextual representations of the query in order to perform semantic search over the corpus. We empirically show that employing a language model benefits our approach in understanding the context as well as the background of the query article. The proposed approaches are evaluated on the TREC 2018 Washington Post dataset and our best model outperforms the TREC median as well as the highest scoring model of 2018 in terms of the nDCG@5 metric. We further propose a diversity measure to evaluate the effectiveness of the various approaches in retrieving a diverse set of documents. This would potentially motivate researchers to work on introducing diversity in their recommended list. We have open sourced our implementation on Github and plan to submit our runs for the background linking task in TREC 2020.